2023-11-06T13:12:53.715 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-06T13:12:53.716 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256 --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} --name vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256/orig.config.yaml 2023-11-06T13:12:53.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T13:12:53.851 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256 branch: wip-vshankar-testing1-2023-11-02-1726-pacific description: fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} email: vshankar@redhat.com first_in_suite: false job_id: '7449256' kernel: client: sha1: distro flavor: default kdb: true sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-vshankar-testing1-2023-11-02-1726-pacific ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 4e03306bd00b0abb2be37dbc132f82d281f8973d subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 4e03306bd00b0abb2be37dbc132f82d281f8973d kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-11-02-1726-pacific sha1: 4e03306bd00b0abb2be37dbc132f82d281f8973d owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6875 sha1: 4e03306bd00b0abb2be37dbc132f82d281f8973d sleep_before_teardown: 0 subset: 378/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-11-02-1726-pacific suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4e03306bd00b0abb2be37dbc132f82d281f8973d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4e03306bd00b0abb2be37dbc132f82d281f8973d targets: smithi038.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdhziK/MsV5hX/ovMyvpSdJOVgUMi1WviQ8P5QxWKxdSz1tZC4PYK3pkUzq6tbim0lKAT/yJ4rXMzIQx6dtTw0= smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICqH6xTedLk/Xlsz8Hp9CPLX9Z0aLNdYaQkM0Tl/5z8QJwzX7+L6IS0T6hWoCEXGGmpkCZOvPLKHmhL937d2IA= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwsShdu7BucVMqYkuoB70ScIFqIAtaYU/YlbtaDtirFZc+vZtcI8jz/QkgI/Le/+X6qx7EjeI54PKNRVFG/NIg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - check-counter: {} - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-06_07:50:57 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-06T13:12:53.851 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4e03306bd00b0abb2be37dbc132f82d281f8973d/qa; will attempt to use it 2023-11-06T13:12:53.852 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4e03306bd00b0abb2be37dbc132f82d281f8973d/qa/tasks 2023-11-06T13:12:53.852 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-06T13:12:53.854 INFO:teuthology.task.internal:Checking packages... 2023-11-06T13:12:53.878 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4e03306bd00b0abb2be37dbc132f82d281f8973d' 2023-11-06T13:12:53.878 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-06T13:12:53.879 INFO:teuthology.packaging:ref: None 2023-11-06T13:12:53.879 INFO:teuthology.packaging:tag: None 2023-11-06T13:12:53.879 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-11-02-1726-pacific 2023-11-06T13:12:53.879 INFO:teuthology.packaging:sha1: 4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:12:53.880 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing1-2023-11-02-1726-pacific 2023-11-06T13:12:54.016 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-132.g4e03306b 2023-11-06T13:12:54.017 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-06T13:12:54.023 INFO:teuthology.task.internal:no buildpackages task found 2023-11-06T13:12:54.024 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-06T13:12:54.069 INFO:teuthology.task.internal:Saving configuration 2023-11-06T13:12:54.088 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-06T13:12:54.099 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-06T13:12:54.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 13:06:54.626742', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdhziK/MsV5hX/ovMyvpSdJOVgUMi1WviQ8P5QxWKxdSz1tZC4PYK3pkUzq6tbim0lKAT/yJ4rXMzIQx6dtTw0='} 2023-11-06T13:12:54.147 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 13:06:54.623992', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICqH6xTedLk/Xlsz8Hp9CPLX9Z0aLNdYaQkM0Tl/5z8QJwzX7+L6IS0T6hWoCEXGGmpkCZOvPLKHmhL937d2IA='} 2023-11-06T13:12:54.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 13:06:54.625468', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwsShdu7BucVMqYkuoB70ScIFqIAtaYU/YlbtaDtirFZc+vZtcI8jz/QkgI/Le/+X6qx7EjeI54PKNRVFG/NIg='} 2023-11-06T13:12:54.168 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-06T13:12:54.177 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-11-06T13:12:54.177 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-11-06T13:12:54.177 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-11-06T13:12:54.177 INFO:teuthology.run_tasks:Running task console_log... 2023-11-06T13:12:54.299 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6872337af0>, signals=[15]) 2023-11-06T13:12:54.301 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-06T13:12:54.312 INFO:teuthology.task.internal:Opening connections... 2023-11-06T13:12:54.313 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:12:54.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:12:54.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2023-11-06T13:12:54.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:12:54.453 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2023-11-06T13:12:54.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:12:54.521 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-06T13:12:54.530 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-11-06T13:12:54.548 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-11-06T13:12:54.548 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-11-06T13:12:54.604 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-11-06T13:12:54.605 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.4 (Ootpa)" 2023-11-06T13:12:54.605 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-11-06T13:12:54.605 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-11-06T13:12:54.605 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.4" 2023-11-06T13:12:54.606 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-11-06T13:12:54.606 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-06T13:12:54.606 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-11-06T13:12:54.606 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-06T13:12:54.606 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-11-06T13:12:54.607 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-06T13:12:54.607 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T13:12:54.607 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:12:54.607 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-06T13:12:54.608 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-06T13:12:54.608 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-06T13:12:54.608 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-06T13:12:54.609 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-11-06T13:12:54.632 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2023-11-06T13:12:54.650 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2023-11-06T13:12:54.651 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-11-06T13:12:54.708 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux" 2023-11-06T13:12:54.708 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.4 (Ootpa)" 2023-11-06T13:12:54.708 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel" 2023-11-06T13:12:54.708 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora" 2023-11-06T13:12:54.709 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.4" 2023-11-06T13:12:54.709 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8" 2023-11-06T13:12:54.709 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-06T13:12:54.709 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-11-06T13:12:54.710 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-06T13:12:54.710 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/" 2023-11-06T13:12:54.710 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-06T13:12:54.710 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T13:12:54.710 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:12:54.711 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-06T13:12:54.711 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-06T13:12:54.711 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-06T13:12:54.711 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-06T13:12:54.712 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-11-06T13:12:54.731 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-11-06T13:12:54.748 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-11-06T13:12:54.749 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-11-06T13:12:54.805 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-11-06T13:12:54.806 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.4 (Ootpa)" 2023-11-06T13:12:54.806 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-11-06T13:12:54.806 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-11-06T13:12:54.806 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.4" 2023-11-06T13:12:54.807 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-11-06T13:12:54.807 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-06T13:12:54.807 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-11-06T13:12:54.807 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-06T13:12:54.807 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-11-06T13:12:54.808 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-06T13:12:54.808 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T13:12:54.808 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:12:54.808 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-06T13:12:54.808 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-06T13:12:54.809 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-06T13:12:54.809 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-06T13:12:54.809 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-11-06T13:12:54.831 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-06T13:12:54.845 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-06T13:12:54.855 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-06T13:12:54.855 DEBUG:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2023-11-06T13:12:54.859 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2023-11-06T13:12:54.862 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2023-11-06T13:12:54.877 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-06T13:12:54.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-06T13:12:54.889 DEBUG:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2023-11-06T13:12:54.916 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2023-11-06T13:12:54.918 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2023-11-06T13:12:54.930 INFO:teuthology.orchestra.run.smithi038.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-06T13:12:54.933 INFO:teuthology.orchestra.run.smithi044.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-06T13:12:54.934 INFO:teuthology.orchestra.run.smithi163.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-11-06T13:12:54.935 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-06T13:12:55.013 INFO:teuthology.run_tasks:Running task kernel... 2023-11-06T13:12:55.032 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'} 2023-11-06T13:12:55.033 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-11-06T13:12:55.034 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-11-06T13:12:55.034 DEBUG:teuthology.orchestra.run.smithi038:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-06T13:12:55.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-06T13:12:55.051 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-11-06T13:12:55.108 INFO:teuthology.orchestra.run.smithi038.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-11-06T13:12:55.108 INFO:teuthology.task.kernel:Running kernel on smithi038: 4.18.0-305.25.1.el8_4.x86_64 2023-11-06T13:12:55.109 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2023-11-06T13:12:56.646 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2023-11-06T13:12:56.646 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2023-11-06T13:12:58.172 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-11-06T13:12:59.787 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-11-06T13:13:03.351 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 1.7 MB/s | 24 kB 00:00 2023-11-06T13:13:04.113 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-11-06T13:13:04.113 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-11-06T13:13:04.113 INFO:teuthology.orchestra.run.smithi038.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-11-06T13:13:04.269 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-11-06T13:13:04.270 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do. 2023-11-06T13:13:04.270 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-11-06T13:13:04.402 DEBUG:teuthology.orchestra.run.smithi038:> echo no | sudo yum reinstall kernel || true 2023-11-06T13:13:04.808 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2023-11-06T13:13:04.809 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2023-11-06T13:13:05.116 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 Nov 2023 01:13:03 PM UTC. 2023-11-06T13:13:05.248 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-06T13:13:05.248 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-06T13:13:05.249 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-06T13:13:05.273 INFO:teuthology.orchestra.run.smithi038.stderr:Error: No packages marked for reinstall. 2023-11-06T13:13:05.324 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum reinstall -y kernel || true 2023-11-06T13:13:05.690 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2023-11-06T13:13:05.690 INFO:teuthology.orchestra.run.smithi038.stdout:Unable to read consumer identity 2023-11-06T13:13:05.989 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:00:02 ago on Mon 06 Nov 2023 01:13:03 PM UTC. 2023-11-06T13:13:06.133 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-11-06T13:13:06.133 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-06T13:13:06.134 INFO:teuthology.orchestra.run.smithi038.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-11-06T13:13:06.147 INFO:teuthology.orchestra.run.smithi038.stderr:Error: No packages marked for reinstall. 2023-11-06T13:13:06.204 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2023-11-06T13:13:06.334 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:06.334 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:06.335 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:06.335 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-06T13:13:06.335 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-06T13:13:06.335 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-11-06T13:13:06.336 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2023-11-06T13:13:06.336 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q kernel | sort -rV | head -n 1 2023-11-06T13:13:06.466 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:06.467 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:06.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2-tools 2023-11-06T13:13:06.495 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2-tools 2023-11-06T13:13:06.496 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2023-11-06T13:13:06.496 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.02 2023-11-06T13:13:06.496 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 99.el8_4.1 2023-11-06T13:13:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2023-11-06T13:13:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-11-06T13:13:06.497 INFO:teuthology.orchestra.run.smithi038.stdout:Group : System Environment/Base 2023-11-06T13:13:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 9264631 2023-11-06T13:13:06.498 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2023-11-06T13:13:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-11-06T13:13:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-11-06T13:13:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-11-06T13:13:06.499 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-11-06T13:13:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:Relocations : (not relocatable) 2023-11-06T13:13:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : Red Hat, Inc. 2023-11-06T13:13:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : Red Hat, Inc. 2023-11-06T13:13:06.500 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-06T13:13:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Support tools for GRUB. 2023-11-06T13:13:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2023-11-06T13:13:06.501 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:13:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-06T13:13:06.501 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-06T13:13:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-06T13:13:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2023-11-06T13:13:06.502 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:13:06.502 INFO:teuthology.orchestra.run.smithi038.stdout:This subpackage provides tools for support of all platforms. 2023-11-06T13:13:06.504 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-06T13:13:06.504 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:06.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-06T13:13:07.776 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2023-11-06T13:13:10.229 INFO:teuthology.orchestra.run.smithi038.stderr:done 2023-11-06T13:13:10.230 DEBUG:teuthology.orchestra.run.smithi038:> mktemp 2023-11-06T13:13:10.267 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.06B9xAwl2i 2023-11-06T13:13:10.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.06B9xAwl2i 2023-11-06T13:13:10.336 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.06B9xAwl2i 2023-11-06T13:13:10.506 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.06B9xAwl2i is 6KB 2023-11-06T13:13:10.554 DEBUG:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.06B9xAwl2i 2023-11-06T13:13:10.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo /bin/ls /boot/loader/entries || true 2023-11-06T13:13:10.636 INFO:teuthology.orchestra.run.smithi038.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-11-06T13:13:10.637 INFO:teuthology.orchestra.run.smithi038.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-11-06T13:13:10.637 INFO:teuthology.orchestra.run.smithi038.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-11-06T13:13:10.638 INFO:teuthology.orchestra.run.smithi038.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-11-06T13:13:10.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-11-06T13:13:10.818 DEBUG:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2023-11-06T13:13:40.820 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-06T13:13:40.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-11-06T13:13:40.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:14:40.824 DEBUG:teuthology.orchestra.remote:timed out 2023-11-06T13:14:49.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-11-06T13:14:49.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:14:53.458 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-11-06T13:14:53.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-11-06T13:14:53.714 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-11-06T13:14:53.714 DEBUG:teuthology.orchestra.run.smithi038:> uname -r 2023-11-06T13:14:53.729 INFO:teuthology.orchestra.run.smithi038.stdout:4.18.0-425.3.1.el8.x86_64 2023-11-06T13:14:53.730 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-11-06T13:14:53.730 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-06T13:14:53.730 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-11-06T13:14:54.731 DEBUG:teuthology.parallel:result is None 2023-11-06T13:14:54.732 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-06T13:14:54.739 INFO:teuthology.task.internal:Creating test directory... 2023-11-06T13:14:54.739 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-06T13:14:54.742 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-06T13:14:54.745 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-06T13:14:54.763 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-06T13:14:54.770 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-06T13:14:54.781 INFO:teuthology.task.internal:Creating archive directory... 2023-11-06T13:14:54.781 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-06T13:14:54.799 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-06T13:14:54.802 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-06T13:14:54.844 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-06T13:14:54.852 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-06T13:14:54.853 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-06T13:14:54.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-06T13:14:54.883 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-06T13:14:54.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-06T13:14:54.900 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-06T13:14:54.903 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-06T13:14:54.926 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-06T13:14:54.963 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-06T13:14:54.984 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-06T13:14:54.985 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-06T13:14:55.028 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-06T13:14:55.098 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-06T13:14:55.110 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-06T13:14:55.112 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-06T13:14:55.124 INFO:teuthology.task.internal:Configuring sudo... 2023-11-06T13:14:55.124 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-06T13:14:55.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-06T13:14:55.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-06T13:14:55.160 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-06T13:14:55.169 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-06T13:14:55.169 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-06T13:14:55.196 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-06T13:14:55.199 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-06T13:14:55.215 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-06T13:14:55.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-06T13:14:55.370 DEBUG:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-06T13:14:55.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-06T13:14:55.455 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:14:55.455 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-06T13:14:55.525 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-06T13:14:55.566 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-06T13:14:55.615 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-06T13:14:55.699 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-06T13:14:55.744 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:14:55.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-06T13:14:55.813 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-06T13:14:55.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-06T13:14:55.902 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-06T13:14:55.984 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-06T13:14:56.026 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:14:56.027 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-06T13:14:56.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2023-11-06T13:14:56.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2023-11-06T13:14:56.098 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2023-11-06T13:14:56.154 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-06T13:14:56.189 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-06T13:14:56.190 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-06T13:14:56.570 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-06T13:14:56.579 INFO:teuthology.task.internal:Starting timer... 2023-11-06T13:14:56.579 INFO:teuthology.run_tasks:Running task pcp... 2023-11-06T13:14:56.620 INFO:teuthology.run_tasks:Running task selinux... 2023-11-06T13:14:56.632 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-11-06T13:14:56.633 DEBUG:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2023-11-06T13:14:56.730 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: [ OK ] 2023-11-06T13:14:56.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2023-11-06T13:14:56.792 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: [ OK ] 2023-11-06T13:14:56.793 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2023-11-06T13:14:56.855 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: [ OK ] 2023-11-06T13:14:56.856 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-06T13:14:56.857 DEBUG:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2023-11-06T13:14:56.886 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2023-11-06T13:14:56.887 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2023-11-06T13:14:56.912 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2023-11-06T13:14:56.912 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2023-11-06T13:14:56.940 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2023-11-06T13:14:56.940 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi038.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive'} 2023-11-06T13:14:56.941 DEBUG:teuthology.orchestra.run.smithi038:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-06T13:14:56.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-06T13:14:56.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-06T13:14:56.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-06T13:14:56.996 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-06T13:14:57.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-06T13:14:57.022 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-06T13:14:57.022 DEBUG:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2023-11-06T13:14:57.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2023-11-06T13:14:57.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2023-11-06T13:14:57.120 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-06T13:14:57.131 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-06T13:14:57.132 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-06T13:14:57.156 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-06T13:14:57.157 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi044.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-06T13:23:49.968 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2023-11-06T13:23:49.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-11-06T13:23:49.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:23:50.041 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-11-06T13:23:50.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-11-06T13:23:50.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-06T13:23:50.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:23:50.184 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-11-06T13:23:50.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-11-06T13:23:50.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-11-06T13:23:50.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T13:23:50.367 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-11-06T13:23:50.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-11-06T13:23:50.392 INFO:teuthology.run_tasks:Running task clock... 2023-11-06T13:23:50.402 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-06T13:23:50.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-06T13:23:50.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-06T13:23:50.406 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-06T13:23:50.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-06T13:23:50.409 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-06T13:23:50.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-06T13:23:50.435 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-06T13:23:50.440 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-06T13:23:50.450 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-06T13:23:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-06T13:23:50.463 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-06T13:23:50.478 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-06T13:23:50.486 INFO:teuthology.orchestra.run.smithi038.stderr:sudo: ntpd: command not found 2023-11-06T13:23:50.497 INFO:teuthology.orchestra.run.smithi038.stdout:506 Cannot talk to daemon 2023-11-06T13:23:50.499 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2023-11-06T13:23:50.511 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2023-11-06T13:23:50.511 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-06T13:23:50.516 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2023-11-06T13:23:50.525 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-06T13:23:50.526 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-06T13:23:50.526 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2023-11-06T13:23:50.540 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-06T13:23:50.541 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-06T13:23:50.554 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-06T13:23:50.591 INFO:teuthology.orchestra.run.smithi038.stderr:bash: ntpq: command not found 2023-11-06T13:23:50.595 INFO:teuthology.orchestra.run.smithi038.stdout:210 Number of sources = 4 2023-11-06T13:23:50.596 INFO:teuthology.orchestra.run.smithi038.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-06T13:23:50.596 INFO:teuthology.orchestra.run.smithi038.stdout:=============================================================================== 2023-11-06T13:23:50.597 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.597 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.598 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.599 INFO:teuthology.orchestra.run.smithi038.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.607 INFO:teuthology.orchestra.run.smithi044.stderr:bash: ntpq: command not found 2023-11-06T13:23:50.609 INFO:teuthology.orchestra.run.smithi044.stdout:210 Number of sources = 4 2023-11-06T13:23:50.609 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-06T13:23:50.609 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2023-11-06T13:23:50.610 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.610 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.610 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.610 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.613 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-11-06T13:23:50.616 INFO:teuthology.orchestra.run.smithi163.stdout:210 Number of sources = 4 2023-11-06T13:23:50.616 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-06T13:23:50.617 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-11-06T13:23:50.617 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.617 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.618 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.618 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-06T13:23:50.618 INFO:teuthology.run_tasks:Running task install... 2023-11-06T13:23:50.628 DEBUG:teuthology.task.install:project ceph 2023-11-06T13:23:50.629 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d'}} 2023-11-06T13:23:50.629 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d'} 2023-11-06T13:23:50.629 INFO:teuthology.task.install:Using flavor: default 2023-11-06T13:23:50.636 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-06T13:23:50.637 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-06T13:23:50.638 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d', 'tag': None, 'wait_for_package': False} 2023-11-06T13:23:50.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:23:50.641 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d', 'tag': None, 'wait_for_package': False} 2023-11-06T13:23:50.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:23:50.643 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d', 'tag': None, 'wait_for_package': False} 2023-11-06T13:23:50.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:23:50.786 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/ 2023-11-06T13:23:50.787 INFO:teuthology.task.install.rpm:Package version is 16.2.14-132.g4e03306b 2023-11-06T13:23:50.801 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/ 2023-11-06T13:23:50.802 INFO:teuthology.task.install.rpm:Package version is 16.2.14-132.g4e03306b 2023-11-06T13:23:50.807 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/ 2023-11-06T13:23:50.808 INFO:teuthology.task.install.rpm:Package version is 16.2.14-132.g4e03306b 2023-11-06T13:23:51.126 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-06T13:23:51.127 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:23:51.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-06T13:23:51.157 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-06T13:23:51.157 DEBUG:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e03306bd00b0abb2be37dbc132f82d281f8973d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-06T13:23:51.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-06T13:23:51.283 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-06T13:23:51.283 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:23:51.284 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-06T13:23:51.302 DEBUG:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-06T13:23:51.306 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-11-02-1726-pacific/4e03306bd00b0abb2be37dbc132f82d281f8973d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-06T13:23:51.306 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:23:51.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-06T13:23:51.309 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-06T13:23:51.309 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e03306bd00b0abb2be37dbc132f82d281f8973d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-06T13:23:51.337 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-11-06T13:23:51.338 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e03306bd00b0abb2be37dbc132f82d281f8973d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-06T13:23:51.366 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2023-11-06T13:23:51.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum clean all 2023-11-06T13:23:51.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-06T13:23:51.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-06T13:23:51.449 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-06T13:23:51.488 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-06T13:23:51.512 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2023-11-06T13:23:51.513 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2023-11-06T13:23:51.555 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2023-11-06T13:23:51.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2023-11-06T13:23:51.776 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2023-11-06T13:23:51.898 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-11-06T13:23:51.967 INFO:teuthology.orchestra.run.smithi044.stdout:Updating Subscription Management repositories. 2023-11-06T13:23:52.139 INFO:teuthology.orchestra.run.smithi038.stdout:44 files removed 2023-11-06T13:23:52.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-06T13:23:52.226 INFO:teuthology.orchestra.run.smithi163.stdout:44 files removed 2023-11-06T13:23:52.276 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-06T13:23:52.329 INFO:teuthology.orchestra.run.smithi044.stdout:44 files removed 2023-11-06T13:23:52.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-11-06T13:23:52.568 INFO:teuthology.orchestra.run.smithi038.stdout:Updating Subscription Management repositories. 2023-11-06T13:23:52.620 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-11-06T13:23:52.746 INFO:teuthology.orchestra.run.smithi044.stdout:Updating Subscription Management repositories. 2023-11-06T13:23:54.145 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 72 kB/s | 76 kB 00:01 2023-11-06T13:23:54.199 INFO:teuthology.orchestra.run.smithi038.stdout:ceph packages for x86_64 69 kB/s | 76 kB 00:01 2023-11-06T13:23:54.338 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 68 kB/s | 76 kB 00:01 2023-11-06T13:23:54.822 INFO:teuthology.orchestra.run.smithi038.stdout:ceph noarch packages 27 kB/s | 15 kB 00:00 2023-11-06T13:23:55.015 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 19 kB/s | 15 kB 00:00 2023-11-06T13:23:55.250 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 18 kB/s | 15 kB 00:00 2023-11-06T13:23:55.666 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 2.3 kB/s | 1.4 kB 00:00 2023-11-06T13:23:55.760 INFO:teuthology.orchestra.run.smithi038.stdout:ceph source packages 1.6 kB/s | 1.4 kB 00:00 2023-11-06T13:23:55.770 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 48 kB/s | 3.5 kB 00:00 2023-11-06T13:23:55.868 INFO:teuthology.orchestra.run.smithi038.stdout:Copr repo for python3-asyncssh owned by ceph 46 kB/s | 3.5 kB 00:00 2023-11-06T13:23:55.931 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 2.2 kB/s | 1.4 kB 00:00 2023-11-06T13:23:56.036 INFO:teuthology.orchestra.run.smithi044.stdout:Copr repo for python3-asyncssh owned by ceph 48 kB/s | 3.5 kB 00:00 2023-11-06T13:23:57.554 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2023-11-06T13:23:57.951 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-11-06T13:24:00.823 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-11-06T13:24:01.175 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 122 MB/s | 33 MB 00:00 2023-11-06T13:24:01.502 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-11-06T13:24:01.894 INFO:teuthology.orchestra.run.smithi044.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 108 MB/s | 33 MB 00:00 2023-11-06T13:24:06.302 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 128 MB/s | 38 MB 00:00 2023-11-06T13:24:07.445 INFO:teuthology.orchestra.run.smithi044.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 113 MB/s | 38 MB 00:00 2023-11-06T13:24:14.773 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-06T13:24:14.774 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-06T13:24:14.784 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-06T13:24:14.785 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-06T13:24:14.786 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-06T13:24:14.787 INFO:teuthology.orchestra.run.smithi163.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-06T13:24:14.788 INFO:teuthology.orchestra.run.smithi163.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-06T13:24:14.791 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-06T13:24:14.792 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-06T13:24:15.285 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-11-06T13:24:15.297 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================================================== 2023-11-06T13:24:15.297 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2023-11-06T13:24:15.297 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================================================== 2023-11-06T13:24:15.297 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2023-11-06T13:24:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-06T13:24:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:16.2.14-132.g4e03306b.el8 ceph 6.4 k 2023-11-06T13:24:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:16.2.14-132.g4e03306b.el8 ceph 6.1 M 2023-11-06T13:24:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 910 k 2023-11-06T13:24:15.298 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-132.g4e03306b.el8 ceph 161 k 2023-11-06T13:24:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:16.2.14-132.g4e03306b.el8 ceph 1.6 M 2023-11-06T13:24:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 116 k 2023-11-06T13:24:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 3.1 M 2023-11-06T13:24:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 8.6 M 2023-11-06T13:24:15.299 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 27 k 2023-11-06T13:24:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:16.2.14-132.g4e03306b.el8 ceph 12 M 2023-11-06T13:24:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:16.2.14-132.g4e03306b.el8 ceph 52 M 2023-11-06T13:24:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 85 k 2023-11-06T13:24:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror x86_64 2:16.2.14-132.g4e03306b.el8 ceph 257 k 2023-11-06T13:24:15.300 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 19 k 2023-11-06T13:24:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-06T13:24:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-06T13:24:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-06T13:24:15.301 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:16.2.14-132.g4e03306b.el8 ceph 25 k 2023-11-06T13:24:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 824 k 2023-11-06T13:24:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:16.2.14-132.g4e03306b.el8 ceph 131 k 2023-11-06T13:24:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-06T13:24:15.302 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-06T13:24:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-06T13:24:15.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:16.2.14-132.g4e03306b.el8 ceph 215 k 2023-11-06T13:24:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:16.2.14-132.g4e03306b.el8 ceph 390 k 2023-11-06T13:24:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 369 k 2023-11-06T13:24:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:16.2.14-132.g4e03306b.el8 ceph 114 k 2023-11-06T13:24:15.304 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 88 k 2023-11-06T13:24:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.7 M 2023-11-06T13:24:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 173 k 2023-11-06T13:24:15.305 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-06T13:24:15.305 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2023-11-06T13:24:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.7 M 2023-11-06T13:24:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 4.2 M 2023-11-06T13:24:15.306 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-11-06T13:24:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-06T13:24:15.306 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:16.2.14-132.g4e03306b.el8 ceph 24 M 2023-11-06T13:24:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 24 k 2023-11-06T13:24:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:16.2.14-132.g4e03306b.el8 ceph 2.4 M 2023-11-06T13:24:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 245 k 2023-11-06T13:24:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:16.2.14-132.g4e03306b.el8 ceph 5.0 M 2023-11-06T13:24:15.307 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 18 M 2023-11-06T13:24:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 15 k 2023-11-06T13:24:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:16.2.14-132.g4e03306b.el8 ceph 26 k 2023-11-06T13:24:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-06T13:24:15.308 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-06T13:24:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-06T13:24:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-06T13:24:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-06T13:24:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-06T13:24:15.309 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:16.2.14-132.g4e03306b.el8 ceph 174 k 2023-11-06T13:24:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-06T13:24:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-06T13:24:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-06T13:24:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-06T13:24:15.310 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-06T13:24:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 494 k 2023-11-06T13:24:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-06T13:24:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.8 M 2023-11-06T13:24:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-06T13:24:15.311 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-06T13:24:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-06T13:24:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-06T13:24:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-06T13:24:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-06T13:24:15.312 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-06T13:24:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-06T13:24:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-06T13:24:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-06T13:24:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-06T13:24:15.313 INFO:teuthology.orchestra.run.smithi163.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-06T13:24:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-06T13:24:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-06T13:24:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-06T13:24:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-06T13:24:15.314 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 45 k 2023-11-06T13:24:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:16.2.14-132.g4e03306b.el8 ceph 99 k 2023-11-06T13:24:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-06T13:24:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-06T13:24:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-06T13:24:15.315 INFO:teuthology.orchestra.run.smithi163.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-06T13:24:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-06T13:24:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-06T13:24:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-06T13:24:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-06T13:24:15.316 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-06T13:24:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-06T13:24:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-06T13:24:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-06T13:24:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-06T13:24:15.317 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-06T13:24:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-06T13:24:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-06T13:24:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-06T13:24:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-06T13:24:15.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-06T13:24:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-06T13:24:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-06T13:24:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-06T13:24:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-06T13:24:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-06T13:24:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-06T13:24:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-06T13:24:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-06T13:24:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-06T13:24:15.320 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-06T13:24:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-06T13:24:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-06T13:24:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-06T13:24:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-06T13:24:15.321 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-06T13:24:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-06T13:24:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-06T13:24:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-06T13:24:15.322 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-06T13:24:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-06T13:24:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-06T13:24:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-06T13:24:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-06T13:24:15.323 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-06T13:24:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-06T13:24:15.324 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:24:15.324 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-11-06T13:24:15.324 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================================================== 2023-11-06T13:24:15.324 INFO:teuthology.orchestra.run.smithi163.stdout:Install 118 Packages 2023-11-06T13:24:15.325 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 2 Packages 2023-11-06T13:24:15.325 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:24:15.326 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 201 M 2023-11-06T13:24:15.326 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-11-06T13:24:15.638 INFO:teuthology.orchestra.run.smithi163.stdout:(1/120): ceph-16.2.14-132.g4e03306b.el8.x86_64. 68 kB/s | 6.4 kB 00:00 2023-11-06T13:24:15.814 INFO:teuthology.orchestra.run.smithi163.stdout:(2/120): ceph-fuse-16.2.14-132.g4e03306b.el8.x8 5.1 MB/s | 910 kB 00:00 2023-11-06T13:24:15.844 INFO:teuthology.orchestra.run.smithi163.stdout:(3/120): ceph-immutable-object-cache-16.2.14-13 5.3 MB/s | 161 kB 00:00 2023-11-06T13:24:16.303 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-06T13:24:16.304 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-06T13:24:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-06T13:24:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-06T13:24:16.317 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-06T13:24:16.318 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-06T13:24:16.320 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-06T13:24:16.322 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-06T13:24:16.323 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-06T13:24:16.443 INFO:teuthology.orchestra.run.smithi163.stdout:(4/120): ceph-mds-16.2.14-132.g4e03306b.el8.x86 4.1 MB/s | 2.4 MB 00:00 2023-11-06T13:24:16.793 INFO:teuthology.orchestra.run.smithi038.stdout:Extra Packages for Enterprise Linux 781 kB/s | 16 MB 00:20 2023-11-06T13:24:16.840 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2023-11-06T13:24:16.852 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================================== 2023-11-06T13:24:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2023-11-06T13:24:16.853 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================================== 2023-11-06T13:24:16.853 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2023-11-06T13:24:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-06T13:24:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:16.2.14-132.g4e03306b.el8 ceph 6.4 k 2023-11-06T13:24:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:16.2.14-132.g4e03306b.el8 ceph 6.1 M 2023-11-06T13:24:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 910 k 2023-11-06T13:24:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-132.g4e03306b.el8 ceph 161 k 2023-11-06T13:24:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:16.2.14-132.g4e03306b.el8 ceph 1.6 M 2023-11-06T13:24:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 116 k 2023-11-06T13:24:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 3.1 M 2023-11-06T13:24:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 8.6 M 2023-11-06T13:24:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 27 k 2023-11-06T13:24:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:16.2.14-132.g4e03306b.el8 ceph 12 M 2023-11-06T13:24:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:16.2.14-132.g4e03306b.el8 ceph 52 M 2023-11-06T13:24:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 85 k 2023-11-06T13:24:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:16.2.14-132.g4e03306b.el8 ceph 257 k 2023-11-06T13:24:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 19 k 2023-11-06T13:24:16.856 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-06T13:24:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-06T13:24:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-06T13:24:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:16.2.14-132.g4e03306b.el8 ceph 25 k 2023-11-06T13:24:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 824 k 2023-11-06T13:24:16.857 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:16.2.14-132.g4e03306b.el8 ceph 131 k 2023-11-06T13:24:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-06T13:24:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-06T13:24:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-06T13:24:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:16.2.14-132.g4e03306b.el8 ceph 215 k 2023-11-06T13:24:16.858 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:16.2.14-132.g4e03306b.el8 ceph 390 k 2023-11-06T13:24:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 369 k 2023-11-06T13:24:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:16.2.14-132.g4e03306b.el8 ceph 114 k 2023-11-06T13:24:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 88 k 2023-11-06T13:24:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.7 M 2023-11-06T13:24:16.859 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 173 k 2023-11-06T13:24:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-06T13:24:16.860 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2023-11-06T13:24:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.7 M 2023-11-06T13:24:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 4.2 M 2023-11-06T13:24:16.861 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2023-11-06T13:24:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-06T13:24:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:16.2.14-132.g4e03306b.el8 ceph 24 M 2023-11-06T13:24:16.861 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 24 k 2023-11-06T13:24:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:16.2.14-132.g4e03306b.el8 ceph 2.4 M 2023-11-06T13:24:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 245 k 2023-11-06T13:24:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:16.2.14-132.g4e03306b.el8 ceph 5.0 M 2023-11-06T13:24:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 18 M 2023-11-06T13:24:16.862 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 15 k 2023-11-06T13:24:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:16.2.14-132.g4e03306b.el8 ceph 26 k 2023-11-06T13:24:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-06T13:24:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-06T13:24:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-06T13:24:16.863 INFO:teuthology.orchestra.run.smithi044.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-06T13:24:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-06T13:24:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-06T13:24:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:16.2.14-132.g4e03306b.el8 ceph 174 k 2023-11-06T13:24:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-06T13:24:16.864 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-06T13:24:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-06T13:24:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-06T13:24:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-06T13:24:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 494 k 2023-11-06T13:24:16.865 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-06T13:24:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.8 M 2023-11-06T13:24:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-06T13:24:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-06T13:24:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-06T13:24:16.866 INFO:teuthology.orchestra.run.smithi044.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-06T13:24:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-06T13:24:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-06T13:24:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-06T13:24:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-06T13:24:16.867 INFO:teuthology.orchestra.run.smithi044.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-06T13:24:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-06T13:24:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-06T13:24:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-06T13:24:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-06T13:24:16.868 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-06T13:24:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-06T13:24:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-06T13:24:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 45 k 2023-11-06T13:24:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:16.2.14-132.g4e03306b.el8 ceph 99 k 2023-11-06T13:24:16.869 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-06T13:24:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-06T13:24:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-06T13:24:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-06T13:24:16.870 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-06T13:24:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-06T13:24:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-06T13:24:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-06T13:24:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-06T13:24:16.871 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-06T13:24:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-06T13:24:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-06T13:24:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-06T13:24:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-06T13:24:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-06T13:24:16.872 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-06T13:24:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-06T13:24:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-06T13:24:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-06T13:24:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-06T13:24:16.873 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-06T13:24:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-06T13:24:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-06T13:24:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-06T13:24:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-06T13:24:16.874 INFO:teuthology.orchestra.run.smithi044.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-06T13:24:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-06T13:24:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-06T13:24:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-06T13:24:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-06T13:24:16.875 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-06T13:24:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-06T13:24:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-06T13:24:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-06T13:24:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-06T13:24:16.876 INFO:teuthology.orchestra.run.smithi044.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-06T13:24:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-06T13:24:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-06T13:24:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-06T13:24:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-06T13:24:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-06T13:24:16.877 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-06T13:24:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-06T13:24:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-06T13:24:16.878 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:24:16.878 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2023-11-06T13:24:16.878 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================================================== 2023-11-06T13:24:16.879 INFO:teuthology.orchestra.run.smithi044.stdout:Install 118 Packages 2023-11-06T13:24:16.879 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2023-11-06T13:24:16.879 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:24:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 201 M 2023-11-06T13:24:16.880 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2023-11-06T13:24:16.894 INFO:teuthology.orchestra.run.smithi163.stdout:(5/120): ceph-base-16.2.14-132.g4e03306b.el8.x8 4.5 MB/s | 6.1 MB 00:01 2023-11-06T13:24:16.949 INFO:teuthology.orchestra.run.smithi163.stdout:(6/120): ceph-mgr-16.2.14-132.g4e03306b.el8.x86 3.2 MB/s | 1.6 MB 00:00 2023-11-06T13:24:17.240 INFO:teuthology.orchestra.run.smithi044.stdout:(1/120): ceph-16.2.14-132.g4e03306b.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-11-06T13:24:17.954 INFO:teuthology.orchestra.run.smithi044.stdout:(2/120): ceph-fuse-16.2.14-132.g4e03306b.el8.x8 1.2 MB/s | 910 kB 00:00 2023-11-06T13:24:18.087 INFO:teuthology.orchestra.run.smithi163.stdout:(7/120): ceph-mon-16.2.14-132.g4e03306b.el8.x86 4.2 MB/s | 5.0 MB 00:01 2023-11-06T13:24:18.096 INFO:teuthology.orchestra.run.smithi044.stdout:(3/120): ceph-immutable-object-cache-16.2.14-13 1.1 MB/s | 161 kB 00:00 2023-11-06T13:24:19.292 INFO:teuthology.orchestra.run.smithi044.stdout:(4/120): ceph-mds-16.2.14-132.g4e03306b.el8.x86 2.0 MB/s | 2.4 MB 00:01 2023-11-06T13:24:20.043 INFO:teuthology.orchestra.run.smithi044.stdout:(5/120): ceph-mgr-16.2.14-132.g4e03306b.el8.x86 2.1 MB/s | 1.6 MB 00:00 2023-11-06T13:24:20.315 INFO:teuthology.orchestra.run.smithi038.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-11-06T13:24:20.750 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 110 MB/s | 38 MB 00:00 2023-11-06T13:24:20.979 INFO:teuthology.orchestra.run.smithi163.stdout:(8/120): ceph-radosgw-16.2.14-132.g4e03306b.el8 4.0 MB/s | 12 MB 00:02 2023-11-06T13:24:21.044 INFO:teuthology.orchestra.run.smithi163.stdout:(9/120): ceph-selinux-16.2.14-132.g4e03306b.el8 395 kB/s | 26 kB 00:00 2023-11-06T13:24:21.647 INFO:teuthology.orchestra.run.smithi163.stdout:(10/120): ceph-common-16.2.14-132.g4e03306b.el8 4.0 MB/s | 24 MB 00:06 2023-11-06T13:24:21.814 INFO:teuthology.orchestra.run.smithi163.stdout:(11/120): ceph-osd-16.2.14-132.g4e03306b.el8.x8 3.8 MB/s | 18 MB 00:04 2023-11-06T13:24:21.817 INFO:teuthology.orchestra.run.smithi163.stdout:(12/120): cephfs-mirror-16.2.14-132.g4e03306b.e 1.5 MB/s | 257 kB 00:00 2023-11-06T13:24:21.894 INFO:teuthology.orchestra.run.smithi163.stdout:(13/120): libcephfs-devel-16.2.14-132.g4e03306b 319 kB/s | 25 kB 00:00 2023-11-06T13:24:21.953 INFO:teuthology.orchestra.run.smithi044.stdout:(6/120): ceph-mon-16.2.14-132.g4e03306b.el8.x86 2.6 MB/s | 5.0 MB 00:01 2023-11-06T13:24:22.026 INFO:teuthology.orchestra.run.smithi163.stdout:(14/120): libcephsqlite-16.2.14-132.g4e03306b.e 1.3 MB/s | 174 kB 00:00 2023-11-06T13:24:22.038 INFO:teuthology.orchestra.run.smithi163.stdout:(15/120): libcephfs2-16.2.14-132.g4e03306b.el8. 3.6 MB/s | 824 kB 00:00 2023-11-06T13:24:22.093 INFO:teuthology.orchestra.run.smithi163.stdout:(16/120): librados-devel-16.2.14-132.g4e03306b. 1.9 MB/s | 131 kB 00:00 2023-11-06T13:24:22.178 INFO:teuthology.orchestra.run.smithi163.stdout:(17/120): libradosstriper1-16.2.14-132.g4e03306 3.5 MB/s | 494 kB 00:00 2023-11-06T13:24:22.247 INFO:teuthology.orchestra.run.smithi163.stdout:(18/120): python3-ceph-argparse-16.2.14-132.g4e 660 kB/s | 45 kB 00:00 2023-11-06T13:24:22.315 INFO:teuthology.orchestra.run.smithi163.stdout:(19/120): python3-ceph-common-16.2.14-132.g4e03 1.4 MB/s | 99 kB 00:00 2023-11-06T13:24:22.389 INFO:teuthology.orchestra.run.smithi163.stdout:(20/120): python3-cephfs-16.2.14-132.g4e03306b. 2.8 MB/s | 215 kB 00:00 2023-11-06T13:24:22.536 INFO:teuthology.orchestra.run.smithi163.stdout:(21/120): python3-rados-16.2.14-132.g4e03306b.e 2.6 MB/s | 390 kB 00:00 2023-11-06T13:24:22.684 INFO:teuthology.orchestra.run.smithi163.stdout:(22/120): python3-rbd-16.2.14-132.g4e03306b.el8 2.4 MB/s | 369 kB 00:00 2023-11-06T13:24:22.757 INFO:teuthology.orchestra.run.smithi163.stdout:(23/120): python3-rgw-16.2.14-132.g4e03306b.el8 1.5 MB/s | 114 kB 00:00 2023-11-06T13:24:22.827 INFO:teuthology.orchestra.run.smithi163.stdout:(24/120): rbd-fuse-16.2.14-132.g4e03306b.el8.x8 1.2 MB/s | 88 kB 00:00 2023-11-06T13:24:23.041 INFO:teuthology.orchestra.run.smithi163.stdout:(25/120): librgw2-16.2.14-132.g4e03306b.el8.x86 4.0 MB/s | 3.8 MB 00:00 2023-11-06T13:24:23.130 INFO:teuthology.orchestra.run.smithi163.stdout:(26/120): rbd-nbd-16.2.14-132.g4e03306b.el8.x86 1.9 MB/s | 173 kB 00:00 2023-11-06T13:24:23.197 INFO:teuthology.orchestra.run.smithi163.stdout:(27/120): ceph-grafana-dashboards-16.2.14-132.g 361 kB/s | 24 kB 00:00 2023-11-06T13:24:23.268 INFO:teuthology.orchestra.run.smithi163.stdout:(28/120): ceph-mgr-cephadm-16.2.14-132.g4e03306 1.6 MB/s | 116 kB 00:00 2023-11-06T13:24:23.873 INFO:teuthology.orchestra.run.smithi163.stdout:(29/120): rbd-mirror-16.2.14-132.g4e03306b.el8. 3.5 MB/s | 3.7 MB 00:01 2023-11-06T13:24:24.141 INFO:teuthology.orchestra.run.smithi163.stdout:(30/120): ceph-mgr-dashboard-16.2.14-132.g4e033 3.6 MB/s | 3.1 MB 00:00 2023-11-06T13:24:24.218 INFO:teuthology.orchestra.run.smithi163.stdout:(31/120): ceph-mgr-modules-core-16.2.14-132.g4e 3.1 MB/s | 245 kB 00:00 2023-11-06T13:24:24.288 INFO:teuthology.orchestra.run.smithi163.stdout:(32/120): ceph-mgr-rook-16.2.14-132.g4e03306b.e 392 kB/s | 27 kB 00:00 2023-11-06T13:24:24.355 INFO:teuthology.orchestra.run.smithi163.stdout:(33/120): ceph-prometheus-alerts-16.2.14-132.g4 221 kB/s | 15 kB 00:00 2023-11-06T13:24:24.537 INFO:teuthology.orchestra.run.smithi163.stdout:(34/120): cephadm-16.2.14-132.g4e03306b.el8.noa 469 kB/s | 85 kB 00:00 2023-11-06T13:24:24.607 INFO:teuthology.orchestra.run.smithi163.stdout:(35/120): cephfs-top-16.2.14-132.g4e03306b.el8. 268 kB/s | 19 kB 00:00 2023-11-06T13:24:24.877 INFO:teuthology.orchestra.run.smithi163.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-11-06T13:24:24.945 INFO:teuthology.orchestra.run.smithi163.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 2.6 MB/s | 181 kB 00:00 2023-11-06T13:24:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-11-06T13:24:25.058 INFO:teuthology.orchestra.run.smithi163.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-11-06T13:24:25.112 INFO:teuthology.orchestra.run.smithi163.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 394 kB/s | 21 kB 00:00 2023-11-06T13:24:25.166 INFO:teuthology.orchestra.run.smithi163.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 808 kB/s | 44 kB 00:00 2023-11-06T13:24:25.231 INFO:teuthology.orchestra.run.smithi163.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.8 MB/s | 185 kB 00:00 2023-11-06T13:24:25.280 INFO:teuthology.orchestra.run.smithi163.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 668 kB/s | 33 kB 00:00 2023-11-06T13:24:25.331 INFO:teuthology.orchestra.run.smithi163.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 321 kB/s | 16 kB 00:00 2023-11-06T13:24:25.399 INFO:teuthology.orchestra.run.smithi163.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.5 MB/s | 173 kB 00:00 2023-11-06T13:24:25.430 INFO:teuthology.orchestra.run.smithi044.stdout:(7/120): ceph-base-16.2.14-132.g4e03306b.el8.x8 729 kB/s | 6.1 MB 00:08 2023-11-06T13:24:25.507 INFO:teuthology.orchestra.run.smithi163.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-11-06T13:24:25.580 INFO:teuthology.orchestra.run.smithi163.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 4.8 MB/s | 355 kB 00:00 2023-11-06T13:24:25.641 INFO:teuthology.orchestra.run.smithi163.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.3 MB/s | 81 kB 00:00 2023-11-06T13:24:25.693 INFO:teuthology.orchestra.run.smithi163.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 213 kB/s | 11 kB 00:00 2023-11-06T13:24:25.951 INFO:teuthology.orchestra.run.smithi163.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 68 kB/s | 18 kB 00:00 2023-11-06T13:24:26.090 INFO:teuthology.orchestra.run.smithi163.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 8.4 MB/s | 1.2 MB 00:00 2023-11-06T13:24:26.139 INFO:teuthology.orchestra.run.smithi163.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.0 MB/s | 49 kB 00:00 2023-11-06T13:24:26.195 INFO:teuthology.orchestra.run.smithi163.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-11-06T13:24:26.255 INFO:teuthology.orchestra.run.smithi163.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 4.6 MB/s | 283 kB 00:00 2023-11-06T13:24:26.311 INFO:teuthology.orchestra.run.smithi163.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 281 kB/s | 16 kB 00:00 2023-11-06T13:24:26.366 INFO:teuthology.orchestra.run.smithi163.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 891 kB/s | 49 kB 00:00 2023-11-06T13:24:26.411 INFO:teuthology.orchestra.run.smithi163.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 752 kB/s | 34 kB 00:00 2023-11-06T13:24:26.461 INFO:teuthology.orchestra.run.smithi163.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-11-06T13:24:26.495 INFO:teuthology.orchestra.run.smithi163.stdout:(59/120): ceph-mgr-diskprediction-local-16.2.14 3.3 MB/s | 8.6 MB 00:02 2023-11-06T13:24:26.505 INFO:teuthology.orchestra.run.smithi163.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 1.4 MB/s | 64 kB 00:00 2023-11-06T13:24:26.542 INFO:teuthology.orchestra.run.smithi163.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 651 kB/s | 24 kB 00:00 2023-11-06T13:24:26.577 INFO:teuthology.orchestra.run.smithi163.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 832 kB/s | 29 kB 00:00 2023-11-06T13:24:26.611 INFO:teuthology.orchestra.run.smithi163.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 816 kB/s | 27 kB 00:00 2023-11-06T13:24:26.614 INFO:teuthology.orchestra.run.smithi038.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 MB/s | 33 MB 00:00 2023-11-06T13:24:26.650 INFO:teuthology.orchestra.run.smithi163.stdout:(64/120): python3-simplegeneric-0.8.1-17.el8.no 121 kB/s | 19 kB 00:00 2023-11-06T13:24:26.659 INFO:teuthology.orchestra.run.smithi163.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 5.2 MB/s | 255 kB 00:00 2023-11-06T13:24:26.700 INFO:teuthology.orchestra.run.smithi163.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.5 MB/s | 61 kB 00:00 2023-11-06T13:24:26.735 INFO:teuthology.orchestra.run.smithi163.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 2.4 MB/s | 85 kB 00:00 2023-11-06T13:24:26.774 INFO:teuthology.orchestra.run.smithi163.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 595 kB/s | 23 kB 00:00 2023-11-06T13:24:26.778 INFO:teuthology.orchestra.run.smithi163.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-11-06T13:24:26.810 INFO:teuthology.orchestra.run.smithi163.stdout:(70/120): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-11-06T13:24:26.856 INFO:teuthology.orchestra.run.smithi163.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 960 kB/s | 44 kB 00:00 2023-11-06T13:24:26.877 INFO:teuthology.orchestra.run.smithi163.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.2 MB/s | 27 kB 00:00 2023-11-06T13:24:26.898 INFO:teuthology.orchestra.run.smithi163.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 7.7 MB/s | 161 kB 00:00 2023-11-06T13:24:26.920 INFO:teuthology.orchestra.run.smithi163.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-11-06T13:24:26.944 INFO:teuthology.orchestra.run.smithi163.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 19 MB/s | 457 kB 00:00 2023-11-06T13:24:26.979 INFO:teuthology.orchestra.run.smithi044.stdout:(8/120): ceph-common-16.2.14-132.g4e03306b.el8. 2.4 MB/s | 24 MB 00:10 2023-11-06T13:24:27.057 INFO:teuthology.orchestra.run.smithi163.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 52 MB/s | 15 MB 00:00 2023-11-06T13:24:27.076 INFO:teuthology.orchestra.run.smithi163.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.1 MB/s | 39 kB 00:00 2023-11-06T13:24:27.112 INFO:teuthology.orchestra.run.smithi163.stdout:(78/120): python3-babel-2.5.1-5.el8.noarch.rpm 28 MB/s | 4.8 MB 00:00 2023-11-06T13:24:27.114 INFO:teuthology.orchestra.run.smithi163.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 18 MB/s | 688 kB 00:00 2023-11-06T13:24:27.133 INFO:teuthology.orchestra.run.smithi163.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-11-06T13:24:27.137 INFO:teuthology.orchestra.run.smithi163.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 9.6 MB/s | 225 kB 00:00 2023-11-06T13:24:27.152 INFO:teuthology.orchestra.run.smithi163.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 6.4 MB/s | 126 kB 00:00 2023-11-06T13:24:27.174 INFO:teuthology.orchestra.run.smithi163.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 8.4 MB/s | 187 kB 00:00 2023-11-06T13:24:27.197 INFO:teuthology.orchestra.run.smithi163.stdout:(84/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 63 MB/s | 3.7 MB 00:00 2023-11-06T13:24:27.203 INFO:teuthology.orchestra.run.smithi163.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 18 MB/s | 538 kB 00:00 2023-11-06T13:24:27.206 INFO:teuthology.orchestra.run.smithi044.stdout:(9/120): ceph-selinux-16.2.14-132.g4e03306b.el8 113 kB/s | 26 kB 00:00 2023-11-06T13:24:27.221 INFO:teuthology.orchestra.run.smithi163.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-11-06T13:24:27.225 INFO:teuthology.orchestra.run.smithi163.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 7.1 MB/s | 157 kB 00:00 2023-11-06T13:24:27.242 INFO:teuthology.orchestra.run.smithi163.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 5.0 MB/s | 110 kB 00:00 2023-11-06T13:24:27.250 INFO:teuthology.orchestra.run.smithi163.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 14 MB/s | 353 kB 00:00 2023-11-06T13:24:27.266 INFO:teuthology.orchestra.run.smithi163.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 836 kB/s | 20 kB 00:00 2023-11-06T13:24:27.278 INFO:teuthology.orchestra.run.smithi163.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2023-11-06T13:24:27.291 INFO:teuthology.orchestra.run.smithi163.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-11-06T13:24:27.357 INFO:teuthology.orchestra.run.smithi163.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 60 MB/s | 4.7 MB 00:00 2023-11-06T13:24:27.386 INFO:teuthology.orchestra.run.smithi163.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 49 MB/s | 4.6 MB 00:00 2023-11-06T13:24:27.393 INFO:teuthology.orchestra.run.smithi163.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 20 MB/s | 713 kB 00:00 2023-11-06T13:24:27.404 INFO:teuthology.orchestra.run.smithi163.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.0 MB/s | 19 kB 00:00 2023-11-06T13:24:27.420 INFO:teuthology.orchestra.run.smithi163.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2023-11-06T13:24:27.429 INFO:teuthology.orchestra.run.smithi163.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 6.2 MB/s | 155 kB 00:00 2023-11-06T13:24:27.442 INFO:teuthology.orchestra.run.smithi163.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 9.8 MB/s | 220 kB 00:00 2023-11-06T13:24:27.453 INFO:teuthology.orchestra.run.smithi163.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 2.0 MB/s | 48 kB 00:00 2023-11-06T13:24:27.473 INFO:teuthology.orchestra.run.smithi163.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 2.1 MB/s | 43 kB 00:00 2023-11-06T13:24:27.476 INFO:teuthology.orchestra.run.smithi163.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.7 MB/s | 229 kB 00:00 2023-11-06T13:24:27.505 INFO:teuthology.orchestra.run.smithi163.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 621 kB/s | 18 kB 00:00 2023-11-06T13:24:27.516 INFO:teuthology.orchestra.run.smithi163.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 54 MB/s | 2.3 MB 00:00 2023-11-06T13:24:27.528 INFO:teuthology.orchestra.run.smithi163.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 25 MB/s | 605 kB 00:00 2023-11-06T13:24:27.535 INFO:teuthology.orchestra.run.smithi163.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 4.3 MB/s | 83 kB 00:00 2023-11-06T13:24:27.549 INFO:teuthology.orchestra.run.smithi163.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 2.8 MB/s | 59 kB 00:00 2023-11-06T13:24:27.556 INFO:teuthology.orchestra.run.smithi163.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 8.0 MB/s | 169 kB 00:00 2023-11-06T13:24:27.573 INFO:teuthology.orchestra.run.smithi163.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.7 MB/s | 38 kB 00:00 2023-11-06T13:24:27.576 INFO:teuthology.orchestra.run.smithi163.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.4 MB/s | 86 kB 00:00 2023-11-06T13:24:27.590 INFO:teuthology.orchestra.run.smithi163.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.2 MB/s | 58 kB 00:00 2023-11-06T13:24:27.604 INFO:teuthology.orchestra.run.smithi163.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2023-11-06T13:24:27.629 INFO:teuthology.orchestra.run.smithi163.stdout:(113/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-11-06T13:24:27.634 INFO:teuthology.orchestra.run.smithi163.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 12 MB/s | 559 kB 00:00 2023-11-06T13:24:27.648 INFO:teuthology.orchestra.run.smithi163.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 3.7 MB/s | 70 kB 00:00 2023-11-06T13:24:27.661 INFO:teuthology.orchestra.run.smithi163.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 7.3 MB/s | 200 kB 00:00 2023-11-06T13:24:27.668 INFO:teuthology.orchestra.run.smithi163.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 4.6 MB/s | 97 kB 00:00 2023-11-06T13:24:28.581 INFO:teuthology.orchestra.run.smithi044.stdout:(10/120): ceph-osd-16.2.14-132.g4e03306b.el8.x8 2.8 MB/s | 18 MB 00:06 2023-11-06T13:24:28.708 INFO:teuthology.orchestra.run.smithi044.stdout:(11/120): cephfs-mirror-16.2.14-132.g4e03306b.e 2.0 MB/s | 257 kB 00:00 2023-11-06T13:24:28.778 INFO:teuthology.orchestra.run.smithi044.stdout:(12/120): libcephfs-devel-16.2.14-132.g4e03306b 366 kB/s | 25 kB 00:00 2023-11-06T13:24:28.962 INFO:teuthology.orchestra.run.smithi163.stdout:(118/120): librados2-16.2.14-132.g4e03306b.el8. 2.9 MB/s | 3.7 MB 00:01 2023-11-06T13:24:29.041 INFO:teuthology.orchestra.run.smithi044.stdout:(13/120): libcephfs2-16.2.14-132.g4e03306b.el8. 3.1 MB/s | 824 kB 00:00 2023-11-06T13:24:29.102 INFO:teuthology.orchestra.run.smithi044.stdout:(14/120): libcephsqlite-16.2.14-132.g4e03306b.e 2.8 MB/s | 174 kB 00:00 2023-11-06T13:24:29.160 INFO:teuthology.orchestra.run.smithi044.stdout:(15/120): librados-devel-16.2.14-132.g4e03306b. 2.2 MB/s | 131 kB 00:00 2023-11-06T13:24:29.289 INFO:teuthology.orchestra.run.smithi044.stdout:(16/120): libradosstriper1-16.2.14-132.g4e03306 3.8 MB/s | 494 kB 00:00 2023-11-06T13:24:29.333 INFO:teuthology.orchestra.run.smithi163.stdout:(119/120): librbd1-16.2.14-132.g4e03306b.el8.x8 2.5 MB/s | 4.2 MB 00:01 2023-11-06T13:24:30.141 INFO:teuthology.orchestra.run.smithi044.stdout:(17/120): librgw2-16.2.14-132.g4e03306b.el8.x86 4.5 MB/s | 3.8 MB 00:00 2023-11-06T13:24:30.198 INFO:teuthology.orchestra.run.smithi044.stdout:(18/120): python3-ceph-argparse-16.2.14-132.g4e 805 kB/s | 45 kB 00:00 2023-11-06T13:24:30.256 INFO:teuthology.orchestra.run.smithi044.stdout:(19/120): python3-ceph-common-16.2.14-132.g4e03 1.7 MB/s | 99 kB 00:00 2023-11-06T13:24:30.319 INFO:teuthology.orchestra.run.smithi044.stdout:(20/120): python3-cephfs-16.2.14-132.g4e03306b. 3.3 MB/s | 215 kB 00:00 2023-11-06T13:24:30.445 INFO:teuthology.orchestra.run.smithi044.stdout:(21/120): python3-rados-16.2.14-132.g4e03306b.e 3.0 MB/s | 390 kB 00:00 2023-11-06T13:24:30.570 INFO:teuthology.orchestra.run.smithi044.stdout:(22/120): python3-rbd-16.2.14-132.g4e03306b.el8 2.9 MB/s | 369 kB 00:00 2023-11-06T13:24:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:(23/120): python3-rgw-16.2.14-132.g4e03306b.el8 1.7 MB/s | 114 kB 00:00 2023-11-06T13:24:30.695 INFO:teuthology.orchestra.run.smithi044.stdout:(24/120): rbd-fuse-16.2.14-132.g4e03306b.el8.x8 1.4 MB/s | 88 kB 00:00 2023-11-06T13:24:31.572 INFO:teuthology.orchestra.run.smithi044.stdout:(25/120): rbd-mirror-16.2.14-132.g4e03306b.el8. 4.2 MB/s | 3.7 MB 00:00 2023-11-06T13:24:31.641 INFO:teuthology.orchestra.run.smithi044.stdout:(26/120): rbd-nbd-16.2.14-132.g4e03306b.el8.x86 2.5 MB/s | 173 kB 00:00 2023-11-06T13:24:31.703 INFO:teuthology.orchestra.run.smithi044.stdout:(27/120): ceph-grafana-dashboards-16.2.14-132.g 390 kB/s | 24 kB 00:00 2023-11-06T13:24:31.768 INFO:teuthology.orchestra.run.smithi044.stdout:(28/120): ceph-mgr-cephadm-16.2.14-132.g4e03306 1.8 MB/s | 116 kB 00:00 2023-11-06T13:24:32.442 INFO:teuthology.orchestra.run.smithi044.stdout:(29/120): ceph-mgr-dashboard-16.2.14-132.g4e033 4.6 MB/s | 3.1 MB 00:00 2023-11-06T13:24:33.875 INFO:teuthology.orchestra.run.smithi044.stdout:(30/120): ceph-mgr-diskprediction-local-16.2.14 6.0 MB/s | 8.6 MB 00:01 2023-11-06T13:24:33.877 INFO:teuthology.orchestra.run.smithi163.stdout:(120/120): ceph-test-16.2.14-132.g4e03306b.el8. 4.0 MB/s | 52 MB 00:12 2023-11-06T13:24:33.884 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-11-06T13:24:33.885 INFO:teuthology.orchestra.run.smithi163.stdout:Total 11 MB/s | 201 MB 00:18 2023-11-06T13:24:33.928 INFO:teuthology.orchestra.run.smithi044.stdout:(31/120): ceph-mgr-modules-core-16.2.14-132.g4e 4.6 MB/s | 245 kB 00:00 2023-11-06T13:24:33.938 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-11-06T13:24:33.976 INFO:teuthology.orchestra.run.smithi044.stdout:(32/120): ceph-mgr-rook-16.2.14-132.g4e03306b.e 572 kB/s | 27 kB 00:00 2023-11-06T13:24:34.023 INFO:teuthology.orchestra.run.smithi044.stdout:(33/120): ceph-prometheus-alerts-16.2.14-132.g4 314 kB/s | 15 kB 00:00 2023-11-06T13:24:34.055 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-11-06T13:24:34.055 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-11-06T13:24:34.070 INFO:teuthology.orchestra.run.smithi044.stdout:(34/120): cephadm-16.2.14-132.g4e03306b.el8.noa 1.8 MB/s | 85 kB 00:00 2023-11-06T13:24:34.114 INFO:teuthology.orchestra.run.smithi044.stdout:(35/120): cephfs-top-16.2.14-132.g4e03306b.el8. 424 kB/s | 19 kB 00:00 2023-11-06T13:24:34.171 INFO:teuthology.orchestra.run.smithi044.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 5.3 MB/s | 306 kB 00:00 2023-11-06T13:24:34.183 INFO:teuthology.orchestra.run.smithi044.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 16 MB/s | 181 kB 00:00 2023-11-06T13:24:34.191 INFO:teuthology.orchestra.run.smithi044.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 6.7 MB/s | 59 kB 00:00 2023-11-06T13:24:34.201 INFO:teuthology.orchestra.run.smithi044.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 8.4 MB/s | 75 kB 00:00 2023-11-06T13:24:34.209 INFO:teuthology.orchestra.run.smithi044.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 2.5 MB/s | 21 kB 00:00 2023-11-06T13:24:34.218 INFO:teuthology.orchestra.run.smithi044.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 5.0 MB/s | 44 kB 00:00 2023-11-06T13:24:34.230 INFO:teuthology.orchestra.run.smithi044.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 16 MB/s | 185 kB 00:00 2023-11-06T13:24:34.239 INFO:teuthology.orchestra.run.smithi044.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 3.7 MB/s | 33 kB 00:00 2023-11-06T13:24:34.247 INFO:teuthology.orchestra.run.smithi044.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 2.0 MB/s | 16 kB 00:00 2023-11-06T13:24:34.259 INFO:teuthology.orchestra.run.smithi044.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 15 MB/s | 173 kB 00:00 2023-11-06T13:24:34.274 INFO:teuthology.orchestra.run.smithi044.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 24 MB/s | 384 kB 00:00 2023-11-06T13:24:34.288 INFO:teuthology.orchestra.run.smithi044.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 27 MB/s | 355 kB 00:00 2023-11-06T13:24:34.296 INFO:teuthology.orchestra.run.smithi044.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 9.4 MB/s | 81 kB 00:00 2023-11-06T13:24:34.305 INFO:teuthology.orchestra.run.smithi044.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2023-11-06T13:24:34.313 INFO:teuthology.orchestra.run.smithi044.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2023-11-06T13:24:34.338 INFO:teuthology.orchestra.run.smithi044.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 48 MB/s | 1.2 MB 00:00 2023-11-06T13:24:34.347 INFO:teuthology.orchestra.run.smithi044.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 5.6 MB/s | 49 kB 00:00 2023-11-06T13:24:34.355 INFO:teuthology.orchestra.run.smithi044.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 6.9 MB/s | 59 kB 00:00 2023-11-06T13:24:34.365 INFO:teuthology.orchestra.run.smithi044.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 28 MB/s | 283 kB 00:00 2023-11-06T13:24:34.376 INFO:teuthology.orchestra.run.smithi044.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2023-11-06T13:24:34.382 INFO:teuthology.orchestra.run.smithi044.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 5.7 MB/s | 49 kB 00:00 2023-11-06T13:24:34.391 INFO:teuthology.orchestra.run.smithi044.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 4.1 MB/s | 34 kB 00:00 2023-11-06T13:24:34.400 INFO:teuthology.orchestra.run.smithi044.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 21 MB/s | 196 kB 00:00 2023-11-06T13:24:34.409 INFO:teuthology.orchestra.run.smithi044.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 7.5 MB/s | 64 kB 00:00 2023-11-06T13:24:34.418 INFO:teuthology.orchestra.run.smithi044.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 2.3 MB/s | 19 kB 00:00 2023-11-06T13:24:34.426 INFO:teuthology.orchestra.run.smithi044.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 2.8 MB/s | 24 kB 00:00 2023-11-06T13:24:34.435 INFO:teuthology.orchestra.run.smithi044.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 3.4 MB/s | 29 kB 00:00 2023-11-06T13:24:34.443 INFO:teuthology.orchestra.run.smithi044.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 3.3 MB/s | 27 kB 00:00 2023-11-06T13:24:34.453 INFO:teuthology.orchestra.run.smithi044.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 25 MB/s | 255 kB 00:00 2023-11-06T13:24:34.463 INFO:teuthology.orchestra.run.smithi044.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 25 MB/s | 251 kB 00:00 2023-11-06T13:24:34.472 INFO:teuthology.orchestra.run.smithi044.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 7.1 MB/s | 61 kB 00:00 2023-11-06T13:24:34.481 INFO:teuthology.orchestra.run.smithi044.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 9.3 MB/s | 85 kB 00:00 2023-11-06T13:24:34.490 INFO:teuthology.orchestra.run.smithi044.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 2.7 MB/s | 23 kB 00:00 2023-11-06T13:24:34.494 INFO:teuthology.orchestra.run.smithi044.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 18 MB/s | 70 kB 00:00 2023-11-06T13:24:34.786 INFO:teuthology.orchestra.run.smithi044.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 50 MB/s | 15 MB 00:00 2023-11-06T13:24:34.799 INFO:teuthology.orchestra.run.smithi044.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-11-06T13:24:34.811 INFO:teuthology.orchestra.run.smithi044.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.3 MB/s | 27 kB 00:00 2023-11-06T13:24:34.824 INFO:teuthology.orchestra.run.smithi044.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-11-06T13:24:34.839 INFO:teuthology.orchestra.run.smithi044.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 21 MB/s | 320 kB 00:00 2023-11-06T13:24:34.856 INFO:teuthology.orchestra.run.smithi044.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 27 MB/s | 457 kB 00:00 2023-11-06T13:24:34.926 INFO:teuthology.orchestra.run.smithi044.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 68 MB/s | 4.8 MB 00:00 2023-11-06T13:24:34.939 INFO:teuthology.orchestra.run.smithi044.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-11-06T13:24:34.959 INFO:teuthology.orchestra.run.smithi044.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 34 MB/s | 688 kB 00:00 2023-11-06T13:24:34.973 INFO:teuthology.orchestra.run.smithi044.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2023-11-06T13:24:34.987 INFO:teuthology.orchestra.run.smithi044.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 16 MB/s | 225 kB 00:00 2023-11-06T13:24:35.000 INFO:teuthology.orchestra.run.smithi044.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.9 MB/s | 126 kB 00:00 2023-11-06T13:24:35.056 INFO:teuthology.orchestra.run.smithi044.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 67 MB/s | 3.7 MB 00:00 2023-11-06T13:24:35.070 INFO:teuthology.orchestra.run.smithi044.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-11-06T13:24:35.088 INFO:teuthology.orchestra.run.smithi044.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 30 MB/s | 538 kB 00:00 2023-11-06T13:24:35.103 INFO:teuthology.orchestra.run.smithi044.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 20 MB/s | 302 kB 00:00 2023-11-06T13:24:35.116 INFO:teuthology.orchestra.run.smithi038.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-06T13:24:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:(86/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-11-06T13:24:35.117 INFO:teuthology.orchestra.run.smithi038.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-06T13:24:35.128 INFO:teuthology.orchestra.run.smithi038.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-11-06T13:24:35.129 INFO:teuthology.orchestra.run.smithi044.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 8.9 MB/s | 110 kB 00:00 2023-11-06T13:24:35.129 INFO:teuthology.orchestra.run.smithi038.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-11-06T13:24:35.130 INFO:teuthology.orchestra.run.smithi038.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-11-06T13:24:35.131 INFO:teuthology.orchestra.run.smithi038.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-06T13:24:35.133 INFO:teuthology.orchestra.run.smithi038.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-06T13:24:35.135 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-11-06T13:24:35.136 INFO:teuthology.orchestra.run.smithi038.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-11-06T13:24:35.145 INFO:teuthology.orchestra.run.smithi044.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 22 MB/s | 353 kB 00:00 2023-11-06T13:24:35.156 INFO:teuthology.orchestra.run.smithi044.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.7 MB/s | 20 kB 00:00 2023-11-06T13:24:35.176 INFO:teuthology.orchestra.run.smithi044.stdout:(90/120): libtool-2.4.6-25.el8.x86_64.rpm 36 MB/s | 709 kB 00:00 2023-11-06T13:24:35.187 INFO:teuthology.orchestra.run.smithi044.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.6 MB/s | 54 kB 00:00 2023-11-06T13:24:35.256 INFO:teuthology.orchestra.run.smithi044.stdout:(92/120): openblas-threads-0.3.12-1.el8.x86_64. 69 MB/s | 4.7 MB 00:00 2023-11-06T13:24:35.324 INFO:teuthology.orchestra.run.smithi044.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 68 MB/s | 4.6 MB 00:00 2023-11-06T13:24:35.345 INFO:teuthology.orchestra.run.smithi044.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 34 MB/s | 713 kB 00:00 2023-11-06T13:24:35.357 INFO:teuthology.orchestra.run.smithi044.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.6 MB/s | 19 kB 00:00 2023-11-06T13:24:35.368 INFO:teuthology.orchestra.run.smithi044.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.6 MB/s | 43 kB 00:00 2023-11-06T13:24:35.382 INFO:teuthology.orchestra.run.smithi044.stdout:(97/120): python3-oauthlib-2.1.0-1.el8.noarch.r 12 MB/s | 155 kB 00:00 2023-11-06T13:24:35.396 INFO:teuthology.orchestra.run.smithi044.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-11-06T13:24:35.407 INFO:teuthology.orchestra.run.smithi044.stdout:(99/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 4.0 MB/s | 48 kB 00:00 2023-11-06T13:24:35.421 INFO:teuthology.orchestra.run.smithi044.stdout:(100/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 16 MB/s | 229 kB 00:00 2023-11-06T13:24:35.433 INFO:teuthology.orchestra.run.smithi044.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 3.4 MB/s | 43 kB 00:00 2023-11-06T13:24:35.486 INFO:teuthology.orchestra.run.smithi044.stdout:(102/120): openssl-devel-1.1.1g-15.el8_3.x86_64 44 MB/s | 2.3 MB 00:00 2023-11-06T13:24:35.498 INFO:teuthology.orchestra.run.smithi044.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.5 MB/s | 18 kB 00:00 2023-11-06T13:24:35.517 INFO:teuthology.orchestra.run.smithi044.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 33 MB/s | 605 kB 00:00 2023-11-06T13:24:35.562 INFO:teuthology.orchestra.run.smithi044.stdout:(105/120): ceph-radosgw-16.2.14-132.g4e03306b.e 1.1 MB/s | 12 MB 00:10 2023-11-06T13:24:35.620 INFO:teuthology.orchestra.run.smithi044.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 801 kB/s | 83 kB 00:00 2023-11-06T13:24:35.639 INFO:teuthology.orchestra.run.smithi044.stdout:(107/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.4 MB/s | 169 kB 00:00 2023-11-06T13:24:35.650 INFO:teuthology.orchestra.run.smithi044.stdout:(108/120): elfutils-libelf-devel-0.182-3.el8.x8 664 kB/s | 59 kB 00:00 2023-11-06T13:24:35.661 INFO:teuthology.orchestra.run.smithi044.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.7 MB/s | 38 kB 00:00 2023-11-06T13:24:35.663 INFO:teuthology.orchestra.run.smithi044.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.8 MB/s | 86 kB 00:00 2023-11-06T13:24:35.672 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies resolved. 2023-11-06T13:24:35.674 INFO:teuthology.orchestra.run.smithi044.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.4 MB/s | 58 kB 00:00 2023-11-06T13:24:35.675 INFO:teuthology.orchestra.run.smithi044.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.6 MB/s | 47 kB 00:00 2023-11-06T13:24:35.685 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================================== 2023-11-06T13:24:35.685 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2023-11-06T13:24:35.685 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================================== 2023-11-06T13:24:35.686 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2023-11-06T13:24:35.686 INFO:teuthology.orchestra.run.smithi038.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-06T13:24:35.686 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:16.2.14-132.g4e03306b.el8 ceph 6.4 k 2023-11-06T13:24:35.686 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:16.2.14-132.g4e03306b.el8 ceph 6.1 M 2023-11-06T13:24:35.687 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 910 k 2023-11-06T13:24:35.687 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-132.g4e03306b.el8 ceph 161 k 2023-11-06T13:24:35.687 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:16.2.14-132.g4e03306b.el8 ceph 1.6 M 2023-11-06T13:24:35.688 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 116 k 2023-11-06T13:24:35.688 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 3.1 M 2023-11-06T13:24:35.688 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 8.6 M 2023-11-06T13:24:35.688 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 27 k 2023-11-06T13:24:35.689 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:16.2.14-132.g4e03306b.el8 ceph 12 M 2023-11-06T13:24:35.689 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:16.2.14-132.g4e03306b.el8 ceph 52 M 2023-11-06T13:24:35.689 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 85 k 2023-11-06T13:24:35.689 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror x86_64 2:16.2.14-132.g4e03306b.el8 ceph 257 k 2023-11-06T13:24:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 19 k 2023-11-06T13:24:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-11-06T13:24:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-06T13:24:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-06T13:24:35.690 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:16.2.14-132.g4e03306b.el8 ceph 25 k 2023-11-06T13:24:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 824 k 2023-11-06T13:24:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:16.2.14-132.g4e03306b.el8 ceph 131 k 2023-11-06T13:24:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-06T13:24:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-11-06T13:24:35.691 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-06T13:24:35.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs x86_64 2:16.2.14-132.g4e03306b.el8 ceph 215 k 2023-11-06T13:24:35.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados x86_64 2:16.2.14-132.g4e03306b.el8 ceph 390 k 2023-11-06T13:24:35.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 369 k 2023-11-06T13:24:35.692 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw x86_64 2:16.2.14-132.g4e03306b.el8 ceph 114 k 2023-11-06T13:24:35.692 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 88 k 2023-11-06T13:24:35.693 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.7 M 2023-11-06T13:24:35.693 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 173 k 2023-11-06T13:24:35.693 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-11-06T13:24:35.693 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrading: 2023-11-06T13:24:35.694 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.7 M 2023-11-06T13:24:35.694 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 4.2 M 2023-11-06T13:24:35.694 INFO:teuthology.orchestra.run.smithi038.stdout:Installing dependencies: 2023-11-06T13:24:35.695 INFO:teuthology.orchestra.run.smithi038.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-06T13:24:35.695 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:16.2.14-132.g4e03306b.el8 ceph 24 M 2023-11-06T13:24:35.695 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 24 k 2023-11-06T13:24:35.695 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:16.2.14-132.g4e03306b.el8 ceph 2.4 M 2023-11-06T13:24:35.695 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 245 k 2023-11-06T13:24:35.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:16.2.14-132.g4e03306b.el8 ceph 5.0 M 2023-11-06T13:24:35.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:16.2.14-132.g4e03306b.el8 ceph 18 M 2023-11-06T13:24:35.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts noarch 2:16.2.14-132.g4e03306b.el8 ceph-noarch 15 k 2023-11-06T13:24:35.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:16.2.14-132.g4e03306b.el8 ceph 26 k 2023-11-06T13:24:35.696 INFO:teuthology.orchestra.run.smithi038.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-06T13:24:35.697 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-06T13:24:35.697 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-11-06T13:24:35.698 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-06T13:24:35.698 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-06T13:24:35.699 INFO:teuthology.orchestra.run.smithi038.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-11-06T13:24:35.699 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite x86_64 2:16.2.14-132.g4e03306b.el8 ceph 174 k 2023-11-06T13:24:35.699 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-11-06T13:24:35.700 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-11-06T13:24:35.700 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-06T13:24:35.700 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-11-06T13:24:35.700 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-06T13:24:35.701 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 494 k 2023-11-06T13:24:35.701 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-11-06T13:24:35.701 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:16.2.14-132.g4e03306b.el8 ceph 3.8 M 2023-11-06T13:24:35.702 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-06T13:24:35.702 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-11-06T13:24:35.702 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-06T13:24:35.703 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-06T13:24:35.703 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-06T13:24:35.704 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-06T13:24:35.704 INFO:teuthology.orchestra.run.smithi038.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-11-06T13:24:35.704 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-06T13:24:35.705 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-06T13:24:35.705 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-06T13:24:35.705 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-06T13:24:35.706 INFO:teuthology.orchestra.run.smithi038.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-11-06T13:24:35.706 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-06T13:24:35.707 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-06T13:24:35.707 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-06T13:24:35.707 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-06T13:24:35.708 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse x86_64 2:16.2.14-132.g4e03306b.el8 ceph 45 k 2023-11-06T13:24:35.708 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common x86_64 2:16.2.14-132.g4e03306b.el8 ceph 99 k 2023-11-06T13:24:35.708 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-06T13:24:35.709 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-06T13:24:35.709 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-06T13:24:35.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-11-06T13:24:35.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-06T13:24:35.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-06T13:24:35.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-06T13:24:35.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-06T13:24:35.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-06T13:24:35.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-06T13:24:35.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-06T13:24:35.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-06T13:24:35.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-06T13:24:35.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-06T13:24:35.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-06T13:24:35.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-06T13:24:35.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-06T13:24:35.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-06T13:24:35.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-06T13:24:35.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-06T13:24:35.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-06T13:24:35.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-06T13:24:35.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-06T13:24:35.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-06T13:24:35.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-06T13:24:35.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-11-06T13:24:35.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-06T13:24:35.719 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-06T13:24:35.719 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-06T13:24:35.719 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-06T13:24:35.720 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-11-06T13:24:35.720 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-06T13:24:35.720 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-06T13:24:35.720 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-06T13:24:35.721 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-06T13:24:35.721 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-06T13:24:35.721 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-06T13:24:35.721 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-06T13:24:35.721 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-06T13:24:35.721 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-06T13:24:35.722 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-06T13:24:35.722 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-11-06T13:24:35.722 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-06T13:24:35.722 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-06T13:24:35.723 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:24:35.723 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2023-11-06T13:24:35.723 INFO:teuthology.orchestra.run.smithi038.stdout:====================================================================================================================== 2023-11-06T13:24:35.723 INFO:teuthology.orchestra.run.smithi038.stdout:Install 118 Packages 2023-11-06T13:24:35.723 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade 2 Packages 2023-11-06T13:24:35.724 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:24:35.725 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 201 M 2023-11-06T13:24:35.725 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading Packages: 2023-11-06T13:24:35.725 INFO:teuthology.orchestra.run.smithi044.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 27 MB/s | 559 kB 00:00 2023-11-06T13:24:35.726 INFO:teuthology.orchestra.run.smithi044.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 28 MB/s | 639 kB 00:00 2023-11-06T13:24:35.726 INFO:teuthology.orchestra.run.smithi044.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.0 MB/s | 70 kB 00:00 2023-11-06T13:24:35.726 INFO:teuthology.orchestra.run.smithi044.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 13 MB/s | 200 kB 00:00 2023-11-06T13:24:35.726 INFO:teuthology.orchestra.run.smithi044.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 7.5 MB/s | 97 kB 00:00 2023-11-06T13:24:35.806 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-11-06T13:24:35.810 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-11-06T13:24:36.226 INFO:teuthology.orchestra.run.smithi038.stdout:(1/120): ceph-16.2.14-132.g4e03306b.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-11-06T13:24:36.676 INFO:teuthology.orchestra.run.smithi038.stdout:(2/120): ceph-base-16.2.14-132.g4e03306b.el8.x8 7.4 MB/s | 6.1 MB 00:00 2023-11-06T13:24:36.712 INFO:teuthology.orchestra.run.smithi038.stdout:(3/120): ceph-immutable-object-cache-16.2.14-13 4.5 MB/s | 161 kB 00:00 2023-11-06T13:24:36.995 INFO:teuthology.orchestra.run.smithi038.stdout:(4/120): ceph-mds-16.2.14-132.g4e03306b.el8.x86 8.6 MB/s | 2.4 MB 00:00 2023-11-06T13:24:37.188 INFO:teuthology.orchestra.run.smithi038.stdout:(5/120): ceph-mgr-16.2.14-132.g4e03306b.el8.x86 8.3 MB/s | 1.6 MB 00:00 2023-11-06T13:24:37.724 INFO:teuthology.orchestra.run.smithi038.stdout:(6/120): ceph-mon-16.2.14-132.g4e03306b.el8.x86 9.4 MB/s | 5.0 MB 00:00 2023-11-06T13:24:38.160 INFO:teuthology.orchestra.run.smithi044.stdout:(118/120): librados2-16.2.14-132.g4e03306b.el8. 1.5 MB/s | 3.7 MB 00:02 2023-11-06T13:24:38.268 INFO:teuthology.orchestra.run.smithi038.stdout:(7/120): ceph-common-16.2.14-132.g4e03306b.el8. 10 MB/s | 24 MB 00:02 2023-11-06T13:24:39.789 INFO:teuthology.orchestra.run.smithi038.stdout:(8/120): ceph-osd-16.2.14-132.g4e03306b.el8.x86 8.9 MB/s | 18 MB 00:02 2023-11-06T13:24:39.862 INFO:teuthology.orchestra.run.smithi038.stdout:(9/120): ceph-radosgw-16.2.14-132.g4e03306b.el8 7.3 MB/s | 12 MB 00:01 2023-11-06T13:24:39.922 INFO:teuthology.orchestra.run.smithi038.stdout:(10/120): ceph-selinux-16.2.14-132.g4e03306b.el 194 kB/s | 26 kB 00:00 2023-11-06T13:24:39.988 INFO:teuthology.orchestra.run.smithi038.stdout:(11/120): cephfs-mirror-16.2.14-132.g4e03306b.e 3.8 MB/s | 257 kB 00:00 2023-11-06T13:24:40.050 INFO:teuthology.orchestra.run.smithi038.stdout:(12/120): libcephfs-devel-16.2.14-132.g4e03306b 412 kB/s | 25 kB 00:00 2023-11-06T13:24:40.156 INFO:teuthology.orchestra.run.smithi038.stdout:(13/120): ceph-fuse-16.2.14-132.g4e03306b.el8.x 232 kB/s | 910 kB 00:03 2023-11-06T13:24:40.188 INFO:teuthology.orchestra.run.smithi038.stdout:(14/120): libcephfs2-16.2.14-132.g4e03306b.el8. 5.9 MB/s | 824 kB 00:00 2023-11-06T13:24:40.252 INFO:teuthology.orchestra.run.smithi038.stdout:(15/120): librados-devel-16.2.14-132.g4e03306b. 2.0 MB/s | 131 kB 00:00 2023-11-06T13:24:40.322 INFO:teuthology.orchestra.run.smithi038.stdout:(16/120): libradosstriper1-16.2.14-132.g4e03306 6.9 MB/s | 494 kB 00:00 2023-11-06T13:24:40.667 INFO:teuthology.orchestra.run.smithi038.stdout:(17/120): libcephsqlite-16.2.14-132.g4e03306b.e 340 kB/s | 174 kB 00:00 2023-11-06T13:24:40.863 INFO:teuthology.orchestra.run.smithi038.stdout:(18/120): python3-ceph-argparse-16.2.14-132.g4e 230 kB/s | 45 kB 00:00 2023-11-06T13:24:41.057 INFO:teuthology.orchestra.run.smithi038.stdout:(19/120): librgw2-16.2.14-132.g4e03306b.el8.x86 5.2 MB/s | 3.8 MB 00:00 2023-11-06T13:24:41.131 INFO:teuthology.orchestra.run.smithi038.stdout:(20/120): python3-cephfs-16.2.14-132.g4e03306b. 2.9 MB/s | 215 kB 00:00 2023-11-06T13:24:41.132 INFO:teuthology.orchestra.run.smithi038.stdout:(21/120): python3-ceph-common-16.2.14-132.g4e03 367 kB/s | 99 kB 00:00 2023-11-06T13:24:41.215 INFO:teuthology.orchestra.run.smithi038.stdout:(22/120): python3-rbd-16.2.14-132.g4e03306b.el8 4.4 MB/s | 369 kB 00:00 2023-11-06T13:24:41.286 INFO:teuthology.orchestra.run.smithi038.stdout:(23/120): python3-rgw-16.2.14-132.g4e03306b.el8 1.6 MB/s | 114 kB 00:00 2023-11-06T13:24:41.340 INFO:teuthology.orchestra.run.smithi038.stdout:(24/120): rbd-fuse-16.2.14-132.g4e03306b.el8.x8 1.6 MB/s | 88 kB 00:00 2023-11-06T13:24:41.398 INFO:teuthology.orchestra.run.smithi044.stdout:(119/120): librbd1-16.2.14-132.g4e03306b.el8.x8 753 kB/s | 4.2 MB 00:05 2023-11-06T13:24:41.778 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-11-06T13:24:42.003 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-06T13:24:42.045 INFO:teuthology.orchestra.run.smithi038.stdout:(25/120): rbd-mirror-16.2.14-132.g4e03306b.el8. 5.2 MB/s | 3.7 MB 00:00 2023-11-06T13:24:42.113 INFO:teuthology.orchestra.run.smithi038.stdout:(26/120): rbd-nbd-16.2.14-132.g4e03306b.el8.x86 2.5 MB/s | 173 kB 00:00 2023-11-06T13:24:42.169 INFO:teuthology.orchestra.run.smithi038.stdout:(27/120): ceph-grafana-dashboards-16.2.14-132.g 424 kB/s | 24 kB 00:00 2023-11-06T13:24:42.225 INFO:teuthology.orchestra.run.smithi038.stdout:(28/120): python3-rados-16.2.14-132.g4e03306b.e 357 kB/s | 390 kB 00:01 2023-11-06T13:24:42.235 INFO:teuthology.orchestra.run.smithi038.stdout:(29/120): ceph-mgr-cephadm-16.2.14-132.g4e03306 1.7 MB/s | 116 kB 00:00 2023-11-06T13:24:42.423 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-06T13:24:42.664 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/122 2023-11-06T13:24:42.884 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/122 2023-11-06T13:24:43.005 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/122 2023-11-06T13:24:43.242 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-11-06T13:24:43.648 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-11-06T13:24:43.867 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:24:44.123 INFO:teuthology.orchestra.run.smithi038.stdout:(30/120): ceph-mgr-diskprediction-local-16.2.14 4.5 MB/s | 8.6 MB 00:01 2023-11-06T13:24:44.182 INFO:teuthology.orchestra.run.smithi038.stdout:(31/120): ceph-mgr-modules-core-16.2.14-132.g4e 4.1 MB/s | 245 kB 00:00 2023-11-06T13:24:44.230 INFO:teuthology.orchestra.run.smithi038.stdout:(32/120): ceph-mgr-rook-16.2.14-132.g4e03306b.e 568 kB/s | 27 kB 00:00 2023-11-06T13:24:44.276 INFO:teuthology.orchestra.run.smithi038.stdout:(33/120): ceph-prometheus-alerts-16.2.14-132.g4 323 kB/s | 15 kB 00:00 2023-11-06T13:24:44.323 INFO:teuthology.orchestra.run.smithi038.stdout:(34/120): cephadm-16.2.14-132.g4e03306b.el8.noa 1.8 MB/s | 85 kB 00:00 2023-11-06T13:24:44.323 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:24:44.373 INFO:teuthology.orchestra.run.smithi038.stdout:(35/120): cephfs-top-16.2.14-132.g4e03306b.el8. 369 kB/s | 19 kB 00:00 2023-11-06T13:24:44.566 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:24:44.709 INFO:teuthology.orchestra.run.smithi038.stdout:(36/120): gperftools-libs-2.7-9.el8.x86_64.rpm 912 kB/s | 306 kB 00:00 2023-11-06T13:24:44.724 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:24:44.795 INFO:teuthology.orchestra.run.smithi038.stdout:(37/120): leveldb-1.22-1.el8.x86_64.rpm 2.1 MB/s | 181 kB 00:00 2023-11-06T13:24:44.864 INFO:teuthology.orchestra.run.smithi038.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 854 kB/s | 59 kB 00:00 2023-11-06T13:24:44.926 INFO:teuthology.orchestra.run.smithi038.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2023-11-06T13:24:44.950 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:24:45.004 INFO:teuthology.orchestra.run.smithi038.stdout:(40/120): python3-apipkg-1.5-6.el8.noarch.rpm 271 kB/s | 21 kB 00:00 2023-11-06T13:24:45.046 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:24:45.063 INFO:teuthology.orchestra.run.smithi038.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 735 kB/s | 44 kB 00:00 2023-11-06T13:24:45.289 INFO:teuthology.orchestra.run.smithi038.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 821 kB/s | 185 kB 00:00 2023-11-06T13:24:45.366 INFO:teuthology.orchestra.run.smithi038.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 433 kB/s | 33 kB 00:00 2023-11-06T13:24:45.433 INFO:teuthology.orchestra.run.smithi038.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2023-11-06T13:24:45.518 INFO:teuthology.orchestra.run.smithi038.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-11-06T13:24:45.570 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 9/122 2023-11-06T13:24:45.653 INFO:teuthology.orchestra.run.smithi038.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-11-06T13:24:45.754 INFO:teuthology.orchestra.run.smithi038.stdout:(47/120): python3-execnet-1.7.1-1.el8.noarch.rp 3.5 MB/s | 355 kB 00:00 2023-11-06T13:24:45.783 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:24:45.881 INFO:teuthology.orchestra.run.smithi038.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 634 kB/s | 81 kB 00:00 2023-11-06T13:24:45.896 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:24:45.940 INFO:teuthology.orchestra.run.smithi038.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-11-06T13:24:45.987 INFO:teuthology.orchestra.run.smithi038.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 377 kB/s | 18 kB 00:00 2023-11-06T13:24:46.145 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-06T13:24:46.147 INFO:teuthology.orchestra.run.smithi038.stdout:(51/120): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2023-11-06T13:24:46.195 INFO:teuthology.orchestra.run.smithi038.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 1.0 MB/s | 49 kB 00:00 2023-11-06T13:24:46.252 INFO:teuthology.orchestra.run.smithi038.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-11-06T13:24:46.330 INFO:teuthology.orchestra.run.smithi038.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.5 MB/s | 283 kB 00:00 2023-11-06T13:24:46.360 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-06T13:24:46.380 INFO:teuthology.orchestra.run.smithi038.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-11-06T13:24:46.432 INFO:teuthology.orchestra.run.smithi038.stdout:(56/120): python3-remoto-1.2.1-1.el8.noarch.rpm 947 kB/s | 49 kB 00:00 2023-11-06T13:24:46.482 INFO:teuthology.orchestra.run.smithi038.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 687 kB/s | 34 kB 00:00 2023-11-06T13:24:46.561 INFO:teuthology.orchestra.run.smithi038.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 2.4 MB/s | 196 kB 00:00 2023-11-06T13:24:46.566 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:24:46.625 INFO:teuthology.orchestra.run.smithi038.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.0 MB/s | 64 kB 00:00 2023-11-06T13:24:46.676 INFO:teuthology.orchestra.run.smithi038.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 357 kB/s | 19 kB 00:00 2023-11-06T13:24:46.705 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:24:46.728 INFO:teuthology.orchestra.run.smithi038.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 458 kB/s | 24 kB 00:00 2023-11-06T13:24:46.769 INFO:teuthology.orchestra.run.smithi038.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 730 kB/s | 29 kB 00:00 2023-11-06T13:24:46.816 INFO:teuthology.orchestra.run.smithi038.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 581 kB/s | 27 kB 00:00 2023-11-06T13:24:46.867 INFO:teuthology.orchestra.run.smithi038.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-11-06T13:24:46.899 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 14/122 2023-11-06T13:24:46.914 INFO:teuthology.orchestra.run.smithi038.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 5.3 MB/s | 251 kB 00:00 2023-11-06T13:24:46.956 INFO:teuthology.orchestra.run.smithi038.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-11-06T13:24:46.974 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 14/122 2023-11-06T13:24:47.000 INFO:teuthology.orchestra.run.smithi038.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 1.9 MB/s | 85 kB 00:00 2023-11-06T13:24:47.042 INFO:teuthology.orchestra.run.smithi038.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 556 kB/s | 23 kB 00:00 2023-11-06T13:24:47.046 INFO:teuthology.orchestra.run.smithi038.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-11-06T13:24:47.080 INFO:teuthology.orchestra.run.smithi038.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 558 kB/s | 19 kB 00:00 2023-11-06T13:24:47.094 INFO:teuthology.orchestra.run.smithi038.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.9 MB/s | 43 kB 00:00 2023-11-06T13:24:47.110 INFO:teuthology.orchestra.run.smithi038.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.6 MB/s | 155 kB 00:00 2023-11-06T13:24:47.127 INFO:teuthology.orchestra.run.smithi038.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-11-06T13:24:47.145 INFO:teuthology.orchestra.run.smithi038.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.6 MB/s | 48 kB 00:00 2023-11-06T13:24:47.161 INFO:teuthology.orchestra.run.smithi038.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-11-06T13:24:47.162 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-11-06T13:24:47.174 INFO:teuthology.orchestra.run.smithi038.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.1 MB/s | 43 kB 00:00 2023-11-06T13:24:47.220 INFO:teuthology.orchestra.run.smithi038.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 51 MB/s | 2.3 MB 00:00 2023-11-06T13:24:47.233 INFO:teuthology.orchestra.run.smithi038.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-11-06T13:24:47.254 INFO:teuthology.orchestra.run.smithi038.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 30 MB/s | 605 kB 00:00 2023-11-06T13:24:47.267 INFO:teuthology.orchestra.run.smithi038.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 6.2 MB/s | 83 kB 00:00 2023-11-06T13:24:47.279 INFO:teuthology.orchestra.run.smithi038.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 4.8 MB/s | 59 kB 00:00 2023-11-06T13:24:47.293 INFO:teuthology.orchestra.run.smithi038.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-11-06T13:24:47.305 INFO:teuthology.orchestra.run.smithi038.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.2 MB/s | 38 kB 00:00 2023-11-06T13:24:47.317 INFO:teuthology.orchestra.run.smithi038.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.9 MB/s | 86 kB 00:00 2023-11-06T13:24:47.329 INFO:teuthology.orchestra.run.smithi038.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.8 MB/s | 58 kB 00:00 2023-11-06T13:24:47.341 INFO:teuthology.orchestra.run.smithi038.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.9 MB/s | 47 kB 00:00 2023-11-06T13:24:47.350 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-11-06T13:24:47.360 INFO:teuthology.orchestra.run.smithi038.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 29 MB/s | 559 kB 00:00 2023-11-06T13:24:47.381 INFO:teuthology.orchestra.run.smithi038.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 31 MB/s | 639 kB 00:00 2023-11-06T13:24:47.393 INFO:teuthology.orchestra.run.smithi038.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.8 MB/s | 70 kB 00:00 2023-11-06T13:24:47.407 INFO:teuthology.orchestra.run.smithi038.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 14 MB/s | 200 kB 00:00 2023-11-06T13:24:47.421 INFO:teuthology.orchestra.run.smithi038.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.2 MB/s | 97 kB 00:00 2023-11-06T13:24:47.483 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-11-06T13:24:47.674 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-11-06T13:24:47.694 INFO:teuthology.orchestra.run.smithi038.stdout:(92/120): python3-scipy-1.0.0-20.module+el8.1.0 53 MB/s | 15 MB 00:00 2023-11-06T13:24:47.707 INFO:teuthology.orchestra.run.smithi038.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.2 MB/s | 44 kB 00:00 2023-11-06T13:24:47.719 INFO:teuthology.orchestra.run.smithi038.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-11-06T13:24:47.733 INFO:teuthology.orchestra.run.smithi038.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-11-06T13:24:47.750 INFO:teuthology.orchestra.run.smithi038.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-11-06T13:24:47.767 INFO:teuthology.orchestra.run.smithi038.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 26 MB/s | 457 kB 00:00 2023-11-06T13:24:47.842 INFO:teuthology.orchestra.run.smithi038.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 64 MB/s | 4.8 MB 00:00 2023-11-06T13:24:47.855 INFO:teuthology.orchestra.run.smithi038.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-11-06T13:24:47.876 INFO:teuthology.orchestra.run.smithi038.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 33 MB/s | 688 kB 00:00 2023-11-06T13:24:47.890 INFO:teuthology.orchestra.run.smithi038.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2023-11-06T13:24:47.905 INFO:teuthology.orchestra.run.smithi038.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 15 MB/s | 225 kB 00:00 2023-11-06T13:24:47.919 INFO:teuthology.orchestra.run.smithi038.stdout:(103/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.9 MB/s | 126 kB 00:00 2023-11-06T13:24:47.979 INFO:teuthology.orchestra.run.smithi038.stdout:(104/120): python3-numpy-1.14.3-9.el8.x86_64.rp 62 MB/s | 3.7 MB 00:00 2023-11-06T13:24:47.994 INFO:teuthology.orchestra.run.smithi038.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-11-06T13:24:48.011 INFO:teuthology.orchestra.run.smithi038.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 30 MB/s | 538 kB 00:00 2023-11-06T13:24:48.027 INFO:teuthology.orchestra.run.smithi038.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 19 MB/s | 302 kB 00:00 2023-11-06T13:24:48.040 INFO:teuthology.orchestra.run.smithi038.stdout:(108/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-11-06T13:24:48.053 INFO:teuthology.orchestra.run.smithi038.stdout:(109/120): python3-pyasn1-modules-0.3.7-6.el8.n 8.7 MB/s | 110 kB 00:00 2023-11-06T13:24:48.068 INFO:teuthology.orchestra.run.smithi038.stdout:(110/120): librdkafka-0.11.4-1.el8.x86_64.rpm 23 MB/s | 353 kB 00:00 2023-11-06T13:24:48.272 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-11-06T13:24:48.466 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-11-06T13:24:48.488 INFO:teuthology.orchestra.run.smithi038.stdout:(111/120): ceph-test-16.2.14-132.g4e03306b.el8. 6.0 MB/s | 52 MB 00:08 2023-11-06T13:24:48.490 INFO:teuthology.orchestra.run.smithi038.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 47 kB/s | 20 kB 00:00 2023-11-06T13:24:48.506 INFO:teuthology.orchestra.run.smithi038.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.4 MB/s | 54 kB 00:00 2023-11-06T13:24:48.535 INFO:teuthology.orchestra.run.smithi038.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 15 MB/s | 709 kB 00:00 2023-11-06T13:24:48.608 INFO:teuthology.orchestra.run.smithi038.stdout:(115/120): ceph-mgr-dashboard-16.2.14-132.g4e03 502 kB/s | 3.1 MB 00:06 2023-11-06T13:24:48.624 INFO:teuthology.orchestra.run.smithi038.stdout:(116/120): openblas-threads-0.3.12-1.el8.x86_64 40 MB/s | 4.7 MB 00:00 2023-11-06T13:24:48.664 INFO:teuthology.orchestra.run.smithi038.stdout:(117/120): openblas-0.3.12-1.el8.x86_64.rpm 36 MB/s | 4.6 MB 00:00 2023-11-06T13:24:48.669 INFO:teuthology.orchestra.run.smithi038.stdout:(118/120): automake-1.16.1-7.el8.noarch.rpm 11 MB/s | 713 kB 00:00 2023-11-06T13:24:48.996 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-11-06T13:24:49.114 INFO:teuthology.orchestra.run.smithi038.stdout:(119/120): librbd1-16.2.14-132.g4e03306b.el8.x8 9.3 MB/s | 4.2 MB 00:00 2023-11-06T13:24:49.191 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-11-06T13:24:49.966 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-11-06T13:24:50.261 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-11-06T13:24:50.482 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-11-06T13:24:50.688 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-11-06T13:24:50.996 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-11-06T13:24:51.303 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-11-06T13:24:51.347 INFO:teuthology.orchestra.run.smithi038.stdout:(120/120): librados2-16.2.14-132.g4e03306b.el8. 1.4 MB/s | 3.7 MB 00:02 2023-11-06T13:24:51.351 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2023-11-06T13:24:51.351 INFO:teuthology.orchestra.run.smithi038.stdout:Total 13 MB/s | 201 MB 00:15 2023-11-06T13:24:51.410 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2023-11-06T13:24:51.539 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction check succeeded. 2023-11-06T13:24:51.539 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2023-11-06T13:24:51.582 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-06T13:24:51.796 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:16.2.14-132.g4e03306b.el8. 26/122 2023-11-06T13:24:52.007 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:16.2.14-132.g4e03306b.el 27/122 2023-11-06T13:24:52.287 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_6 28/122 2023-11-06T13:24:53.259 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded. 2023-11-06T13:24:53.264 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2023-11-06T13:24:53.314 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-11-06T13:24:53.680 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-11-06T13:24:53.999 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-11-06T13:24:54.272 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-11-06T13:24:54.582 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-11-06T13:24:54.882 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-11-06T13:24:56.979 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-11-06T13:24:57.360 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-11-06T13:24:57.551 INFO:teuthology.orchestra.run.smithi044.stdout:(120/120): ceph-test-16.2.14-132.g4e03306b.el8. 1.7 MB/s | 52 MB 00:30 2023-11-06T13:24:57.555 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2023-11-06T13:24:57.556 INFO:teuthology.orchestra.run.smithi044.stdout:Total 4.9 MB/s | 201 MB 00:40 2023-11-06T13:24:57.613 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-06T13:24:57.615 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2023-11-06T13:24:57.743 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2023-11-06T13:24:57.743 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2023-11-06T13:24:57.859 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-06T13:24:58.092 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 38/122 2023-11-06T13:24:58.110 INFO:teuthology.orchestra.run.smithi038.stdout: Preparing : 1/1 2023-11-06T13:24:58.306 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 39/122 2023-11-06T13:24:58.392 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-06T13:24:58.535 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:16.2.14-132.g4e03306b.el8.x86_6 40/122 2023-11-06T13:24:58.640 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-06T13:24:58.747 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-11-06T13:24:58.825 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-06T13:24:58.952 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-11-06T13:24:58.997 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-11-06T13:24:59.166 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-11-06T13:24:59.167 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-06T13:24:59.342 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-11-06T13:24:59.446 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2023-11-06T13:24:59.450 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2023-11-06T13:24:59.469 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-11-06T13:24:59.617 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-11-06T13:24:59.665 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-11-06T13:24:59.809 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librados2-2:16.2.14-132.g4e03306b.el8.x86_64 5/122 2023-11-06T13:24:59.859 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-11-06T13:25:00.186 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-11-06T13:25:00.281 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-2:16.2.14-132.g4e03306b.el8.x86_64 5/122 2023-11-06T13:25:00.451 INFO:teuthology.orchestra.run.smithi038.stdout: Upgrading : librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:25:00.488 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-11-06T13:25:00.612 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:25:00.764 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-11-06T13:25:00.801 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:25:00.951 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:25:01.132 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-11-06T13:25:01.139 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:25:01.370 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-11-06T13:25:01.613 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-11-06T13:25:01.660 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/122 2023-11-06T13:25:01.808 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:25:01.851 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-11-06T13:25:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:25:02.085 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-11-06T13:25:02.155 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-06T13:25:02.288 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-11-06T13:25:02.357 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-11-06T13:25:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-06T13:25:02.557 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-11-06T13:25:02.583 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:25:02.697 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:25:02.776 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-11-06T13:25:02.858 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 14/122 2023-11-06T13:25:02.936 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 14/122 2023-11-06T13:25:02.991 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-06T13:25:03.098 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-11-06T13:25:03.215 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-06T13:25:03.538 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-06T13:25:03.622 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-11-06T13:25:03.827 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-06T13:25:03.857 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-11-06T13:25:04.005 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-06T13:25:04.012 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-11-06T13:25:04.133 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-06T13:25:04.174 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2023-11-06T13:25:04.202 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-06T13:25:04.301 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-11-06T13:25:04.385 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-06T13:25:04.400 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-11-06T13:25:04.450 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-06T13:25:04.563 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/122 2023-11-06T13:25:04.637 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-06T13:25:04.777 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/122 2023-11-06T13:25:04.895 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-06T13:25:04.958 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 4/122 2023-11-06T13:25:05.044 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-11-06T13:25:05.125 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-06T13:25:05.127 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 4/122 2023-11-06T13:25:05.250 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-06T13:25:05.316 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-11-06T13:25:05.328 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-06T13:25:05.634 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-06T13:25:05.718 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/122 2023-11-06T13:25:05.801 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-11-06T13:25:05.885 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-06T13:25:05.958 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:25:05.991 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-11-06T13:25:06.137 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-06T13:25:06.395 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:25:06.462 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-06T13:25:06.575 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:25:06.699 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:25:06.746 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-11-06T13:25:06.763 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-06T13:25:06.900 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:25:06.950 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-06T13:25:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:25:07.038 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-11-06T13:25:07.253 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-06T13:25:07.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-11-06T13:25:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 9/122 2023-11-06T13:25:07.578 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-06T13:25:07.749 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:25:07.765 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-common-2:16.2.14-132.g4e03306b.el8. 26/122 2023-11-06T13:25:07.868 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:25:07.917 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-ceph-argparse-2:16.2.14-132.g4e03306b.el 27/122 2023-11-06T13:25:08.129 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-11-06T13:25:08.174 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_6 28/122 2023-11-06T13:25:08.324 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-11-06T13:25:08.393 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-11-06T13:25:08.435 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-06T13:25:08.566 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:25:08.673 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:25:08.694 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-11-06T13:25:08.787 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-06T13:25:08.825 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 14/122 2023-11-06T13:25:08.921 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 14/122 2023-11-06T13:25:08.958 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-06T13:25:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-06T13:25:09.062 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-11-06T13:25:09.216 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-11-06T13:25:09.358 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-11-06T13:25:09.386 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-06T13:25:09.524 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-11-06T13:25:09.693 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-06T13:25:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-06T13:25:10.096 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-11-06T13:25:10.201 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-06T13:25:10.382 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-11-06T13:25:10.493 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-06T13:25:10.729 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-06T13:25:10.929 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-06T13:25:10.939 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-11-06T13:25:11.154 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-06T13:25:11.160 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-11-06T13:25:11.165 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-11-06T13:25:11.485 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-11-06T13:25:11.897 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-11-06T13:25:12.162 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-11-06T13:25:12.382 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-11-06T13:25:12.540 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-11-06T13:25:12.546 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-11-06T13:25:12.846 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-11-06T13:25:12.862 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-11-06T13:25:13.079 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-11-06T13:25:13.139 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-11-06T13:25:13.341 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-06T13:25:13.375 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-11-06T13:25:13.530 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:16.2.14-132.g4e03306b.el8. 26/122 2023-11-06T13:25:13.544 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-06T13:25:13.690 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:16.2.14-132.g4e03306b.el 27/122 2023-11-06T13:25:13.736 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 38/122 2023-11-06T13:25:13.940 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_6 28/122 2023-11-06T13:25:13.954 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 39/122 2023-11-06T13:25:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librados-devel-2:16.2.14-132.g4e03306b.el8.x86_6 40/122 2023-11-06T13:25:14.431 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-11-06T13:25:14.649 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-11-06T13:25:14.873 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-11-06T13:25:15.000 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-11-06T13:25:15.054 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-11-06T13:25:15.223 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-06T13:25:15.301 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-11-06T13:25:15.309 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-11-06T13:25:15.492 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-11-06T13:25:15.585 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-11-06T13:25:15.635 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-11-06T13:25:15.848 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-11-06T13:25:15.848 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-11-06T13:25:16.004 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-11-06T13:25:16.170 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-11-06T13:25:16.194 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-11-06T13:25:16.344 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-11-06T13:25:16.398 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-11-06T13:25:16.427 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:16.522 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-11-06T13:25:16.670 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-11-06T13:25:16.904 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-11-06T13:25:17.213 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-11-06T13:25:17.380 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:17.470 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-11-06T13:25:17.702 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 89/122 2023-11-06T13:25:17.716 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-11-06T13:25:17.779 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 89/122 2023-11-06T13:25:17.928 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 90/122 2023-11-06T13:25:18.016 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-11-06T13:25:18.199 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-06T13:25:18.381 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-06T13:25:18.563 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-11-06T13:25:18.708 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-06T13:25:18.886 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-11-06T13:25:18.958 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-06T13:25:19.140 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-11-06T13:25:19.177 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-06T13:25:19.329 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-06T13:25:19.335 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-11-06T13:25:19.496 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-06T13:25:19.585 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 38/122 2023-11-06T13:25:19.683 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-06T13:25:19.781 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 39/122 2023-11-06T13:25:19.916 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-06T13:25:19.998 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:16.2.14-132.g4e03306b.el8.x86_6 40/122 2023-11-06T13:25:20.160 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-06T13:25:20.205 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-11-06T13:25:20.358 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-06T13:25:20.396 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-11-06T13:25:20.560 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-11-06T13:25:20.650 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-06T13:25:20.717 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-11-06T13:25:20.887 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-06T13:25:21.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-11-06T13:25:21.080 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-06T13:25:21.235 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-11-06T13:25:21.403 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-11-06T13:25:21.411 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-06T13:25:21.690 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-06T13:25:21.744 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-11-06T13:25:21.892 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-06T13:25:22.002 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-11-06T13:25:22.106 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-06T13:25:22.259 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-11-06T13:25:22.640 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-11-06T13:25:22.847 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-11-06T13:25:23.056 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-11-06T13:25:23.255 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-11-06T13:25:23.353 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-06T13:25:23.478 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-11-06T13:25:23.622 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-11-06T13:25:23.673 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-06T13:25:23.704 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-11-06T13:25:23.908 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-11-06T13:25:23.935 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-06T13:25:24.098 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-11-06T13:25:24.231 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-06T13:25:24.301 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-11-06T13:25:24.475 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-11-06T13:25:24.785 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-11-06T13:25:24.959 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-06T13:25:24.999 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-11-06T13:25:25.198 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-11-06T13:25:25.207 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-06T13:25:25.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-11-06T13:25:25.454 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-06T13:25:25.520 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-11-06T13:25:25.756 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-11-06T13:25:25.767 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-06T13:25:26.003 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-06T13:25:26.005 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-11-06T13:25:26.184 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 68/122 2023-11-06T13:25:26.236 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-06T13:25:26.431 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-06T13:25:26.497 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 69/122 2023-11-06T13:25:26.761 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 70/122 2023-11-06T13:25:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 71/122 2023-11-06T13:25:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 72/122 2023-11-06T13:25:27.509 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-2.6-1.el8.noarch 73/122 2023-11-06T13:25:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 74/122 2023-11-06T13:25:27.984 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 75/122 2023-11-06T13:25:28.255 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 76/122 2023-11-06T13:25:29.620 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 77/122 2023-11-06T13:25:29.947 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 78/122 2023-11-06T13:25:30.175 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 79/122 2023-11-06T13:25:30.533 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/122 2023-11-06T13:25:30.932 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 81/122 2023-11-06T13:25:31.180 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/122 2023-11-06T13:25:31.435 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 83/122 2023-11-06T13:25:31.735 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 84/122 2023-11-06T13:25:31.767 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:31.920 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 85/122 2023-11-06T13:25:31.997 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:32.151 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 86/122 2023-11-06T13:25:32.388 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 87/122 2023-11-06T13:25:32.767 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:33.059 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 89/122 2023-11-06T13:25:33.152 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 89/122 2023-11-06T13:25:33.296 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 90/122 2023-11-06T13:25:35.759 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 90/122 2023-11-06T13:25:35.760 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2023-11-06T13:25:35.760 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2023-11-06T13:25:35.760 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-11-06T13:25:35.760 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /run 2023-11-06T13:25:35.761 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2023-11-06T13:25:35.761 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2023-11-06T13:25:35.761 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2023-11-06T13:25:35.761 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2023-11-06T13:25:35.761 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-11-06T13:25:35.762 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:25:36.133 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 91/122 2023-11-06T13:25:36.580 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 91/122 2023-11-06T13:25:36.774 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 92/122 2023-11-06T13:25:37.828 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:38.079 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:38.267 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 92/122 2023-11-06T13:25:38.466 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 93/122 2023-11-06T13:25:38.487 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 93/122 2023-11-06T13:25:38.837 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 88/122 2023-11-06T13:25:39.097 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 89/122 2023-11-06T13:25:39.207 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 89/122 2023-11-06T13:25:39.320 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 90/122 2023-11-06T13:25:41.426 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:16.2.14-132.g4e03306b.el8.noarch 94/122 2023-11-06T13:25:41.589 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:16.2.14-132.g4e03306b.el8.noarch 94/122 2023-11-06T13:25:41.797 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.e 95/122 2023-11-06T13:25:42.009 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-132.g4e03306b. 96/122 2023-11-06T13:25:42.198 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 97/122 2023-11-06T13:25:43.154 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 97/122 2023-11-06T13:25:43.430 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 98/122 2023-11-06T13:25:44.468 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 98/122 2023-11-06T13:25:44.664 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 99/122 2023-11-06T13:25:44.760 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 99/122 2023-11-06T13:25:45.156 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el 100/122 2023-11-06T13:25:45.380 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 101/122 2023-11-06T13:25:45.407 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 101/122 2023-11-06T13:25:45.573 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 102/122 2023-11-06T13:25:45.584 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 102/122 2023-11-06T13:25:46.703 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:16.2.14-132.g4e03306b.el8.x86_64 103/122 2023-11-06T13:25:46.955 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 104/122 2023-11-06T13:25:47.069 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 104/122 2023-11-06T13:25:47.238 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-132.g4e033 105/122 2023-11-06T13:25:47.281 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-132.g4e033 105/122 2023-11-06T13:25:47.465 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 106/122 2023-11-06T13:25:47.808 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 106/122 2023-11-06T13:25:48.022 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 107/122 2023-11-06T13:25:51.646 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 90/122 2023-11-06T13:25:51.647 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /sys 2023-11-06T13:25:51.647 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /proc 2023-11-06T13:25:51.647 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2023-11-06T13:25:51.647 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /run 2023-11-06T13:25:51.648 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /mnt 2023-11-06T13:25:51.648 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /var/tmp 2023-11-06T13:25:51.648 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /home 2023-11-06T13:25:51.648 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /tmp 2023-11-06T13:25:51.648 INFO:teuthology.orchestra.run.smithi038.stdout:skipping the directory /dev 2023-11-06T13:25:51.649 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:25:52.011 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 91/122 2023-11-06T13:25:52.483 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 91/122 2023-11-06T13:25:52.579 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 107/122 2023-11-06T13:25:52.644 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 92/122 2023-11-06T13:25:52.927 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 108/122 2023-11-06T13:25:53.130 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-11-06T13:25:53.825 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-11-06T13:25:54.232 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 92/122 2023-11-06T13:25:54.246 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-11-06T13:25:54.467 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 111/122 2023-11-06T13:25:54.577 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 93/122 2023-11-06T13:25:54.600 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 93/122 2023-11-06T13:25:54.708 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-11-06T13:25:54.917 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_ 113/122 2023-11-06T13:25:55.110 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-06T13:25:55.321 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 115/122 2023-11-06T13:25:55.513 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 116/122 2023-11-06T13:25:55.706 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 117/122 2023-11-06T13:25:55.901 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-11-06T13:25:56.179 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-11-06T13:25:56.238 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-11-06T13:25:56.438 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-11-06T13:25:56.447 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-11-06T13:25:56.448 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-06T13:25:56.691 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-06T13:25:56.691 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:25:57.537 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 90/122 2023-11-06T13:25:57.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2023-11-06T13:25:57.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2023-11-06T13:25:57.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /dev 2023-11-06T13:25:57.538 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /run 2023-11-06T13:25:57.539 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2023-11-06T13:25:57.539 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2023-11-06T13:25:57.539 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2023-11-06T13:25:57.539 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2023-11-06T13:25:57.539 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /dev 2023-11-06T13:25:57.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:25:57.625 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:25:57.625 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:16.2.14-132.g4e03306b.el8.x86_64 1/122 2023-11-06T13:25:57.625 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 2/122 2023-11-06T13:25:57.625 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 3/122 2023-11-06T13:25:57.626 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 4/122 2023-11-06T13:25:57.626 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-132.g4e033 5/122 2023-11-06T13:25:57.627 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:25:57.627 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:25:57.627 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:25:57.628 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 9/122 2023-11-06T13:25:57.628 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:25:57.629 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 11/122 2023-11-06T13:25:57.629 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 12/122 2023-11-06T13:25:57.629 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:25:57.630 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_ 14/122 2023-11-06T13:25:57.630 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 15/122 2023-11-06T13:25:57.630 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 16/122 2023-11-06T13:25:57.630 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:16.2.14-132.g4e03306b.el8.x86_6 17/122 2023-11-06T13:25:57.630 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 18/122 2023-11-06T13:25:57.631 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 19/122 2023-11-06T13:25:57.631 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:16.2.14-132.g4e03306b.el 20/122 2023-11-06T13:25:57.631 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:16.2.14-132.g4e03306b.el8. 21/122 2023-11-06T13:25:57.632 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_6 22/122 2023-11-06T13:25:57.632 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 23/122 2023-11-06T13:25:57.632 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 24/122 2023-11-06T13:25:57.633 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 25/122 2023-11-06T13:25:57.633 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 26/122 2023-11-06T13:25:57.633 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 27/122 2023-11-06T13:25:57.634 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 28/122 2023-11-06T13:25:57.635 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-132.g4e03306b. 29/122 2023-11-06T13:25:57.635 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 30/122 2023-11-06T13:25:57.635 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 31/122 2023-11-06T13:25:57.636 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 32/122 2023-11-06T13:25:57.636 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el 33/122 2023-11-06T13:25:57.636 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 34/122 2023-11-06T13:25:57.637 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.e 35/122 2023-11-06T13:25:57.637 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:16.2.14-132.g4e03306b.el8.noarch 36/122 2023-11-06T13:25:57.638 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 37/122 2023-11-06T13:25:57.638 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-06T13:25:57.638 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-06T13:25:57.638 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-06T13:25:57.639 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-06T13:25:57.639 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-06T13:25:57.639 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-06T13:25:57.639 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-06T13:25:57.640 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-06T13:25:57.640 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-06T13:25:57.640 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-06T13:25:57.640 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-06T13:25:57.641 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-06T13:25:57.641 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-06T13:25:57.641 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-06T13:25:57.642 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-06T13:25:57.642 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-06T13:25:57.642 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-06T13:25:57.642 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-06T13:25:57.642 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-06T13:25:57.643 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-06T13:25:57.643 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-06T13:25:57.643 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-06T13:25:57.644 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-06T13:25:57.644 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-06T13:25:57.644 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-06T13:25:57.644 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-06T13:25:57.644 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-06T13:25:57.645 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-06T13:25:57.645 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-06T13:25:57.645 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-06T13:25:57.646 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-06T13:25:57.647 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-06T13:25:57.647 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-06T13:25:57.647 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-06T13:25:57.647 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-11-06T13:25:57.647 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-11-06T13:25:57.648 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-11-06T13:25:57.648 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-11-06T13:25:57.648 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-11-06T13:25:57.648 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-11-06T13:25:57.648 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-11-06T13:25:57.649 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-11-06T13:25:57.649 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-11-06T13:25:57.649 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-11-06T13:25:57.649 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-11-06T13:25:57.649 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-11-06T13:25:57.650 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-11-06T13:25:57.650 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-11-06T13:25:57.650 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-11-06T13:25:57.650 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-11-06T13:25:57.650 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-11-06T13:25:57.651 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-11-06T13:25:57.651 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-11-06T13:25:57.651 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-11-06T13:25:57.651 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-11-06T13:25:57.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-11-06T13:25:57.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-11-06T13:25:57.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-11-06T13:25:57.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-11-06T13:25:57.652 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-11-06T13:25:57.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-11-06T13:25:57.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-11-06T13:25:57.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-11-06T13:25:57.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-11-06T13:25:57.653 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-11-06T13:25:57.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-11-06T13:25:57.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-11-06T13:25:57.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-11-06T13:25:57.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-11-06T13:25:57.654 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-11-06T13:25:57.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-11-06T13:25:57.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-11-06T13:25:57.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-11-06T13:25:57.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-11-06T13:25:57.655 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-11-06T13:25:57.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-11-06T13:25:57.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-11-06T13:25:57.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-11-06T13:25:57.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-11-06T13:25:57.656 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-11-06T13:25:57.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-11-06T13:25:57.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.14-132.g4e03306b.el8.x86_64 119/122 2023-11-06T13:25:57.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-06T13:25:57.657 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 121/122 2023-11-06T13:25:57.854 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephadm-2:16.2.14-132.g4e03306b.el8.noarch 94/122 2023-11-06T13:25:57.943 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 91/122 2023-11-06T13:25:57.975 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephadm-2:16.2.14-132.g4e03306b.el8.noarch 94/122 2023-11-06T13:25:58.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.e 95/122 2023-11-06T13:25:58.405 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 91/122 2023-11-06T13:25:58.481 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-132.g4e03306b. 96/122 2023-11-06T13:25:58.568 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 92/122 2023-11-06T13:25:58.667 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 97/122 2023-11-06T13:25:59.677 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 97/122 2023-11-06T13:25:59.946 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 98/122 2023-11-06T13:26:00.062 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:00.062 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:54 ago on Mon 06 Nov 2023 01:24:06 PM UTC. 2023-11-06T13:26:00.165 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 92/122 2023-11-06T13:26:00.334 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 93/122 2023-11-06T13:26:00.356 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 93/122 2023-11-06T13:26:01.060 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 98/122 2023-11-06T13:26:01.259 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 99/122 2023-11-06T13:26:01.360 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 99/122 2023-11-06T13:26:01.739 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el 100/122 2023-11-06T13:26:01.963 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 101/122 2023-11-06T13:26:01.992 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 101/122 2023-11-06T13:26:02.063 INFO:teuthology.orchestra.run.smithi163.stdout:Installed products updated. 2023-11-06T13:26:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 102/122 2023-11-06T13:26:02.171 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 102/122 2023-11-06T13:26:02.222 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:02.223 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2023-11-06T13:26:02.223 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.223 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.223 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-11-06T13:26:02.223 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.1-7.el8.noarch 2023-11-06T13:26:02.224 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.0.4-10.el8.x86_64 2023-11-06T13:26:02.224 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.224 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.224 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.224 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.225 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.225 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.225 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.225 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.225 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.226 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.226 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.226 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.226 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.226 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.227 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.227 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.227 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.227 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.227 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.228 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.228 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.228 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:02.228 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-06T13:26:02.228 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.1-9.el8.x86_64 2023-11-06T13:26:02.229 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-06T13:26:02.229 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-06T13:26:02.229 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.5-12.el8.x86_64 2023-11-06T13:26:02.229 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-06T13:26:02.229 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-06T13:26:02.230 INFO:teuthology.orchestra.run.smithi163.stdout: leveldb-1.22-1.el8.x86_64 2023-11-06T13:26:02.230 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-06T13:26:02.230 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.230 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.230 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.230 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-06T13:26:02.231 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-06T13:26:02.231 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-06T13:26:02.231 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-06T13:26:02.231 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-06T13:26:02.231 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.232 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.232 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-06T13:26:02.232 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.232 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-06T13:26:02.232 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-06T13:26:02.233 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-06T13:26:02.233 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-06T13:26:02.233 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-06T13:26:02.233 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-06T13:26:02.233 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-06T13:26:02.234 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-06T13:26:02.234 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-06T13:26:02.234 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-06T13:26:02.234 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-06T13:26:02.234 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-06T13:26:02.235 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-06T13:26:02.235 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-06T13:26:02.235 INFO:teuthology.orchestra.run.smithi163.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-06T13:26:02.235 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-06T13:26:02.235 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-06T13:26:02.236 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-06T13:26:02.236 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-06T13:26:02.236 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.236 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.236 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.237 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-06T13:26:02.237 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-06T13:26:02.237 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-06T13:26:02.237 INFO:teuthology.orchestra.run.smithi163.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-06T13:26:02.237 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-06T13:26:02.238 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-06T13:26:02.238 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-06T13:26:02.238 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-06T13:26:02.238 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-06T13:26:02.238 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-06T13:26:02.239 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-06T13:26:02.239 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-06T13:26:02.239 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-06T13:26:02.239 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-06T13:26:02.239 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-06T13:26:02.240 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-06T13:26:02.240 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-06T13:26:02.240 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-06T13:26:02.240 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-06T13:26:02.240 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-06T13:26:02.241 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-2.6-1.el8.noarch 2023-11-06T13:26:02.241 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-06T13:26:02.241 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-06T13:26:02.241 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-06T13:26:02.241 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-06T13:26:02.242 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.242 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.242 INFO:teuthology.orchestra.run.smithi163.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-06T13:26:02.242 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-06T13:26:02.242 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-06T13:26:02.243 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.243 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-06T13:26:02.243 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-06T13:26:02.243 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-06T13:26:02.243 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-06T13:26:02.243 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-06T13:26:02.244 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-06T13:26:02.244 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-06T13:26:02.244 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-06T13:26:02.244 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-06T13:26:02.244 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-06T13:26:02.245 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-06T13:26:02.245 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-06T13:26:02.245 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-06T13:26:02.245 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.245 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.246 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:02.246 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-06T13:26:02.246 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-06T13:26:02.246 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-06T13:26:02.247 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-06T13:26:02.247 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:02.247 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-11-06T13:26:02.526 DEBUG:teuthology.parallel:result is None 2023-11-06T13:26:03.282 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-2:16.2.14-132.g4e03306b.el8.x86_64 103/122 2023-11-06T13:26:03.415 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:16.2.14-132.g4e03306b.el8.noarch 94/122 2023-11-06T13:26:03.488 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 104/122 2023-11-06T13:26:03.538 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:16.2.14-132.g4e03306b.el8.noarch 94/122 2023-11-06T13:26:03.582 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 104/122 2023-11-06T13:26:03.717 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-132.g4e033 105/122 2023-11-06T13:26:03.733 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.e 95/122 2023-11-06T13:26:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-132.g4e033 105/122 2023-11-06T13:26:03.917 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 106/122 2023-11-06T13:26:03.939 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-132.g4e03306b. 96/122 2023-11-06T13:26:04.100 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 97/122 2023-11-06T13:26:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 106/122 2023-11-06T13:26:04.584 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 107/122 2023-11-06T13:26:05.108 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 97/122 2023-11-06T13:26:05.359 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 98/122 2023-11-06T13:26:06.471 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 98/122 2023-11-06T13:26:06.642 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 99/122 2023-11-06T13:26:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 99/122 2023-11-06T13:26:07.128 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el 100/122 2023-11-06T13:26:07.351 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 101/122 2023-11-06T13:26:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 101/122 2023-11-06T13:26:07.508 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 102/122 2023-11-06T13:26:07.520 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 102/122 2023-11-06T13:26:08.654 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:16.2.14-132.g4e03306b.el8.x86_64 103/122 2023-11-06T13:26:08.876 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 104/122 2023-11-06T13:26:08.969 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 104/122 2023-11-06T13:26:09.092 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-132.g4e033 105/122 2023-11-06T13:26:09.134 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-132.g4e033 105/122 2023-11-06T13:26:09.292 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 106/122 2023-11-06T13:26:09.446 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 107/122 2023-11-06T13:26:09.656 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 106/122 2023-11-06T13:26:09.825 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 107/122 2023-11-06T13:26:10.407 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 108/122 2023-11-06T13:26:10.762 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-11-06T13:26:10.935 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 110/122 2023-11-06T13:26:11.346 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-11-06T13:26:11.491 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-11-06T13:26:11.503 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-11-06T13:26:11.679 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_ 113/122 2023-11-06T13:26:11.873 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-06T13:26:12.008 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 115/122 2023-11-06T13:26:12.225 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 116/122 2023-11-06T13:26:12.524 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 117/122 2023-11-06T13:26:12.715 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-11-06T13:26:12.786 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-11-06T13:26:12.966 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-11-06T13:26:12.977 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-11-06T13:26:13.077 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-11-06T13:26:13.077 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-06T13:26:13.294 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-06T13:26:13.295 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:14.181 INFO:teuthology.orchestra.run.smithi038.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:14.182 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-2:16.2.14-132.g4e03306b.el8.x86_64 1/122 2023-11-06T13:26:14.182 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 2/122 2023-11-06T13:26:14.182 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 3/122 2023-11-06T13:26:14.183 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 4/122 2023-11-06T13:26:14.183 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-132.g4e033 5/122 2023-11-06T13:26:14.183 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:26:14.183 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:26:14.184 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:26:14.184 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 9/122 2023-11-06T13:26:14.184 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:26:14.184 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 11/122 2023-11-06T13:26:14.184 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 12/122 2023-11-06T13:26:14.185 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:26:14.185 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_ 14/122 2023-11-06T13:26:14.185 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 15/122 2023-11-06T13:26:14.185 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 16/122 2023-11-06T13:26:14.185 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados-devel-2:16.2.14-132.g4e03306b.el8.x86_6 17/122 2023-11-06T13:26:14.186 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 18/122 2023-11-06T13:26:14.186 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 19/122 2023-11-06T13:26:14.186 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-argparse-2:16.2.14-132.g4e03306b.el 20/122 2023-11-06T13:26:14.186 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-ceph-common-2:16.2.14-132.g4e03306b.el8. 21/122 2023-11-06T13:26:14.186 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_6 22/122 2023-11-06T13:26:14.187 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 23/122 2023-11-06T13:26:14.187 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 24/122 2023-11-06T13:26:14.188 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 25/122 2023-11-06T13:26:14.188 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 26/122 2023-11-06T13:26:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 27/122 2023-11-06T13:26:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 28/122 2023-11-06T13:26:14.189 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-132.g4e03306b. 29/122 2023-11-06T13:26:14.190 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 30/122 2023-11-06T13:26:14.197 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 31/122 2023-11-06T13:26:14.198 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 32/122 2023-11-06T13:26:14.198 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el 33/122 2023-11-06T13:26:14.198 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 34/122 2023-11-06T13:26:14.198 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.e 35/122 2023-11-06T13:26:14.198 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephadm-2:16.2.14-132.g4e03306b.el8.noarch 36/122 2023-11-06T13:26:14.199 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 37/122 2023-11-06T13:26:14.199 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-06T13:26:14.199 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-06T13:26:14.199 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-06T13:26:14.200 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-06T13:26:14.200 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-06T13:26:14.200 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-06T13:26:14.200 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-06T13:26:14.200 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-06T13:26:14.200 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-06T13:26:14.201 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-06T13:26:14.201 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-06T13:26:14.201 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-06T13:26:14.201 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-06T13:26:14.201 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-06T13:26:14.202 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-06T13:26:14.202 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-06T13:26:14.202 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-06T13:26:14.202 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-06T13:26:14.202 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-06T13:26:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-06T13:26:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-06T13:26:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-06T13:26:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-06T13:26:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-06T13:26:14.203 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-06T13:26:14.204 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-06T13:26:14.204 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-06T13:26:14.204 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-06T13:26:14.204 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-06T13:26:14.205 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-06T13:26:14.205 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-06T13:26:14.205 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-06T13:26:14.205 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-06T13:26:14.205 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-06T13:26:14.206 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-11-06T13:26:14.206 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-11-06T13:26:14.206 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-11-06T13:26:14.206 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-11-06T13:26:14.206 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-11-06T13:26:14.207 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-11-06T13:26:14.207 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-11-06T13:26:14.207 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-11-06T13:26:14.207 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-11-06T13:26:14.207 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-11-06T13:26:14.208 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-11-06T13:26:14.208 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-11-06T13:26:14.208 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-11-06T13:26:14.208 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-11-06T13:26:14.208 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-11-06T13:26:14.209 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-11-06T13:26:14.209 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-11-06T13:26:14.209 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-11-06T13:26:14.209 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-11-06T13:26:14.209 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-11-06T13:26:14.210 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-11-06T13:26:14.210 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-11-06T13:26:14.210 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-11-06T13:26:14.210 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-11-06T13:26:14.210 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-11-06T13:26:14.211 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-11-06T13:26:14.211 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-11-06T13:26:14.211 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-11-06T13:26:14.211 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-11-06T13:26:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-11-06T13:26:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-11-06T13:26:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-11-06T13:26:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-11-06T13:26:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-11-06T13:26:14.212 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-11-06T13:26:14.213 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-11-06T13:26:14.213 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-11-06T13:26:14.213 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-11-06T13:26:14.213 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-11-06T13:26:14.213 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-11-06T13:26:14.214 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-11-06T13:26:14.214 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-11-06T13:26:14.214 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-11-06T13:26:14.214 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-11-06T13:26:14.215 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-11-06T13:26:14.215 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-11-06T13:26:14.215 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-11-06T13:26:14.215 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-2:16.2.14-132.g4e03306b.el8.x86_64 119/122 2023-11-06T13:26:14.216 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-06T13:26:14.216 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 121/122 2023-11-06T13:26:14.669 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 107/122 2023-11-06T13:26:14.989 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 108/122 2023-11-06T13:26:15.190 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-11-06T13:26:15.930 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-11-06T13:26:16.276 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-11-06T13:26:16.380 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:16.381 INFO:teuthology.orchestra.run.smithi038.stdout:Last metadata expiration check: 0:01:50 ago on Mon 06 Nov 2023 01:24:26 PM UTC. 2023-11-06T13:26:16.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 111/122 2023-11-06T13:26:16.669 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-11-06T13:26:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_ 113/122 2023-11-06T13:26:16.980 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-11-06T13:26:17.149 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 115/122 2023-11-06T13:26:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 116/122 2023-11-06T13:26:17.517 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 117/122 2023-11-06T13:26:17.755 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-11-06T13:26:17.948 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-11-06T13:26:18.012 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-11-06T13:26:18.207 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-11-06T13:26:18.216 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-11-06T13:26:18.217 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-06T13:26:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-11-06T13:26:18.402 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:18.526 INFO:teuthology.orchestra.run.smithi038.stdout:Installed products updated. 2023-11-06T13:26:18.694 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:18.694 INFO:teuthology.orchestra.run.smithi038.stdout:Upgraded: 2023-11-06T13:26:18.694 INFO:teuthology.orchestra.run.smithi038.stdout: librados2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.695 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.695 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2023-11-06T13:26:18.695 INFO:teuthology.orchestra.run.smithi038.stdout: automake-1.16.1-7.el8.noarch 2023-11-06T13:26:18.695 INFO:teuthology.orchestra.run.smithi038.stdout: bison-3.0.4-10.el8.x86_64 2023-11-06T13:26:18.695 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.696 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-immutable-object-cache-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.697 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.697 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.697 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.697 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.697 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.698 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.698 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.698 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.698 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.698 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.699 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.699 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.699 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.699 INFO:teuthology.orchestra.run.smithi038.stdout: cephadm-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.699 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.700 INFO:teuthology.orchestra.run.smithi038.stdout: cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:18.700 INFO:teuthology.orchestra.run.smithi038.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-06T13:26:18.702 INFO:teuthology.orchestra.run.smithi038.stdout: flex-2.6.1-9.el8.x86_64 2023-11-06T13:26:18.702 INFO:teuthology.orchestra.run.smithi038.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-06T13:26:18.702 INFO:teuthology.orchestra.run.smithi038.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-06T13:26:18.702 INFO:teuthology.orchestra.run.smithi038.stdout: jq-1.5-12.el8.x86_64 2023-11-06T13:26:18.702 INFO:teuthology.orchestra.run.smithi038.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-06T13:26:18.703 INFO:teuthology.orchestra.run.smithi038.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-06T13:26:18.703 INFO:teuthology.orchestra.run.smithi038.stdout: leveldb-1.22-1.el8.x86_64 2023-11-06T13:26:18.703 INFO:teuthology.orchestra.run.smithi038.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-06T13:26:18.703 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.703 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.704 INFO:teuthology.orchestra.run.smithi038.stdout: libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.704 INFO:teuthology.orchestra.run.smithi038.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-06T13:26:18.704 INFO:teuthology.orchestra.run.smithi038.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-06T13:26:18.704 INFO:teuthology.orchestra.run.smithi038.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-06T13:26:18.704 INFO:teuthology.orchestra.run.smithi038.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-06T13:26:18.705 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-06T13:26:18.705 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.705 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.705 INFO:teuthology.orchestra.run.smithi038.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-06T13:26:18.705 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.706 INFO:teuthology.orchestra.run.smithi038.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-06T13:26:18.706 INFO:teuthology.orchestra.run.smithi038.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-06T13:26:18.706 INFO:teuthology.orchestra.run.smithi038.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-06T13:26:18.706 INFO:teuthology.orchestra.run.smithi038.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-06T13:26:18.706 INFO:teuthology.orchestra.run.smithi038.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-06T13:26:18.707 INFO:teuthology.orchestra.run.smithi038.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-06T13:26:18.707 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-06T13:26:18.707 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-06T13:26:18.707 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-06T13:26:18.707 INFO:teuthology.orchestra.run.smithi038.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-06T13:26:18.708 INFO:teuthology.orchestra.run.smithi038.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-06T13:26:18.708 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-06T13:26:18.708 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-06T13:26:18.708 INFO:teuthology.orchestra.run.smithi038.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-06T13:26:18.708 INFO:teuthology.orchestra.run.smithi038.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-06T13:26:18.709 INFO:teuthology.orchestra.run.smithi038.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-06T13:26:18.709 INFO:teuthology.orchestra.run.smithi038.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-06T13:26:18.709 INFO:teuthology.orchestra.run.smithi038.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-06T13:26:18.709 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-06T13:26:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-argparse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-06T13:26:18.710 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-06T13:26:18.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-06T13:26:18.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-06T13:26:18.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-06T13:26:18.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-06T13:26:18.711 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-06T13:26:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-06T13:26:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-06T13:26:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-06T13:26:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-06T13:26:18.712 INFO:teuthology.orchestra.run.smithi038.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-06T13:26:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-06T13:26:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-06T13:26:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-06T13:26:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-06T13:26:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-06T13:26:18.713 INFO:teuthology.orchestra.run.smithi038.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-06T13:26:18.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-06T13:26:18.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-06T13:26:18.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-portend-2.6-1.el8.noarch 2023-11-06T13:26:18.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-06T13:26:18.714 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-06T13:26:18.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-06T13:26:18.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-06T13:26:18.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.715 INFO:teuthology.orchestra.run.smithi038.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-06T13:26:18.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-06T13:26:18.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-06T13:26:18.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-06T13:26:18.716 INFO:teuthology.orchestra.run.smithi038.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-06T13:26:18.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-06T13:26:18.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-06T13:26:18.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-06T13:26:18.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-06T13:26:18.717 INFO:teuthology.orchestra.run.smithi038.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-06T13:26:18.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-06T13:26:18.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-06T13:26:18.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-06T13:26:18.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-06T13:26:18.718 INFO:teuthology.orchestra.run.smithi038.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-06T13:26:18.719 INFO:teuthology.orchestra.run.smithi038.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-06T13:26:18.719 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.719 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.719 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:18.719 INFO:teuthology.orchestra.run.smithi038.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-06T13:26:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-06T13:26:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-06T13:26:18.720 INFO:teuthology.orchestra.run.smithi038.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-06T13:26:18.721 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:18.721 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2023-11-06T13:26:19.035 DEBUG:teuthology.parallel:result is None 2023-11-06T13:26:19.296 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:16.2.14-132.g4e03306b.el8.x86_64 1/122 2023-11-06T13:26:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 2/122 2023-11-06T13:26:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 3/122 2023-11-06T13:26:19.297 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 4/122 2023-11-06T13:26:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-132.g4e033 5/122 2023-11-06T13:26:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 6/122 2023-11-06T13:26:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 7/122 2023-11-06T13:26:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 8/122 2023-11-06T13:26:19.298 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 9/122 2023-11-06T13:26:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 10/122 2023-11-06T13:26:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 11/122 2023-11-06T13:26:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 12/122 2023-11-06T13:26:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 13/122 2023-11-06T13:26:19.299 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_ 14/122 2023-11-06T13:26:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 15/122 2023-11-06T13:26:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 16/122 2023-11-06T13:26:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:16.2.14-132.g4e03306b.el8.x86_6 17/122 2023-11-06T13:26:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86 18/122 2023-11-06T13:26:19.300 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 19/122 2023-11-06T13:26:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:16.2.14-132.g4e03306b.el 20/122 2023-11-06T13:26:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:16.2.14-132.g4e03306b.el8. 21/122 2023-11-06T13:26:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_6 22/122 2023-11-06T13:26:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 23/122 2023-11-06T13:26:19.301 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 24/122 2023-11-06T13:26:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 25/122 2023-11-06T13:26:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 26/122 2023-11-06T13:26:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 27/122 2023-11-06T13:26:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 28/122 2023-11-06T13:26:19.302 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-132.g4e03306b. 29/122 2023-11-06T13:26:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noa 30/122 2023-11-06T13:26:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.n 31/122 2023-11-06T13:26:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-132.g4e0 32/122 2023-11-06T13:26:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el 33/122 2023-11-06T13:26:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 34/122 2023-11-06T13:26:19.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.e 35/122 2023-11-06T13:26:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:16.2.14-132.g4e03306b.el8.noarch 36/122 2023-11-06T13:26:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 37/122 2023-11-06T13:26:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/122 2023-11-06T13:26:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/122 2023-11-06T13:26:19.304 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-11-06T13:26:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-11-06T13:26:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/122 2023-11-06T13:26:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-11-06T13:26:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-11-06T13:26:19.305 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-11-06T13:26:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-11-06T13:26:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-11-06T13:26:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-11-06T13:26:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/122 2023-11-06T13:26:19.306 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/122 2023-11-06T13:26:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/122 2023-11-06T13:26:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/122 2023-11-06T13:26:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/122 2023-11-06T13:26:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/122 2023-11-06T13:26:19.307 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/122 2023-11-06T13:26:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-11-06T13:26:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-11-06T13:26:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/122 2023-11-06T13:26:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/122 2023-11-06T13:26:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/122 2023-11-06T13:26:19.308 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/122 2023-11-06T13:26:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/122 2023-11-06T13:26:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/122 2023-11-06T13:26:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/122 2023-11-06T13:26:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/122 2023-11-06T13:26:19.309 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/122 2023-11-06T13:26:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/122 2023-11-06T13:26:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/122 2023-11-06T13:26:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/122 2023-11-06T13:26:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/122 2023-11-06T13:26:19.310 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-11-06T13:26:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-11-06T13:26:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-11-06T13:26:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-11-06T13:26:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-11-06T13:26:19.311 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-11-06T13:26:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-11-06T13:26:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-11-06T13:26:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-11-06T13:26:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-11-06T13:26:19.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-11-06T13:26:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-11-06T13:26:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-11-06T13:26:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-11-06T13:26:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-11-06T13:26:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-11-06T13:26:19.313 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-11-06T13:26:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-11-06T13:26:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-11-06T13:26:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-11-06T13:26:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-11-06T13:26:19.314 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-11-06T13:26:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-11-06T13:26:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-11-06T13:26:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-11-06T13:26:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-11-06T13:26:19.315 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-11-06T13:26:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-11-06T13:26:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-11-06T13:26:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-11-06T13:26:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-11-06T13:26:19.316 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-11-06T13:26:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-11-06T13:26:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-11-06T13:26:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-11-06T13:26:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-11-06T13:26:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-11-06T13:26:19.317 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-11-06T13:26:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-11-06T13:26:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-11-06T13:26:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-11-06T13:26:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-11-06T13:26:19.318 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-11-06T13:26:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-11-06T13:26:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-11-06T13:26:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-11-06T13:26:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-11-06T13:26:19.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-11-06T13:26:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.14-132.g4e03306b.el8.x86_64 119/122 2023-11-06T13:26:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-11-06T13:26:19.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 121/122 2023-11-06T13:26:21.644 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-11-06T13:26:21.645 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:02:14 ago on Mon 06 Nov 2023 01:24:07 PM UTC. 2023-11-06T13:26:23.855 INFO:teuthology.orchestra.run.smithi044.stdout:Installed products updated. 2023-11-06T13:26:24.000 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:24.001 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2023-11-06T13:26:24.001 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.001 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.001 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2023-11-06T13:26:24.001 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.1-7.el8.noarch 2023-11-06T13:26:24.002 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.0.4-10.el8.x86_64 2023-11-06T13:26:24.002 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.002 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.002 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.003 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.003 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.003 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.003 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.003 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.006 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.006 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.006 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:16.2.14-132.g4e03306b.el8.noarch 2023-11-06T13:26:24.006 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-11-06T13:26:24.007 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.1-9.el8.x86_64 2023-11-06T13:26:24.007 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.7-12.el8.x86_64 2023-11-06T13:26:24.007 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-06T13:26:24.007 INFO:teuthology.orchestra.run.smithi044.stdout: jq-1.5-12.el8.x86_64 2023-11-06T13:26:24.007 INFO:teuthology.orchestra.run.smithi044.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-11-06T13:26:24.008 INFO:teuthology.orchestra.run.smithi044.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-11-06T13:26:24.008 INFO:teuthology.orchestra.run.smithi044.stdout: leveldb-1.22-1.el8.x86_64 2023-11-06T13:26:24.008 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-06T13:26:24.008 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.008 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.009 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.009 INFO:teuthology.orchestra.run.smithi044.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-11-06T13:26:24.009 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-11-06T13:26:24.009 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-06T13:26:24.009 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-11-06T13:26:24.009 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-06T13:26:24.010 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.010 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.010 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-11-06T13:26:24.010 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.010 INFO:teuthology.orchestra.run.smithi044.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-06T13:26:24.011 INFO:teuthology.orchestra.run.smithi044.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-11-06T13:26:24.011 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-06T13:26:24.011 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-06T13:26:24.011 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-11-06T13:26:24.011 INFO:teuthology.orchestra.run.smithi044.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-06T13:26:24.012 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-06T13:26:24.012 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-06T13:26:24.012 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.12-1.el8.x86_64 2023-11-06T13:26:24.012 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-11-06T13:26:24.012 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-11-06T13:26:24.013 INFO:teuthology.orchestra.run.smithi044.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-06T13:26:24.013 INFO:teuthology.orchestra.run.smithi044.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-06T13:26:24.013 INFO:teuthology.orchestra.run.smithi044.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-06T13:26:24.013 INFO:teuthology.orchestra.run.smithi044.stdout: python3-apipkg-1.5-6.el8.noarch 2023-11-06T13:26:24.013 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.5.1-5.el8.noarch 2023-11-06T13:26:24.014 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-06T13:26:24.014 INFO:teuthology.orchestra.run.smithi044.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-06T13:26:24.015 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-06T13:26:24.015 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.015 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.015 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.016 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-06T13:26:24.016 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-06T13:26:24.016 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-06T13:26:24.016 INFO:teuthology.orchestra.run.smithi044.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-11-06T13:26:24.016 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-06T13:26:24.017 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-06T13:26:24.017 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-06T13:26:24.017 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-11-06T13:26:24.017 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-06T13:26:24.017 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-06T13:26:24.018 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-06T13:26:24.018 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-06T13:26:24.018 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-06T13:26:24.018 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-06T13:26:24.019 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-06T13:26:24.019 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-06T13:26:24.019 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-11-06T13:26:24.019 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-11-06T13:26:24.020 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-06T13:26:24.020 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-06T13:26:24.020 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-2.6-1.el8.noarch 2023-11-06T13:26:24.020 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-06T13:26:24.021 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-06T13:26:24.021 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-06T13:26:24.021 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-06T13:26:24.021 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.021 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.021 INFO:teuthology.orchestra.run.smithi044.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-11-06T13:26:24.022 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-06T13:26:24.022 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-06T13:26:24.022 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.022 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-06T13:26:24.023 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-06T13:26:24.023 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-11-06T13:26:24.023 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-06T13:26:24.023 INFO:teuthology.orchestra.run.smithi044.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-06T13:26:24.023 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-06T13:26:24.024 INFO:teuthology.orchestra.run.smithi044.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-06T13:26:24.024 INFO:teuthology.orchestra.run.smithi044.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-06T13:26:24.024 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-06T13:26:24.024 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-06T13:26:24.024 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-06T13:26:24.025 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-06T13:26:24.025 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-06T13:26:24.025 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.025 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.025 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:16.2.14-132.g4e03306b.el8.x86_64 2023-11-06T13:26:24.025 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.3.3-2.el8.x86_64 2023-11-06T13:26:24.026 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-11-06T13:26:24.026 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-06T13:26:24.027 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-11-06T13:26:24.027 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:24.027 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2023-11-06T13:26:24.267 DEBUG:teuthology.parallel:result is None 2023-11-06T13:26:24.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:26:24.405 DEBUG:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-06T13:26:24.430 INFO:teuthology.orchestra.run.smithi038.stdout:16.2.14-132.g4e03306b.el8 2023-11-06T13:26:24.431 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-132.g4e03306b.el8 2023-11-06T13:26:24.431 INFO:teuthology.task.install:The correct ceph version 16.2.14-132.g4e03306b is installed. 2023-11-06T13:26:24.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:26:24.567 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-06T13:26:24.589 INFO:teuthology.orchestra.run.smithi044.stdout:16.2.14-132.g4e03306b.el8 2023-11-06T13:26:24.589 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-132.g4e03306b.el8 2023-11-06T13:26:24.590 INFO:teuthology.task.install:The correct ceph version 16.2.14-132.g4e03306b is installed. 2023-11-06T13:26:24.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:26:24.729 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-06T13:26:24.755 INFO:teuthology.orchestra.run.smithi163.stdout:16.2.14-132.g4e03306b.el8 2023-11-06T13:26:24.756 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-132.g4e03306b.el8 2023-11-06T13:26:24.756 INFO:teuthology.task.install:The correct ceph version 16.2.14-132.g4e03306b is installed. 2023-11-06T13:26:24.756 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-06T13:26:24.757 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:24.757 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-06T13:26:24.801 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:24.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-06T13:26:24.845 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:24.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-06T13:26:24.890 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-06T13:26:24.890 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:24.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/daemon-helper 2023-11-06T13:26:24.917 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-06T13:26:24.984 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:24.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2023-11-06T13:26:25.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-06T13:26:25.074 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:25.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2023-11-06T13:26:25.103 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-06T13:26:25.169 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-06T13:26:25.170 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:25.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-06T13:26:25.197 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-06T13:26:25.263 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:25.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-06T13:26:25.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-06T13:26:25.354 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:25.354 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-06T13:26:25.382 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-06T13:26:25.448 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-06T13:26:25.449 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:25.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/usr/bin/stdin-killer 2023-11-06T13:26:25.476 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-06T13:26:25.542 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:25.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2023-11-06T13:26:25.568 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-06T13:26:25.634 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:25.635 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2023-11-06T13:26:25.662 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-06T13:26:25.728 INFO:teuthology.run_tasks:Running task ceph... 2023-11-06T13:26:25.794 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-06T13:26:25.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2023-11-06T13:26:25.800 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2023-11-06T13:26:25.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2023-11-06T13:26:25.827 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-06T13:26:25.827 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-06T13:26:25.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-06T13:26:25.870 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-06T13:26:25.894 INFO:tasks.ceph:Creating extra log directories... 2023-11-06T13:26:25.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-06T13:26:25.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-06T13:26:25.936 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-06T13:26:25.973 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-06T13:26:25.973 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-06T13:26:25.973 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-06T13:26:25.974 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:25.974 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-06T13:26:26.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:26.125 DEBUG:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:26.150 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:26.151 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-06T13:26:26.165 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:26.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:26.307 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:26.308 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-06T13:26:26.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:26.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:26.463 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-06T13:26:26.464 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-06T13:26:26.464 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449256', 'branch': 'wip-vshankar-testing1-2023-11-02-1726-pacific', 'description': 'fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay subvolume/{with-quota} tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7449256', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-11-02-1726-pacific'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'mount_subvol_num': 0}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported', 'mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d'}}, 'kclient': {'client.0': {'mount_subvol_num': 1}, 'mntopts': ['ms_mode=secure', 'nowsync']}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-11-02-1726-pacific', 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'seed': 6875, 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d', 'sleep_before_teardown': 0, 'subset': '378/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-11-02-1726-pacific', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4e03306bd00b0abb2be37dbc132f82d281f8973d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d', 'targets': {'smithi038.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFdhziK/MsV5hX/ovMyvpSdJOVgUMi1WviQ8P5QxWKxdSz1tZC4PYK3pkUzq6tbim0lKAT/yJ4rXMzIQx6dtTw0=', 'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICqH6xTedLk/Xlsz8Hp9CPLX9Z0aLNdYaQkM0Tl/5z8QJwzX7+L6IS0T6hWoCEXGGmpkCZOvPLKHmhL937d2IA=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMwsShdu7BucVMqYkuoB70ScIFqIAtaYU/YlbtaDtirFZc+vZtcI8jz/QkgI/Le/+X6qx7EjeI54PKNRVFG/NIg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '4e03306bd00b0abb2be37dbc132f82d281f8973d'}}, {'ceph': None}, {'kclient': None}, {'fwd_scrub': {'scrub_timeout': 900, 'sleep_between_iterations': 1}}, {'check-counter': {}}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-06_07:50:57', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-06T13:26:26.465 DEBUG:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-06T13:26:26.468 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-06T13:26:26.470 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-06T13:26:26.510 DEBUG:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2023-11-06T13:26:26.524 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2023-11-06T13:26:26.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2023-11-06T13:26:26.573 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:26.574 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/scratch_devs of=/dev/stdout 2023-11-06T13:26:26.603 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-06T13:26:26.604 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 2023-11-06T13:26:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-06T13:26:26.660 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:26.660 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 216843 Links: 1 2023-11-06T13:26:26.660 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:26.661 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:26.661 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-11-06 13:26:13.736157170 +0000 2023-11-06T13:26:26.661 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-11-06 13:23:11.430643942 +0000 2023-11-06T13:26:26.661 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-11-06 13:23:11.430643942 +0000 2023-11-06T13:26:26.661 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-11-06T13:26:26.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-06T13:26:26.724 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-11-06T13:26:26.724 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-11-06T13:26:26.724 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000319199 s, 1.6 MB/s 2023-11-06T13:26:26.725 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-06T13:26:26.782 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 2023-11-06T13:26:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-06T13:26:26.838 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:26.839 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 220404 Links: 1 2023-11-06T13:26:26.839 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:26.839 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:26.839 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-11-06 13:26:13.736157170 +0000 2023-11-06T13:26:26.840 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-11-06 13:23:11.993632707 +0000 2023-11-06T13:26:26.840 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-11-06 13:23:11.993632707 +0000 2023-11-06T13:26:26.840 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-11-06T13:26:26.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-06T13:26:26.902 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-11-06T13:26:26.902 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-11-06T13:26:26.903 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000304657 s, 1.7 MB/s 2023-11-06T13:26:26.904 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-06T13:26:26.959 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 2023-11-06T13:26:27.015 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-06T13:26:27.015 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:27.016 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 220478 Links: 1 2023-11-06T13:26:27.016 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:27.016 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:27.016 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-11-06 13:26:13.736157170 +0000 2023-11-06T13:26:27.016 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-11-06 13:23:12.506622471 +0000 2023-11-06T13:26:27.017 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-11-06 13:23:12.506622471 +0000 2023-11-06T13:26:27.017 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-11-06T13:26:27.017 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-06T13:26:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-11-06T13:26:27.079 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-11-06T13:26:27.079 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000302275 s, 1.7 MB/s 2023-11-06T13:26:27.080 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-06T13:26:27.137 DEBUG:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 2023-11-06T13:26:27.192 INFO:teuthology.orchestra.run.smithi038.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-06T13:26:27.192 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:27.192 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 6h/6d Inode: 219064 Links: 1 2023-11-06T13:26:27.193 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:27.193 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:27.193 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2023-11-06 13:26:13.737157150 +0000 2023-11-06T13:26:27.193 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-11-06 13:23:13.017612273 +0000 2023-11-06T13:26:27.194 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-11-06 13:23:13.017612273 +0000 2023-11-06T13:26:27.194 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-11-06T13:26:27.194 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-06T13:26:27.255 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2023-11-06T13:26:27.256 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2023-11-06T13:26:27.256 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes copied, 0.000350043 s, 1.5 MB/s 2023-11-06T13:26:27.257 DEBUG:teuthology.orchestra.run.smithi038:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-06T13:26:27.313 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:27.314 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:27.314 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2023-11-06T13:26:27.329 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-06T13:26:27.329 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2023-11-06T13:26:27.385 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-06T13:26:27.385 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:27.386 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 222106 Links: 1 2023-11-06T13:26:27.386 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:27.386 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:27.386 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-06 13:26:18.882652439 +0000 2023-11-06T13:26:27.386 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-06 13:23:16.921184253 +0000 2023-11-06T13:26:27.387 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-06 13:23:16.921184253 +0000 2023-11-06T13:26:27.387 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2023-11-06T13:26:27.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-06T13:26:27.448 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-06T13:26:27.449 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-06T13:26:27.449 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000228021 s, 2.2 MB/s 2023-11-06T13:26:27.450 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-06T13:26:27.506 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2023-11-06T13:26:27.561 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-06T13:26:27.562 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 220871 Links: 1 2023-11-06T13:26:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:27.562 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-06 13:26:18.883652423 +0000 2023-11-06T13:26:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-06 13:23:17.419176125 +0000 2023-11-06T13:26:27.563 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-06 13:23:17.419176125 +0000 2023-11-06T13:26:27.563 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2023-11-06T13:26:27.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-06T13:26:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-06T13:26:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-06T13:26:27.625 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000207391 s, 2.5 MB/s 2023-11-06T13:26:27.626 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-06T13:26:27.682 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2023-11-06T13:26:27.737 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-06T13:26:27.738 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:27.738 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 220955 Links: 1 2023-11-06T13:26:27.738 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:27.738 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:27.739 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-06 13:26:18.883652423 +0000 2023-11-06T13:26:27.739 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-06 13:23:17.939167639 +0000 2023-11-06T13:26:27.739 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-06 13:23:17.939167639 +0000 2023-11-06T13:26:27.739 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2023-11-06T13:26:27.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-06T13:26:27.802 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-06T13:26:27.802 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-06T13:26:27.802 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000229705 s, 2.2 MB/s 2023-11-06T13:26:27.803 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-06T13:26:27.859 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2023-11-06T13:26:27.914 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-06T13:26:27.915 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:27.915 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 222854 Links: 1 2023-11-06T13:26:27.915 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:27.915 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:27.916 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2023-11-06 13:26:18.883652423 +0000 2023-11-06T13:26:27.916 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2023-11-06 13:23:18.438159494 +0000 2023-11-06T13:26:27.916 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2023-11-06 13:23:18.438159494 +0000 2023-11-06T13:26:27.916 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: - 2023-11-06T13:26:27.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-06T13:26:27.977 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2023-11-06T13:26:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2023-11-06T13:26:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000185735 s, 2.8 MB/s 2023-11-06T13:26:27.979 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-06T13:26:28.035 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:28.035 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:28.036 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2023-11-06T13:26:28.053 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-06T13:26:28.053 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2023-11-06T13:26:28.110 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-06T13:26:28.110 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:28.110 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 223633 Links: 1 2023-11-06T13:26:28.111 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:28.111 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:28.111 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-11-06 13:25:57.187993547 +0000 2023-11-06T13:26:28.111 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-11-06 13:23:01.754909152 +0000 2023-11-06T13:26:28.112 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-11-06 13:23:01.754909152 +0000 2023-11-06T13:26:28.112 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-11-06T13:26:28.112 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-06T13:26:28.176 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-11-06T13:26:28.176 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-11-06T13:26:28.176 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00026839 s, 1.9 MB/s 2023-11-06T13:26:28.177 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-06T13:26:28.234 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2023-11-06T13:26:28.290 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-06T13:26:28.290 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:28.291 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 222189 Links: 1 2023-11-06T13:26:28.291 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:28.291 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:28.291 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-11-06 13:25:57.187993547 +0000 2023-11-06T13:26:28.291 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-11-06 13:23:02.288896618 +0000 2023-11-06T13:26:28.292 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-11-06 13:23:02.288896618 +0000 2023-11-06T13:26:28.292 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-11-06T13:26:28.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-06T13:26:28.355 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-11-06T13:26:28.355 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-11-06T13:26:28.355 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000242422 s, 2.1 MB/s 2023-11-06T13:26:28.356 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-06T13:26:28.412 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2023-11-06T13:26:28.468 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-06T13:26:28.469 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:28.469 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 225283 Links: 1 2023-11-06T13:26:28.469 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:28.469 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:28.470 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-11-06 13:25:57.187993547 +0000 2023-11-06T13:26:28.470 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-11-06 13:23:02.784884977 +0000 2023-11-06T13:26:28.470 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-11-06 13:23:02.784884977 +0000 2023-11-06T13:26:28.470 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-11-06T13:26:28.471 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-06T13:26:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-11-06T13:26:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-11-06T13:26:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000301573 s, 1.7 MB/s 2023-11-06T13:26:28.534 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-06T13:26:28.590 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2023-11-06T13:26:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-06T13:26:28.645 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-06T13:26:28.645 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 219070 Links: 1 2023-11-06T13:26:28.645 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:26:28.646 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-11-06T13:26:28.646 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-11-06 13:25:57.187993547 +0000 2023-11-06T13:26:28.646 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-11-06 13:23:03.277873406 +0000 2023-11-06T13:26:28.646 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-11-06 13:23:03.277873406 +0000 2023-11-06T13:26:28.647 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-11-06T13:26:28.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-06T13:26:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-11-06T13:26:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-11-06T13:26:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000194618 s, 2.6 MB/s 2023-11-06T13:26:28.709 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-06T13:26:28.764 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:28.765 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2023-11-06T13:26:28.765 INFO:tasks.ceph:Generating config... 2023-11-06T13:26:28.766 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-06T13:26:28.767 INFO:tasks.ceph:[client] debug client = 20 2023-11-06T13:26:28.767 INFO:tasks.ceph:[client] debug ms = 1 2023-11-06T13:26:28.767 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-06T13:26:28.768 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-06T13:26:28.768 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-06T13:26:28.768 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-06T13:26:28.769 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-06T13:26:28.770 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-11-06T13:26:28.771 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-11-06T13:26:28.771 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-11-06T13:26:28.771 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-11-06T13:26:28.771 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-06T13:26:28.772 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-06T13:26:28.772 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-06T13:26:28.772 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-06T13:26:28.772 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-06T13:26:28.773 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-06T13:26:28.773 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-06T13:26:28.773 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-06T13:26:28.774 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-06T13:26:28.774 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-06T13:26:28.774 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-06T13:26:28.774 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-06T13:26:28.775 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-06T13:26:28.775 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-06T13:26:28.776 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-06T13:26:28.776 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-06T13:26:28.776 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-06T13:26:28.776 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-06T13:26:28.777 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-06T13:26:28.777 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-06T13:26:28.777 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-06T13:26:28.777 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-06T13:26:28.778 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-06T13:26:28.778 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-06T13:26:28.778 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-06T13:26:28.779 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-06T13:26:28.779 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-06T13:26:28.779 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2023-11-06T13:26:28.779 INFO:tasks.ceph:Setting up mon.a... 2023-11-06T13:26:28.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-06T13:26:28.846 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2023-11-06T13:26:28.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-06T13:26:28.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-06T13:26:28.957 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.b', '172.21.15.44'), ('mon.c', '172.21.15.163')] 2023-11-06T13:26:28.958 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.38,172.21.15.44,172.21.15.163', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.d': {}, 'mds.g': {}, 'mds.j': {}, 'mds.b': {}, 'mds.e': {}, 'mds.h': {}, 'mds.k': {}, 'mds.c': {}, 'mds.f': {}, 'mds.i': {}, 'mds.l': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-06T13:26:28.959 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:28.959 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-06T13:26:29.013 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.38 --add b 172.21.15.44 --add c 172.21.15.163 --print /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:29.095 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:29.096 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid 678c2a34-c65e-414a-9c54-b10698be691f 2023-11-06T13:26:29.096 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2023-11-06T13:26:29.096 INFO:teuthology.orchestra.run.smithi038.stdout:fsid 678c2a34-c65e-414a-9c54-b10698be691f 2023-11-06T13:26:29.097 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2023-11-06T13:26:29.093873+0000 2023-11-06T13:26:29.097 INFO:teuthology.orchestra.run.smithi038.stdout:created 2023-11-06T13:26:29.093873+0000 2023-11-06T13:26:29.097 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 0 (unknown) 2023-11-06T13:26:29.097 INFO:teuthology.orchestra.run.smithi038.stdout:election_strategy: 1 2023-11-06T13:26:29.097 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2023-11-06T13:26:29.098 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.b 2023-11-06T13:26:29.098 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.c 2023-11-06T13:26:29.098 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-06T13:26:29.099 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-06T13:26:29.154 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 678c2a34-c65e-414a-9c54-b10698be691f... 2023-11-06T13:26:29.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-06T13:26:29.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-06T13:26:29.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-06T13:26:29.238 INFO:teuthology.orchestra.run.smithi038.stdout:[global] 2023-11-06T13:26:29.238 INFO:teuthology.orchestra.run.smithi038.stdout: chdir = "" 2023-11-06T13:26:29.238 INFO:teuthology.orchestra.run.smithi038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-06T13:26:29.239 INFO:teuthology.orchestra.run.smithi038.stdout: auth supported = cephx 2023-11-06T13:26:29.239 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.239 INFO:teuthology.orchestra.run.smithi038.stdout: filestore xattr use omap = true 2023-11-06T13:26:29.239 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.239 INFO:teuthology.orchestra.run.smithi038.stdout: mon clock drift allowed = 1.000 2023-11-06T13:26:29.240 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.240 INFO:teuthology.orchestra.run.smithi038.stdout: osd crush chooseleaf type = 0 2023-11-06T13:26:29.240 INFO:teuthology.orchestra.run.smithi038.stdout: auth debug = true 2023-11-06T13:26:29.240 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.241 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on old message = true 2023-11-06T13:26:29.241 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on bug = true 2023-11-06T13:26:29.241 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.241 INFO:teuthology.orchestra.run.smithi038.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-06T13:26:29.241 INFO:teuthology.orchestra.run.smithi038.stdout: mon pg warn max object skew = 0 2023-11-06T13:26:29.242 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.242 INFO:teuthology.orchestra.run.smithi038.stdout: # disable pg_autoscaler by default for new pools 2023-11-06T13:26:29.242 INFO:teuthology.orchestra.run.smithi038.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-06T13:26:29.242 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.242 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default size = 2 2023-11-06T13:26:29.243 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.243 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow primary affinity = true 2023-11-06T13:26:29.243 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd allow pg remap = true 2023-11-06T13:26:29.243 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on legacy crush tunables = false 2023-11-06T13:26:29.243 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on crush straw calc version zero = false 2023-11-06T13:26:29.244 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on no sortbitwise = false 2023-11-06T13:26:29.244 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on osd down out interval zero = false 2023-11-06T13:26:29.244 INFO:teuthology.orchestra.run.smithi038.stdout: mon warn on too few osds = false 2023-11-06T13:26:29.244 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-06T13:26:29.244 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-06T13:26:29.245 INFO:teuthology.orchestra.run.smithi038.stdout: mon_allow_pool_size_one = true 2023-11-06T13:26:29.245 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.245 INFO:teuthology.orchestra.run.smithi038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-06T13:26:29.245 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.245 INFO:teuthology.orchestra.run.smithi038.stdout: osd default data pool replay window = 5 2023-11-06T13:26:29.246 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.246 INFO:teuthology.orchestra.run.smithi038.stdout: mon allow pool delete = true 2023-11-06T13:26:29.246 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.246 INFO:teuthology.orchestra.run.smithi038.stdout: mon cluster log file level = debug 2023-11-06T13:26:29.246 INFO:teuthology.orchestra.run.smithi038.stdout: debug asserts on shutdown = true 2023-11-06T13:26:29.247 INFO:teuthology.orchestra.run.smithi038.stdout: mon health detail to clog = false 2023-11-06T13:26:29.247 INFO:teuthology.orchestra.run.smithi038.stdout: mon host = "172.21.15.38,172.21.15.44,172.21.15.163" 2023-11-06T13:26:29.247 INFO:teuthology.orchestra.run.smithi038.stdout: ms die on skipped message = False 2023-11-06T13:26:29.247 INFO:teuthology.orchestra.run.smithi038.stdout: fsid = 678c2a34-c65e-414a-9c54-b10698be691f 2023-11-06T13:26:29.247 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.248 INFO:teuthology.orchestra.run.smithi038.stdout:[osd] 2023-11-06T13:26:29.248 INFO:teuthology.orchestra.run.smithi038.stdout: osd journal size = 100 2023-11-06T13:26:29.248 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.248 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub load threshold = 5.0 2023-11-06T13:26:29.248 INFO:teuthology.orchestra.run.smithi038.stdout: osd scrub max interval = 600 2023-11-06T13:26:29.249 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.249 INFO:teuthology.orchestra.run.smithi038.stdout: osd recover clone overlap = true 2023-11-06T13:26:29.249 INFO:teuthology.orchestra.run.smithi038.stdout: osd recovery max chunk = 1048576 2023-11-06T13:26:29.250 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.250 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug shutdown = true 2023-11-06T13:26:29.250 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug op order = true 2023-11-06T13:26:29.250 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug verify stray on activate = true 2023-11-06T13:26:29.251 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.251 INFO:teuthology.orchestra.run.smithi038.stdout: osd open classes on start = true 2023-11-06T13:26:29.251 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug pg log writeout = true 2023-11-06T13:26:29.251 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.251 INFO:teuthology.orchestra.run.smithi038.stdout: osd deep scrub update digest min age = 30 2023-11-06T13:26:29.252 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.252 INFO:teuthology.orchestra.run.smithi038.stdout: osd map max advance = 10 2023-11-06T13:26:29.252 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.252 INFO:teuthology.orchestra.run.smithi038.stdout: journal zero on create = true 2023-11-06T13:26:29.252 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.253 INFO:teuthology.orchestra.run.smithi038.stdout: filestore ondisk finisher threads = 3 2023-11-06T13:26:29.253 INFO:teuthology.orchestra.run.smithi038.stdout: filestore apply finisher threads = 3 2023-11-06T13:26:29.253 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.253 INFO:teuthology.orchestra.run.smithi038.stdout: bdev debug aio = true 2023-11-06T13:26:29.253 INFO:teuthology.orchestra.run.smithi038.stdout: osd debug misdirected ops = true 2023-11-06T13:26:29.254 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore block size = 96636764160 2023-11-06T13:26:29.254 INFO:teuthology.orchestra.run.smithi038.stdout: bluestore fsck on mount = True 2023-11-06T13:26:29.254 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluefs = 20 2023-11-06T13:26:29.254 INFO:teuthology.orchestra.run.smithi038.stdout: debug bluestore = 20 2023-11-06T13:26:29.255 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-11-06T13:26:29.255 INFO:teuthology.orchestra.run.smithi038.stdout: debug osd = 20 2023-11-06T13:26:29.255 INFO:teuthology.orchestra.run.smithi038.stdout: debug rocksdb = 10 2023-11-06T13:26:29.255 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd backfillfull_ratio = 0.85 2023-11-06T13:26:29.255 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd full ratio = 0.9 2023-11-06T13:26:29.256 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd nearfull ratio = 0.8 2023-11-06T13:26:29.256 INFO:teuthology.orchestra.run.smithi038.stdout: osd failsafe full ratio = 0.95 2023-11-06T13:26:29.256 INFO:teuthology.orchestra.run.smithi038.stdout: osd objectstore = bluestore 2023-11-06T13:26:29.256 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-11-06T13:26:29.256 INFO:teuthology.orchestra.run.smithi038.stdout: osd shutdown pgref assert = True 2023-11-06T13:26:29.257 INFO:teuthology.orchestra.run.smithi038.stdout: osd_max_omap_entries_per_request = 10000 2023-11-06T13:26:29.257 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.257 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr] 2023-11-06T13:26:29.257 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-11-06T13:26:29.258 INFO:teuthology.orchestra.run.smithi038.stdout: debug mgr = 20 2023-11-06T13:26:29.258 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-11-06T13:26:29.258 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-11-06T13:26:29.258 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-11-06T13:26:29.258 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-11-06T13:26:29.259 INFO:teuthology.orchestra.run.smithi038.stdout: mgr/telemetry/nag = false 2023-11-06T13:26:29.259 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.259 INFO:teuthology.orchestra.run.smithi038.stdout:[mon] 2023-11-06T13:26:29.259 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-11-06T13:26:29.259 INFO:teuthology.orchestra.run.smithi038.stdout: debug mon = 20 2023-11-06T13:26:29.260 INFO:teuthology.orchestra.run.smithi038.stdout: debug paxos = 20 2023-11-06T13:26:29.260 INFO:teuthology.orchestra.run.smithi038.stdout: debug auth = 20 2023-11-06T13:26:29.260 INFO:teuthology.orchestra.run.smithi038.stdout: mon data avail warn = 5 2023-11-06T13:26:29.260 INFO:teuthology.orchestra.run.smithi038.stdout: mon mgr mkfs grace = 240 2023-11-06T13:26:29.260 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min pgs per osd = 4 2023-11-06T13:26:29.261 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd reporter subtree level = osd 2023-11-06T13:26:29.261 INFO:teuthology.orchestra.run.smithi038.stdout: mon osd prime pg temp = true 2023-11-06T13:26:29.261 INFO:teuthology.orchestra.run.smithi038.stdout: mon reweight min bytes per osd = 10 2023-11-06T13:26:29.261 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.261 INFO:teuthology.orchestra.run.smithi038.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-06T13:26:29.262 INFO:teuthology.orchestra.run.smithi038.stdout: auth mon ticket ttl = 660 # 11m 2023-11-06T13:26:29.262 INFO:teuthology.orchestra.run.smithi038.stdout: auth service ticket ttl = 240 # 4m 2023-11-06T13:26:29.262 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.262 INFO:teuthology.orchestra.run.smithi038.stdout: # don't complain about insecure global_id in the test suite 2023-11-06T13:26:29.263 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-06T13:26:29.263 INFO:teuthology.orchestra.run.smithi038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-06T13:26:29.263 INFO:teuthology.orchestra.run.smithi038.stdout: mon op complaint time = 120 2023-11-06T13:26:29.263 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:26:29.263 INFO:teuthology.orchestra.run.smithi038.stdout:[client] 2023-11-06T13:26:29.264 INFO:teuthology.orchestra.run.smithi038.stdout: rgw cache enabled = true 2023-11-06T13:26:29.264 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable ops log = true 2023-11-06T13:26:29.264 INFO:teuthology.orchestra.run.smithi038.stdout: rgw enable usage log = true 2023-11-06T13:26:29.264 INFO:teuthology.orchestra.run.smithi038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-06T13:26:29.264 INFO:teuthology.orchestra.run.smithi038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-06T13:26:29.265 INFO:teuthology.orchestra.run.smithi038.stdout: client mount timeout = 600 2023-11-06T13:26:29.265 INFO:teuthology.orchestra.run.smithi038.stdout: debug client = 20 2023-11-06T13:26:29.265 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-11-06T13:26:29.265 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-11-06T13:26:29.265 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-11-06T13:26:29.266 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.a] 2023-11-06T13:26:29.266 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.b] 2023-11-06T13:26:29.266 INFO:teuthology.orchestra.run.smithi038.stdout:[mon.c] 2023-11-06T13:26:29.266 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-11-06T13:26:29.266 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.d] 2023-11-06T13:26:29.267 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.g] 2023-11-06T13:26:29.267 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.j] 2023-11-06T13:26:29.267 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-11-06T13:26:29.267 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.e] 2023-11-06T13:26:29.267 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.h] 2023-11-06T13:26:29.268 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.k] 2023-11-06T13:26:29.268 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c] 2023-11-06T13:26:29.268 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.f] 2023-11-06T13:26:29.268 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.i] 2023-11-06T13:26:29.268 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.l] 2023-11-06T13:26:29.269 INFO:teuthology.orchestra.run.smithi038.stdout:[mds] 2023-11-06T13:26:29.269 INFO:teuthology.orchestra.run.smithi038.stdout: debug mds = 20 2023-11-06T13:26:29.269 INFO:teuthology.orchestra.run.smithi038.stdout: debug ms = 1 2023-11-06T13:26:29.269 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal fragment size max = 10000 2023-11-06T13:26:29.269 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal merge size = 5 2023-11-06T13:26:29.269 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal split bits = 3 2023-11-06T13:26:29.270 INFO:teuthology.orchestra.run.smithi038.stdout: mds bal split size = 100 2023-11-06T13:26:29.270 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug frag = True 2023-11-06T13:26:29.270 INFO:teuthology.orchestra.run.smithi038.stdout: mds debug scatterstat = True 2023-11-06T13:26:29.270 INFO:teuthology.orchestra.run.smithi038.stdout: mds op complaint time = 180 2023-11-06T13:26:29.270 INFO:teuthology.orchestra.run.smithi038.stdout: mds verify scatter = True 2023-11-06T13:26:29.271 INFO:teuthology.orchestra.run.smithi038.stdout: osd op complaint time = 180 2023-11-06T13:26:29.271 INFO:teuthology.orchestra.run.smithi038.stdout: rados mon op timeout = 900 2023-11-06T13:26:29.271 INFO:teuthology.orchestra.run.smithi038.stdout: rados osd op timeout = 900 2023-11-06T13:26:29.273 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2023-11-06T13:26:29.273 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2023-11-06T13:26:29.274 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-06T13:26:29.274 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2023-11-06T13:26:29.274 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.274 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2023-11-06T13:26:29.275 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.275 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2023-11-06T13:26:29.275 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.275 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2023-11-06T13:26:29.277 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2023-11-06T13:26:29.277 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.278 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2023-11-06T13:26:29.278 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2023-11-06T13:26:29.278 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.278 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-06T13:26:29.278 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2023-11-06T13:26:29.279 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.279 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2023-11-06T13:26:29.279 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-06T13:26:29.279 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.279 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2023-11-06T13:26:29.280 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.280 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2023-11-06T13:26:29.280 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2023-11-06T13:26:29.280 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2023-11-06T13:26:29.280 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2023-11-06T13:26:29.281 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2023-11-06T13:26:29.281 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2023-11-06T13:26:29.281 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2023-11-06T13:26:29.281 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-06T13:26:29.281 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-06T13:26:29.282 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2023-11-06T13:26:29.282 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.282 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-06T13:26:29.282 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.282 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2023-11-06T13:26:29.283 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.283 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2023-11-06T13:26:29.283 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.283 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2023-11-06T13:26:29.283 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2023-11-06T13:26:29.284 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2023-11-06T13:26:29.284 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = "172.21.15.38,172.21.15.44,172.21.15.163" 2023-11-06T13:26:29.284 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on skipped message = False 2023-11-06T13:26:29.284 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 678c2a34-c65e-414a-9c54-b10698be691f 2023-11-06T13:26:29.284 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.285 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2023-11-06T13:26:29.285 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2023-11-06T13:26:29.285 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.285 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2023-11-06T13:26:29.286 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2023-11-06T13:26:29.286 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.286 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2023-11-06T13:26:29.286 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2023-11-06T13:26:29.286 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.287 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2023-11-06T13:26:29.287 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2023-11-06T13:26:29.287 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2023-11-06T13:26:29.287 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.287 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2023-11-06T13:26:29.288 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2023-11-06T13:26:29.288 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.288 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2023-11-06T13:26:29.288 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.288 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2023-11-06T13:26:29.289 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.289 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2023-11-06T13:26:29.289 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.289 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2023-11-06T13:26:29.289 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2023-11-06T13:26:29.290 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.290 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2023-11-06T13:26:29.290 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2023-11-06T13:26:29.290 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2023-11-06T13:26:29.290 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2023-11-06T13:26:29.291 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 20 2023-11-06T13:26:29.291 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 20 2023-11-06T13:26:29.291 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-11-06T13:26:29.291 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2023-11-06T13:26:29.291 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 10 2023-11-06T13:26:29.292 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2023-11-06T13:26:29.292 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2023-11-06T13:26:29.292 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2023-11-06T13:26:29.292 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2023-11-06T13:26:29.292 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2023-11-06T13:26:29.293 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2023-11-06T13:26:29.293 INFO:teuthology.orchestra.run.smithi163.stdout: osd shutdown pgref assert = True 2023-11-06T13:26:29.293 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 10000 2023-11-06T13:26:29.293 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.293 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2023-11-06T13:26:29.294 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-11-06T13:26:29.294 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2023-11-06T13:26:29.294 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-11-06T13:26:29.294 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-11-06T13:26:29.294 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-11-06T13:26:29.295 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-11-06T13:26:29.295 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2023-11-06T13:26:29.295 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.295 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2023-11-06T13:26:29.295 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-11-06T13:26:29.296 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-11-06T13:26:29.296 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2023-11-06T13:26:29.296 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-11-06T13:26:29.296 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2023-11-06T13:26:29.296 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2023-11-06T13:26:29.297 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-11-06T13:26:29.297 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2023-11-06T13:26:29.297 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2023-11-06T13:26:29.297 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-11-06T13:26:29.297 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.298 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-06T13:26:29.298 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2023-11-06T13:26:29.298 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2023-11-06T13:26:29.298 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.298 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2023-11-06T13:26:29.299 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-06T13:26:29.299 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-06T13:26:29.299 INFO:teuthology.orchestra.run.smithi163.stdout: mon op complaint time = 120 2023-11-06T13:26:29.299 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-11-06T13:26:29.300 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2023-11-06T13:26:29.300 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2023-11-06T13:26:29.300 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2023-11-06T13:26:29.300 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2023-11-06T13:26:29.300 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-06T13:26:29.300 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-06T13:26:29.301 INFO:teuthology.orchestra.run.smithi163.stdout: client mount timeout = 600 2023-11-06T13:26:29.301 INFO:teuthology.orchestra.run.smithi163.stdout: debug client = 20 2023-11-06T13:26:29.301 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-11-06T13:26:29.301 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2023-11-06T13:26:29.301 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2023-11-06T13:26:29.302 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2023-11-06T13:26:29.302 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.b] 2023-11-06T13:26:29.302 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.c] 2023-11-06T13:26:29.302 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2023-11-06T13:26:29.302 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2023-11-06T13:26:29.303 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.g] 2023-11-06T13:26:29.303 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.j] 2023-11-06T13:26:29.303 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2023-11-06T13:26:29.303 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e] 2023-11-06T13:26:29.303 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.h] 2023-11-06T13:26:29.304 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.k] 2023-11-06T13:26:29.304 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2023-11-06T13:26:29.304 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f] 2023-11-06T13:26:29.304 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.i] 2023-11-06T13:26:29.304 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.l] 2023-11-06T13:26:29.305 INFO:teuthology.orchestra.run.smithi163.stdout:[mds] 2023-11-06T13:26:29.305 INFO:teuthology.orchestra.run.smithi163.stdout: debug mds = 20 2023-11-06T13:26:29.305 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-11-06T13:26:29.305 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal fragment size max = 10000 2023-11-06T13:26:29.305 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal merge size = 5 2023-11-06T13:26:29.306 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal split bits = 3 2023-11-06T13:26:29.306 INFO:teuthology.orchestra.run.smithi163.stdout: mds bal split size = 100 2023-11-06T13:26:29.306 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug frag = True 2023-11-06T13:26:29.306 INFO:teuthology.orchestra.run.smithi163.stdout: mds debug scatterstat = True 2023-11-06T13:26:29.306 INFO:teuthology.orchestra.run.smithi163.stdout: mds op complaint time = 180 2023-11-06T13:26:29.307 INFO:teuthology.orchestra.run.smithi163.stdout: mds verify scatter = True 2023-11-06T13:26:29.307 INFO:teuthology.orchestra.run.smithi163.stdout: osd op complaint time = 180 2023-11-06T13:26:29.307 INFO:teuthology.orchestra.run.smithi163.stdout: rados mon op timeout = 900 2023-11-06T13:26:29.307 INFO:teuthology.orchestra.run.smithi163.stdout: rados osd op timeout = 900 2023-11-06T13:26:29.307 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2023-11-06T13:26:29.308 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2023-11-06T13:26:29.308 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-06T13:26:29.308 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2023-11-06T13:26:29.308 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.308 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2023-11-06T13:26:29.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.309 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2023-11-06T13:26:29.309 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.309 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2023-11-06T13:26:29.309 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2023-11-06T13:26:29.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.310 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2023-11-06T13:26:29.310 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2023-11-06T13:26:29.310 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.310 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-06T13:26:29.311 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2023-11-06T13:26:29.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.311 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2023-11-06T13:26:29.311 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-06T13:26:29.311 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.311 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2023-11-06T13:26:29.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.312 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2023-11-06T13:26:29.312 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2023-11-06T13:26:29.312 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2023-11-06T13:26:29.312 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2023-11-06T13:26:29.313 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2023-11-06T13:26:29.313 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2023-11-06T13:26:29.313 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2023-11-06T13:26:29.313 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-06T13:26:29.313 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-06T13:26:29.314 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2023-11-06T13:26:29.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.314 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-06T13:26:29.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.314 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2023-11-06T13:26:29.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.315 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2023-11-06T13:26:29.315 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.315 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2023-11-06T13:26:29.315 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2023-11-06T13:26:29.316 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2023-11-06T13:26:29.316 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.38,172.21.15.44,172.21.15.163" 2023-11-06T13:26:29.316 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2023-11-06T13:26:29.316 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 678c2a34-c65e-414a-9c54-b10698be691f 2023-11-06T13:26:29.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.317 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2023-11-06T13:26:29.317 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2023-11-06T13:26:29.317 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.317 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2023-11-06T13:26:29.317 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2023-11-06T13:26:29.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.318 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2023-11-06T13:26:29.318 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2023-11-06T13:26:29.318 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.318 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2023-11-06T13:26:29.319 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2023-11-06T13:26:29.319 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2023-11-06T13:26:29.319 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.319 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2023-11-06T13:26:29.319 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2023-11-06T13:26:29.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.320 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2023-11-06T13:26:29.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.320 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2023-11-06T13:26:29.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.321 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2023-11-06T13:26:29.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.321 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2023-11-06T13:26:29.321 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2023-11-06T13:26:29.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.322 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2023-11-06T13:26:29.322 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2023-11-06T13:26:29.322 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2023-11-06T13:26:29.322 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2023-11-06T13:26:29.323 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2023-11-06T13:26:29.323 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2023-11-06T13:26:29.323 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-06T13:26:29.323 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2023-11-06T13:26:29.323 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2023-11-06T13:26:29.324 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2023-11-06T13:26:29.324 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2023-11-06T13:26:29.324 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2023-11-06T13:26:29.324 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2023-11-06T13:26:29.324 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2023-11-06T13:26:29.325 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2023-11-06T13:26:29.325 INFO:teuthology.orchestra.run.smithi044.stdout: osd shutdown pgref assert = True 2023-11-06T13:26:29.325 INFO:teuthology.orchestra.run.smithi044.stdout: osd_max_omap_entries_per_request = 10000 2023-11-06T13:26:29.325 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.325 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2023-11-06T13:26:29.326 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-06T13:26:29.326 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2023-11-06T13:26:29.326 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-11-06T13:26:29.326 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-11-06T13:26:29.326 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-11-06T13:26:29.327 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-11-06T13:26:29.327 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2023-11-06T13:26:29.327 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.327 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2023-11-06T13:26:29.327 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-06T13:26:29.328 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2023-11-06T13:26:29.328 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2023-11-06T13:26:29.328 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2023-11-06T13:26:29.328 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2023-11-06T13:26:29.328 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2023-11-06T13:26:29.329 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2023-11-06T13:26:29.329 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2023-11-06T13:26:29.329 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2023-11-06T13:26:29.329 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2023-11-06T13:26:29.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.329 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-06T13:26:29.330 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2023-11-06T13:26:29.330 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2023-11-06T13:26:29.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.330 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2023-11-06T13:26:29.330 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-06T13:26:29.331 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-06T13:26:29.331 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2023-11-06T13:26:29.331 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-11-06T13:26:29.331 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2023-11-06T13:26:29.331 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2023-11-06T13:26:29.332 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2023-11-06T13:26:29.332 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2023-11-06T13:26:29.332 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-06T13:26:29.332 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-06T13:26:29.332 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2023-11-06T13:26:29.333 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2023-11-06T13:26:29.333 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-06T13:26:29.333 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2023-11-06T13:26:29.333 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2023-11-06T13:26:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2023-11-06T13:26:29.333 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2023-11-06T13:26:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2023-11-06T13:26:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2023-11-06T13:26:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2023-11-06T13:26:29.334 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.g] 2023-11-06T13:26:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.j] 2023-11-06T13:26:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2023-11-06T13:26:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.e] 2023-11-06T13:26:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.h] 2023-11-06T13:26:29.335 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.k] 2023-11-06T13:26:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2023-11-06T13:26:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.f] 2023-11-06T13:26:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.i] 2023-11-06T13:26:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.l] 2023-11-06T13:26:29.336 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2023-11-06T13:26:29.337 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2023-11-06T13:26:29.337 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2023-11-06T13:26:29.337 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal fragment size max = 10000 2023-11-06T13:26:29.337 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal merge size = 5 2023-11-06T13:26:29.337 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal split bits = 3 2023-11-06T13:26:29.338 INFO:teuthology.orchestra.run.smithi044.stdout: mds bal split size = 100 2023-11-06T13:26:29.338 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2023-11-06T13:26:29.338 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2023-11-06T13:26:29.338 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2023-11-06T13:26:29.338 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2023-11-06T13:26:29.339 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2023-11-06T13:26:29.339 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2023-11-06T13:26:29.339 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2023-11-06T13:26:29.339 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-06T13:26:29.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-06T13:26:29.392 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-06T13:26:29.393 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:29.393 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-06T13:26:29.408 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:29.409 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-06T13:26:29.463 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:26:29.464 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:29.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-06T13:26:29.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-06T13:26:29.539 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:26:29.539 DEBUG:teuthology.orchestra.run.smithi038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:29.594 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2023-11-06T13:26:29.594 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:29.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-06T13:26:29.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-06T13:26:29.630 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:26:29.630 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:29.685 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2023-11-06T13:26:29.686 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:29.686 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-06T13:26:29.687 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-06T13:26:29.721 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:26:29.722 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:29.775 INFO:tasks.ceph:Setting up mon nodes... 2023-11-06T13:26:29.776 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-06T13:26:29.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-06T13:26:29.825 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-06T13:26:29.827 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-06T13:26:29.889 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-06T13:26:29.890 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2023-11-06T13:26:29.960 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2023-11-06T13:26:29.963 INFO:tasks.ceph:Setting up mds nodes... 2023-11-06T13:26:29.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-06T13:26:30.012 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-06T13:26:30.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-06T13:26:30.039 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-06T13:26:30.128 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-06T13:26:30.130 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-06T13:26:30.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2023-11-06T13:26:30.244 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2023-11-06T13:26:30.246 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2023-11-06T13:26:30.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mds/ceph-j && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.j /var/lib/ceph/mds/ceph-j/keyring 2023-11-06T13:26:30.359 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mds/ceph-j/keyring 2023-11-06T13:26:30.361 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-j 2023-11-06T13:26:30.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-06T13:26:30.436 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-06T13:26:30.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-06T13:26:30.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-11-06T13:26:30.552 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-11-06T13:26:30.554 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-11-06T13:26:30.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2023-11-06T13:26:30.668 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2023-11-06T13:26:30.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2023-11-06T13:26:30.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-k && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.k /var/lib/ceph/mds/ceph-k/keyring 2023-11-06T13:26:30.785 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-k/keyring 2023-11-06T13:26:30.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-k 2023-11-06T13:26:30.813 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-06T13:26:30.865 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-06T13:26:30.867 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-06T13:26:30.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-11-06T13:26:30.978 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-11-06T13:26:30.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-11-06T13:26:31.004 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2023-11-06T13:26:31.089 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2023-11-06T13:26:31.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2023-11-06T13:26:31.115 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mds/ceph-l && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.l /var/lib/ceph/mds/ceph-l/keyring 2023-11-06T13:26:31.200 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mds/ceph-l/keyring 2023-11-06T13:26:31.203 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-l 2023-11-06T13:26:31.226 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-06T13:26:31.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-06T13:26:31.270 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-06T13:26:31.283 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-06T13:26:31.284 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2023-11-06T13:26:31.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-06T13:26:31.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:31.351 INFO:tasks.ceph:role: osd.0 2023-11-06T13:26:31.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:26:31.351 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-06T13:26:31.446 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:31.446 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:31.446 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:31.446 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2023-11-06T13:26:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:31.447 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:31.447 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:31.447 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:31.448 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:32.727 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-11-06T13:26:32.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-11-06T13:26:32.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-06T13:26:32.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-06T13:26:32.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-06T13:26:32.929 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:32.929 INFO:tasks.ceph:role: osd.3 2023-11-06T13:26:32.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:26:32.930 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-06T13:26:32.984 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:32.984 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:32.985 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:32.985 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2023-11-06T13:26:32.985 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:32.985 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:32.985 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:32.986 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:32.986 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:32.986 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:34.267 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-11-06T13:26:34.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-11-06T13:26:34.270 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-11-06T13:26:34.314 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-06T13:26:34.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-06T13:26:34.413 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:34.414 INFO:tasks.ceph:role: osd.6 2023-11-06T13:26:34.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:26:34.415 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-06T13:26:34.507 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:34.508 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:34.508 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:34.508 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2023-11-06T13:26:34.508 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:34.509 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:34.509 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:34.509 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:34.509 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:34.509 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:35.790 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-11-06T13:26:35.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-11-06T13:26:35.793 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-06T13:26:35.837 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-06T13:26:35.909 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2023-11-06T13:26:35.976 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:35.977 INFO:tasks.ceph:role: osd.9 2023-11-06T13:26:35.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:26:35.977 DEBUG:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-06T13:26:36.070 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:36.071 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:36.071 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:36.071 INFO:teuthology.orchestra.run.smithi038.stdout: = reflink=1 2023-11-06T13:26:36.071 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:36.072 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:36.072 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:36.072 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:36.072 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:36.072 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:37.351 INFO:teuthology.orchestra.run.smithi038.stdout:Discarding blocks...Done. 2023-11-06T13:26:37.353 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2023-11-06T13:26:37.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2023-11-06T13:26:37.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2023-11-06T13:26:37.432 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:37.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:37.518+0000 7f2393985380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-06T13:26:37.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:37.518+0000 7f2393985380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-06T13:26:37.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:37.518+0000 7f2393985380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-06T13:26:37.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:37.519+0000 7f2393985380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-06T13:26:37.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:37.519+0000 7f2393985380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-06T13:26:37.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:37.519+0000 7f2393985380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-06T13:26:40.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-06T13:26:40.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:40.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:40.507+0000 7fa096437380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-06T13:26:40.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:40.507+0000 7fa096437380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-06T13:26:40.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:40.507+0000 7fa096437380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-06T13:26:40.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:40.507+0000 7fa096437380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-06T13:26:40.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:40.507+0000 7fa096437380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-06T13:26:40.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:40.508+0000 7fa096437380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-06T13:26:43.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-06T13:26:43.393 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:43.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:43.475+0000 7fa117efb380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-06T13:26:43.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:43.476+0000 7fa117efb380 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-06T13:26:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:43.476+0000 7fa117efb380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-06T13:26:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:43.476+0000 7fa117efb380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-06T13:26:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:43.476+0000 7fa117efb380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-06T13:26:43.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:43.477+0000 7fa117efb380 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-06T13:26:46.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-06T13:26:46.364 DEBUG:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:46.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:46.448+0000 7f5ba255b380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2023-11-06T13:26:46.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:46.448+0000 7f5ba255b380 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2023-11-06T13:26:46.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:46.448+0000 7f5ba255b380 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2023-11-06T13:26:46.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:46.448+0000 7f5ba255b380 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2023-11-06T13:26:46.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:46.448+0000 7f5ba255b380 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2023-11-06T13:26:46.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:26:46.449+0000 7f5ba255b380 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2023-11-06T13:26:49.319 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2023-11-06T13:26:49.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-06T13:26:49.379 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:49.380 INFO:tasks.ceph:role: osd.1 2023-11-06T13:26:49.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-06T13:26:49.380 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-06T13:26:49.455 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:49.456 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:49.457 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:49.457 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2023-11-06T13:26:49.457 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:49.458 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:49.458 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:49.458 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:49.458 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:49.459 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:49.818 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-06T13:26:49.819 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-06T13:26:49.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-11-06T13:26:49.949 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-06T13:26:49.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-06T13:26:50.048 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:50.049 INFO:tasks.ceph:role: osd.4 2023-11-06T13:26:50.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-06T13:26:50.049 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-06T13:26:50.121 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:50.122 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:50.122 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:50.122 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2023-11-06T13:26:50.123 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:50.123 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:50.123 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:50.123 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:50.123 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:50.124 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:50.484 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-06T13:26:50.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-06T13:26:50.486 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2023-11-06T13:26:50.572 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-06T13:26:50.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-06T13:26:50.670 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:50.670 INFO:tasks.ceph:role: osd.7 2023-11-06T13:26:50.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-06T13:26:50.671 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-06T13:26:50.742 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:50.743 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:50.743 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:50.743 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2023-11-06T13:26:50.743 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:50.744 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:50.744 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:50.744 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:50.744 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:50.744 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:51.107 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-06T13:26:51.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-06T13:26:51.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2023-11-06T13:26:51.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-06T13:26:51.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2023-11-06T13:26:51.307 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2023-11-06T13:26:51.307 INFO:tasks.ceph:role: osd.10 2023-11-06T13:26:51.308 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2023-11-06T13:26:51.308 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-06T13:26:51.381 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:26:51.382 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:26:51.382 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:26:51.382 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 2023-11-06T13:26:51.382 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:26:51.383 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:26:51.383 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:26:51.383 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:26:51.383 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:26:51.383 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:26:51.750 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2023-11-06T13:26:51.752 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2023-11-06T13:26:51.753 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2023-11-06T13:26:51.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2023-11-06T13:26:51.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:51.971+0000 7faf8b709380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-06T13:26:51.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:51.975+0000 7faf8b709380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-06T13:26:51.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:51.975+0000 7faf8b709380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-06T13:26:51.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:51.975+0000 7faf8b709380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-06T13:26:51.978 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:51.975+0000 7faf8b709380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-06T13:26:51.979 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:51.976+0000 7faf8b709380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-06T13:26:54.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-06T13:26:54.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:54.952 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:54.949+0000 7f42aa35c380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-06T13:26:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:54.950+0000 7f42aa35c380 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-06T13:26:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:54.950+0000 7f42aa35c380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-06T13:26:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:54.950+0000 7f42aa35c380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-06T13:26:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:54.950+0000 7f42aa35c380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-06T13:26:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:54.950+0000 7f42aa35c380 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-06T13:26:56.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:56.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:56.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:26:57.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-06T13:26:57.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:26:57.925 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:57.922+0000 7fe2f19a1380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-06T13:26:57.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:57.922+0000 7fe2f19a1380 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-06T13:26:57.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:57.922+0000 7fe2f19a1380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-06T13:26:57.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:57.922+0000 7fe2f19a1380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-06T13:26:57.926 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:57.922+0000 7fe2f19a1380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-06T13:26:57.927 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:26:57.923+0000 7fe2f19a1380 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-06T13:27:00.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-06T13:27:00.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:27:00.893+0000 7f8e7c305380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2023-11-06T13:27:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:27:00.893+0000 7f8e7c305380 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2023-11-06T13:27:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:27:00.893+0000 7f8e7c305380 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2023-11-06T13:27:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:27:00.893+0000 7f8e7c305380 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2023-11-06T13:27:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:27:00.893+0000 7f8e7c305380 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2023-11-06T13:27:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2023-11-06T13:27:00.894+0000 7f8e7c305380 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2023-11-06T13:27:03.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2023-11-06T13:27:03.788 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-06T13:27:03.818 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2023-11-06T13:27:03.818 INFO:tasks.ceph:role: osd.2 2023-11-06T13:27:03.819 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2023-11-06T13:27:03.819 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-06T13:27:03.893 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:27:03.894 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:27:03.894 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:27:03.894 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-11-06T13:27:03.894 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:27:03.895 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:27:03.895 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:27:03.895 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:27:03.895 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:27:03.896 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:27:04.258 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-11-06T13:27:04.260 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-11-06T13:27:04.260 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-11-06T13:27:04.378 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-06T13:27:04.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-06T13:27:04.475 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2023-11-06T13:27:04.475 INFO:tasks.ceph:role: osd.5 2023-11-06T13:27:04.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2023-11-06T13:27:04.475 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-06T13:27:04.547 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:27:04.547 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:27:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:27:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-11-06T13:27:04.548 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:27:04.548 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:27:04.548 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:27:04.549 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:27:04.549 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:27:04.549 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:27:04.915 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-11-06T13:27:04.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-11-06T13:27:04.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-06T13:27:05.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-06T13:27:05.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2023-11-06T13:27:05.098 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2023-11-06T13:27:05.099 INFO:tasks.ceph:role: osd.8 2023-11-06T13:27:05.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2023-11-06T13:27:05.099 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-06T13:27:05.169 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:27:05.170 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:27:05.170 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:27:05.170 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-11-06T13:27:05.170 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:27:05.170 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:27:05.171 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:27:05.171 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:27:05.171 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:27:05.171 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:27:05.534 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-11-06T13:27:05.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-11-06T13:27:05.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2023-11-06T13:27:05.634 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2023-11-06T13:27:05.662 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2023-11-06T13:27:05.726 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2023-11-06T13:27:05.727 INFO:tasks.ceph:role: osd.11 2023-11-06T13:27:05.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com 2023-11-06T13:27:05.727 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-06T13:27:05.796 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-06T13:27:05.797 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-06T13:27:05.797 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-06T13:27:05.797 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-11-06T13:27:05.797 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-06T13:27:05.798 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-11-06T13:27:05.798 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-06T13:27:05.798 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-06T13:27:05.798 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-06T13:27:05.799 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-06T13:27:06.166 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2023-11-06T13:27:06.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-11-06T13:27:06.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2023-11-06T13:27:06.274 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2023-11-06T13:27:06.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:06.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:06.380+0000 7f9cca58b380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-06T13:27:06.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:06.383+0000 7f9cca58b380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-06T13:27:06.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:06.384+0000 7f9cca58b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-06T13:27:06.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:06.384+0000 7f9cca58b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-06T13:27:06.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:06.384+0000 7f9cca58b380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-06T13:27:06.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:06.389+0000 7f9cca58b380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-06T13:27:09.254 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-06T13:27:09.321 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:09.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:09.400+0000 7f1edae76380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-06T13:27:09.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:09.400+0000 7f1edae76380 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-06T13:27:09.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:09.400+0000 7f1edae76380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-06T13:27:09.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:09.400+0000 7f1edae76380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-06T13:27:09.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:09.400+0000 7f1edae76380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-06T13:27:09.404 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:09.400+0000 7f1edae76380 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-06T13:27:12.264 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-06T13:27:12.330 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:12.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:12.407+0000 7fccd3981380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2023-11-06T13:27:12.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:12.407+0000 7fccd3981380 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2023-11-06T13:27:12.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:12.407+0000 7fccd3981380 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2023-11-06T13:27:12.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:12.407+0000 7fccd3981380 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2023-11-06T13:27:12.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:12.407+0000 7fccd3981380 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2023-11-06T13:27:12.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:12.408+0000 7fccd3981380 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2023-11-06T13:27:15.268 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2023-11-06T13:27:15.337 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:15.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:15.419+0000 7f4066675380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2023-11-06T13:27:15.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:15.419+0000 7f4066675380 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2023-11-06T13:27:15.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:15.419+0000 7f4066675380 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2023-11-06T13:27:15.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:15.419+0000 7f4066675380 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2023-11-06T13:27:15.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:15.419+0000 7f4066675380 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2023-11-06T13:27:15.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:15.420+0000 7f4066675380 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2023-11-06T13:27:18.296 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2023-11-06T13:27:18.325 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-06T13:27:18.325 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-06T13:27:18.356 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-06T13:27:18.427 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-06T13:27:18.495 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-g/keyring of=/dev/stdout 2023-11-06T13:27:18.563 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.564 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/mds/ceph-j/keyring of=/dev/stdout 2023-11-06T13:27:18.631 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.631 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-06T13:27:18.698 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.698 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-06T13:27:18.764 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-06T13:27:18.831 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:18.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2023-11-06T13:27:18.897 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:18.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-06T13:27:18.927 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:18.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-06T13:27:18.996 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:18.997 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-11-06T13:27:19.064 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:19.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-h/keyring of=/dev/stdout 2023-11-06T13:27:19.133 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:19.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-k/keyring of=/dev/stdout 2023-11-06T13:27:19.202 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:19.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-06T13:27:19.272 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:19.273 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-06T13:27:19.340 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:19.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-06T13:27:19.409 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:19.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2023-11-06T13:27:19.478 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.479 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2023-11-06T13:27:19.507 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.507 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-06T13:27:19.574 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-11-06T13:27:19.640 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.641 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-i/keyring of=/dev/stdout 2023-11-06T13:27:19.705 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.706 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mds/ceph-l/keyring of=/dev/stdout 2023-11-06T13:27:19.770 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.770 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-06T13:27:19.834 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.835 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-06T13:27:19.898 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2023-11-06T13:27:19.964 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:19.964 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2023-11-06T13:27:20.028 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:20.028 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-06T13:27:20.047 INFO:tasks.ceph:Adding keys to all mons... 2023-11-06T13:27:20.047 DEBUG:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-06T13:27:20.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-06T13:27:20.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-06T13:27:20.114 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2023-11-06T13:27:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCF6UhllSkVMRAAgN/VQlI5jE1bwm9KQhlqNg== 2023-11-06T13:27:20.114 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a] 2023-11-06T13:27:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlMB2mABAAS3HbdfMA2Yq09oMNEEUb5g== 2023-11-06T13:27:20.115 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d] 2023-11-06T13:27:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlFBmNBxAATUvFiohhd/Dur+LASsq6gQ== 2023-11-06T13:27:20.115 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.g] 2023-11-06T13:27:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6Uhlt41uDhAAHwMJI314XaAmH6rjSFgjoQ== 2023-11-06T13:27:20.115 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.j] 2023-11-06T13:27:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlOFxUFRAAlbZo8bujnpOFBh/J6WNGIw== 2023-11-06T13:27:20.116 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2023-11-06T13:27:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCN6Uhllkv5HhAALd6haxnT1nLcn9KDwQwGfA== 2023-11-06T13:27:20.116 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.3] 2023-11-06T13:27:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCQ6UhlbI1JHhAANqM64iUKOTTDJSiwbO9lag== 2023-11-06T13:27:20.117 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.6] 2023-11-06T13:27:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCT6UhllsFsHBAAwzDmL61YieFXgGxOnnR85Q== 2023-11-06T13:27:20.117 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.9] 2023-11-06T13:27:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCW6UhlltHKGhAAsSNWFzBv2EmRSoFAHN0Byw== 2023-11-06T13:27:20.118 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.y] 2023-11-06T13:27:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCF6UhlYovVNBAARkXz2LVTmlqSs09FenNDMg== 2023-11-06T13:27:20.118 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b] 2023-11-06T13:27:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlhxLiGRAAaFuQYGiubN/wSDcL2MT8FA== 2023-11-06T13:27:20.118 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e] 2023-11-06T13:27:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlcE3NIBAA9OxljtSU3M4cp4AGE9IhWQ== 2023-11-06T13:27:20.119 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.h] 2023-11-06T13:27:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhltSa9JxAA0Lqp65C3HZ5jvrjoNzZZLg== 2023-11-06T13:27:20.119 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.k] 2023-11-06T13:27:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6Uhl03CwLhAAiO6APM4rGu7pZ9dRQcJJzw== 2023-11-06T13:27:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2023-11-06T13:27:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCb6UhlyNr7ORAARzpzFcaSTDNnxGhYM7tZoQ== 2023-11-06T13:27:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.4] 2023-11-06T13:27:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCe6UhlozupOBAAj51I7uRkCR+PhtoKa9UIhw== 2023-11-06T13:27:20.120 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.7] 2023-11-06T13:27:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCh6UhlQFMKNxAAmTC51uqo+V81kLvvH2gRBw== 2023-11-06T13:27:20.121 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.10] 2023-11-06T13:27:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCk6Uhl1iBfNRAAIEpKj8Sia9JdNQLhnRcQ0w== 2023-11-06T13:27:20.121 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.z] 2023-11-06T13:27:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCF6UhlcKAkORAAkAq9QdA9elejLERU1FY4eA== 2023-11-06T13:27:20.122 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c] 2023-11-06T13:27:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlujZ3MxAAdWAQrSQHRveqVqiu8mpDFw== 2023-11-06T13:27:20.122 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f] 2023-11-06T13:27:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCG6UhlEjg8OhAAdhGEFabzTytSQoKN4vP1pg== 2023-11-06T13:27:20.122 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.i] 2023-11-06T13:27:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCH6UhlZFc3BRAAQ7jTV1VTtfGNebtpDbElIQ== 2023-11-06T13:27:20.123 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.l] 2023-11-06T13:27:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCH6Uhl8HLaCxAArU7JcuzOr4P2s4xU7DFAPA== 2023-11-06T13:27:20.123 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2023-11-06T13:27:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCq6UhlmaC8FhAA9UnEs8phu7euhIxojVUJvQ== 2023-11-06T13:27:20.124 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.5] 2023-11-06T13:27:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCt6UhlEr7dFxAAnXHg1AJsl094fA6dImlh2w== 2023-11-06T13:27:20.124 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.8] 2023-11-06T13:27:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCw6UhlZTVSGBAABbNTMRROcMlO8JnudU69mQ== 2023-11-06T13:27:20.124 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.11] 2023-11-06T13:27:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCz6Uhl52cJGRAARCPOTIIpFI7rl4p8bPaDGA== 2023-11-06T13:27:20.125 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2023-11-06T13:27:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQCH6UhlxTL5DxAAtxwij1PmwdG4Qgd/bKwbWw== 2023-11-06T13:27:20.127 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2023-11-06T13:27:20.127 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCF6UhllSkVMRAAgN/VQlI5jE1bwm9KQhlqNg== 2023-11-06T13:27:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2023-11-06T13:27:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlMB2mABAAS3HbdfMA2Yq09oMNEEUb5g== 2023-11-06T13:27:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2023-11-06T13:27:20.128 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlFBmNBxAATUvFiohhd/Dur+LASsq6gQ== 2023-11-06T13:27:20.128 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.g] 2023-11-06T13:27:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6Uhlt41uDhAAHwMJI314XaAmH6rjSFgjoQ== 2023-11-06T13:27:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.j] 2023-11-06T13:27:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlOFxUFRAAlbZo8bujnpOFBh/J6WNGIw== 2023-11-06T13:27:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2023-11-06T13:27:20.129 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCN6Uhllkv5HhAALd6haxnT1nLcn9KDwQwGfA== 2023-11-06T13:27:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2023-11-06T13:27:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCQ6UhlbI1JHhAANqM64iUKOTTDJSiwbO9lag== 2023-11-06T13:27:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2023-11-06T13:27:20.130 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCT6UhllsFsHBAAwzDmL61YieFXgGxOnnR85Q== 2023-11-06T13:27:20.130 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.9] 2023-11-06T13:27:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCW6UhlltHKGhAAsSNWFzBv2EmRSoFAHN0Byw== 2023-11-06T13:27:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2023-11-06T13:27:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCF6UhlYovVNBAARkXz2LVTmlqSs09FenNDMg== 2023-11-06T13:27:20.131 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2023-11-06T13:27:20.131 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlhxLiGRAAaFuQYGiubN/wSDcL2MT8FA== 2023-11-06T13:27:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.e] 2023-11-06T13:27:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlcE3NIBAA9OxljtSU3M4cp4AGE9IhWQ== 2023-11-06T13:27:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.h] 2023-11-06T13:27:20.132 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhltSa9JxAA0Lqp65C3HZ5jvrjoNzZZLg== 2023-11-06T13:27:20.132 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.k] 2023-11-06T13:27:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6Uhl03CwLhAAiO6APM4rGu7pZ9dRQcJJzw== 2023-11-06T13:27:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2023-11-06T13:27:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCb6UhlyNr7ORAARzpzFcaSTDNnxGhYM7tZoQ== 2023-11-06T13:27:20.133 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2023-11-06T13:27:20.133 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCe6UhlozupOBAAj51I7uRkCR+PhtoKa9UIhw== 2023-11-06T13:27:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2023-11-06T13:27:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCh6UhlQFMKNxAAmTC51uqo+V81kLvvH2gRBw== 2023-11-06T13:27:20.134 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.10] 2023-11-06T13:27:20.134 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCk6Uhl1iBfNRAAIEpKj8Sia9JdNQLhnRcQ0w== 2023-11-06T13:27:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.z] 2023-11-06T13:27:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCF6UhlcKAkORAAkAq9QdA9elejLERU1FY4eA== 2023-11-06T13:27:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2023-11-06T13:27:20.135 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlujZ3MxAAdWAQrSQHRveqVqiu8mpDFw== 2023-11-06T13:27:20.135 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.f] 2023-11-06T13:27:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCG6UhlEjg8OhAAdhGEFabzTytSQoKN4vP1pg== 2023-11-06T13:27:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.i] 2023-11-06T13:27:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCH6UhlZFc3BRAAQ7jTV1VTtfGNebtpDbElIQ== 2023-11-06T13:27:20.136 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.l] 2023-11-06T13:27:20.136 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCH6Uhl8HLaCxAArU7JcuzOr4P2s4xU7DFAPA== 2023-11-06T13:27:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2023-11-06T13:27:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCq6UhlmaC8FhAA9UnEs8phu7euhIxojVUJvQ== 2023-11-06T13:27:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2023-11-06T13:27:20.137 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCt6UhlEr7dFxAAnXHg1AJsl094fA6dImlh2w== 2023-11-06T13:27:20.137 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.8] 2023-11-06T13:27:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCw6UhlZTVSGBAABbNTMRROcMlO8JnudU69mQ== 2023-11-06T13:27:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.11] 2023-11-06T13:27:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCz6Uhl52cJGRAARCPOTIIpFI7rl4p8bPaDGA== 2023-11-06T13:27:20.138 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2023-11-06T13:27:20.138 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQCH6UhlxTL5DxAAtxwij1PmwdG4Qgd/bKwbWw== 2023-11-06T13:27:20.141 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2023-11-06T13:27:20.141 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCF6UhllSkVMRAAgN/VQlI5jE1bwm9KQhlqNg== 2023-11-06T13:27:20.142 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.a] 2023-11-06T13:27:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlMB2mABAAS3HbdfMA2Yq09oMNEEUb5g== 2023-11-06T13:27:20.142 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.d] 2023-11-06T13:27:20.142 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlFBmNBxAATUvFiohhd/Dur+LASsq6gQ== 2023-11-06T13:27:20.142 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.g] 2023-11-06T13:27:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6Uhlt41uDhAAHwMJI314XaAmH6rjSFgjoQ== 2023-11-06T13:27:20.143 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.j] 2023-11-06T13:27:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlOFxUFRAAlbZo8bujnpOFBh/J6WNGIw== 2023-11-06T13:27:20.143 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2023-11-06T13:27:20.143 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCN6Uhllkv5HhAALd6haxnT1nLcn9KDwQwGfA== 2023-11-06T13:27:20.144 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2023-11-06T13:27:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCQ6UhlbI1JHhAANqM64iUKOTTDJSiwbO9lag== 2023-11-06T13:27:20.144 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2023-11-06T13:27:20.144 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCT6UhllsFsHBAAwzDmL61YieFXgGxOnnR85Q== 2023-11-06T13:27:20.144 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.9] 2023-11-06T13:27:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCW6UhlltHKGhAAsSNWFzBv2EmRSoFAHN0Byw== 2023-11-06T13:27:20.145 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2023-11-06T13:27:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCF6UhlYovVNBAARkXz2LVTmlqSs09FenNDMg== 2023-11-06T13:27:20.145 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.b] 2023-11-06T13:27:20.145 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlhxLiGRAAaFuQYGiubN/wSDcL2MT8FA== 2023-11-06T13:27:20.146 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.e] 2023-11-06T13:27:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlcE3NIBAA9OxljtSU3M4cp4AGE9IhWQ== 2023-11-06T13:27:20.146 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.h] 2023-11-06T13:27:20.146 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhltSa9JxAA0Lqp65C3HZ5jvrjoNzZZLg== 2023-11-06T13:27:20.147 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.k] 2023-11-06T13:27:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6Uhl03CwLhAAiO6APM4rGu7pZ9dRQcJJzw== 2023-11-06T13:27:20.147 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2023-11-06T13:27:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCb6UhlyNr7ORAARzpzFcaSTDNnxGhYM7tZoQ== 2023-11-06T13:27:20.147 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2023-11-06T13:27:20.147 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCe6UhlozupOBAAj51I7uRkCR+PhtoKa9UIhw== 2023-11-06T13:27:20.148 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2023-11-06T13:27:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCh6UhlQFMKNxAAmTC51uqo+V81kLvvH2gRBw== 2023-11-06T13:27:20.148 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.10] 2023-11-06T13:27:20.148 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCk6Uhl1iBfNRAAIEpKj8Sia9JdNQLhnRcQ0w== 2023-11-06T13:27:20.148 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.z] 2023-11-06T13:27:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCF6UhlcKAkORAAkAq9QdA9elejLERU1FY4eA== 2023-11-06T13:27:20.149 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.c] 2023-11-06T13:27:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlujZ3MxAAdWAQrSQHRveqVqiu8mpDFw== 2023-11-06T13:27:20.149 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.f] 2023-11-06T13:27:20.149 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCG6UhlEjg8OhAAdhGEFabzTytSQoKN4vP1pg== 2023-11-06T13:27:20.150 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.i] 2023-11-06T13:27:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCH6UhlZFc3BRAAQ7jTV1VTtfGNebtpDbElIQ== 2023-11-06T13:27:20.150 INFO:teuthology.orchestra.run.smithi038.stdout:[mds.l] 2023-11-06T13:27:20.150 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCH6Uhl8HLaCxAArU7JcuzOr4P2s4xU7DFAPA== 2023-11-06T13:27:20.150 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2023-11-06T13:27:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCq6UhlmaC8FhAA9UnEs8phu7euhIxojVUJvQ== 2023-11-06T13:27:20.151 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2023-11-06T13:27:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCt6UhlEr7dFxAAnXHg1AJsl094fA6dImlh2w== 2023-11-06T13:27:20.151 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.8] 2023-11-06T13:27:20.151 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCw6UhlZTVSGBAABbNTMRROcMlO8JnudU69mQ== 2023-11-06T13:27:20.152 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.11] 2023-11-06T13:27:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCz6Uhl52cJGRAARCPOTIIpFI7rl4p8bPaDGA== 2023-11-06T13:27:20.152 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2023-11-06T13:27:20.152 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCH6UhlxTL5DxAAtxwij1PmwdG4Qgd/bKwbWw== 2023-11-06T13:27:20.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:20.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:20.173 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:20.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.280 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.285 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.340 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.392 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.395 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.448 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.495 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.498 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.500 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.548 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.550 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.600 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.645 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:20.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:20.650 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:20.695 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.700 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.754 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.807 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.860 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:20.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.913 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:20.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.012 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.062 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.107 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:21.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:21.112 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-06T13:27:21.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.162 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.250 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.252 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.301 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.306 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.354 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.359 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-06T13:27:21.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.464 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.509 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.513 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.558 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.563 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-06T13:27:21.608 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-06T13:27:21.611 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-06T13:27:21.613 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-06T13:27:21.662 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-06T13:27:21.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-06T13:27:21.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-06T13:27:21.784 DEBUG:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-06T13:27:21.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-06T13:27:21.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-06T13:27:21.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-06T13:27:21.952 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-06T13:27:21.977 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-06T13:27:22.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-06T13:27:22.091 DEBUG:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:22.093 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:22.096 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-06T13:27:22.145 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-06T13:27:22.146 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-06T13:27:22.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-06T13:27:22.149 INFO:tasks.ceph.mon.a:Started 2023-11-06T13:27:22.149 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-06T13:27:22.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-06T13:27:22.152 INFO:tasks.ceph.mon.b:Started 2023-11-06T13:27:22.152 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-06T13:27:22.152 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-06T13:27:22.188 INFO:tasks.ceph.mon.c:Started 2023-11-06T13:27:22.188 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-06T13:27:22.188 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-06T13:27:22.189 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-06T13:27:22.194 INFO:tasks.ceph.mgr.x:Started 2023-11-06T13:27:22.195 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-06T13:27:22.195 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-06T13:27:22.198 INFO:tasks.ceph.mgr.y:Started 2023-11-06T13:27:22.198 INFO:tasks.ceph.mgr.z:Restarting daemon 2023-11-06T13:27:22.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2023-11-06T13:27:22.202 INFO:tasks.ceph.mgr.z:Started 2023-11-06T13:27:22.203 INFO:tasks.ceph:Setting crush tunables to default 2023-11-06T13:27:22.203 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2023-11-06T13:27:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.320+0000 7f63bcfb0700 1 Processor -- start 2023-11-06T13:27:22.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.320+0000 7f63bcfb0700 1 -- start start 2023-11-06T13:27:22.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63bcfb0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 0x7f63b80ed110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63bcfb0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 0x7f63b817eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63bcfb0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b80ee5c0 con 0x7f63b8182af0 2023-11-06T13:27:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63bcfb0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b8182f70 con 0x7f63b8178b60 2023-11-06T13:27:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63bcfb0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b80ed6d0 con 0x7f63b8180730 2023-11-06T13:27:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63b77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 0x7f63b80ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63b77fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 0x7f63b80ed110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41994/0 (socket says 172.21.15.38:41994) 2023-11-06T13:27:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.321+0000 7f63b77fe700 1 -- 172.21.15.38:0/1626380269 learned_addr learned my addr 172.21.15.38:0/1626380269 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b77fe700 1 -- 172.21.15.38:0/1626380269 >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 msgr2=0x7f63b80ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-06T13:27:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b77fe700 1 -- 172.21.15.38:0/1626380269 >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 msgr2=0x7f63b80ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-06T13:27:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b77fe700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 0x7f63b80ed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-06T13:27:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 0x7f63b817eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b77fe700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 0x7f63b80ed110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-06T13:27:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b7fff700 1 -- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 msgr2=0x7f63b817eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-06T13:27:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b7fff700 1 -- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 msgr2=0x7f63b817eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-06T13:27:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 0x7f63b817eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-11-06T13:27:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.322+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 0x7f63b817eae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-11-06T13:27:22.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.485+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586871135 0 0) 0x7f63b80ee5c0 con 0x7f63b8182af0 2023-11-06T13:27:22.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.485+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a00033f0 con 0x7f63b8182af0 2023-11-06T13:27:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 <== mon.1 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1612515242 0 0) 0x7f63a00033f0 con 0x7f63b8182af0 2023-11-06T13:27:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 msgr2=0x7f63b817eae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:27:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.44:3300/0 conn(0x7f63b8180730 0x7f63b817eae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 msgr2=0x7f63b80ed110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:27:22.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 --2- 172.21.15.38:0/1626380269 >> v2:172.21.15.38:3300/0 conn(0x7f63b8178b60 0x7f63b80ed110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b80ed9b0 con 0x7f63b8182af0 2023-11-06T13:27:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 <== mon.1 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f63ac001470 con 0x7f63b8182af0 2023-11-06T13:27:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 >> v1:172.21.15.44:6789/0 conn(0x7f63b8182af0 legacy=0x7f63b8180020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63a00038e0 0x7f63a0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a0004690 0x7f63a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8182f70 con 0x7f63a0005000 2023-11-06T13:27:22.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80ed6d0 con 0x7f63a0004690 2023-11-06T13:27:22.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a000bf90 con 0x7f63a00038e0 2023-11-06T13:27:22.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b6ffd700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a0004690 0x7f63a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b77fe700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63a00038e0 0x7f63a0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 -- 172.21.15.38:0/1626380269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63a00038e0 msgr2=0x7f63a0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:22.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63a00038e0 0x7f63a0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 -- 172.21.15.38:0/1626380269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a0004690 msgr2=0x7f63a0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:22.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a0004690 0x7f63a0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 -- 172.21.15.38:0/1626380269 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b80ed9b0 con 0x7f63a0005000 2023-11-06T13:27:22.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.486+0000 7f63b7fff700 1 -- 172.21.15.38:0/1626380269 reap_dead start 2023-11-06T13:27:22.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.487+0000 7f63b7fff700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63a000b8e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f63b0007440 tx=0x7f63b0009720).ready entity=mon.0 client_cookie=7026a4a4316d3eb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:22.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.491+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0009a30 con 0x7f63a0005000 2023-11-06T13:27:22.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.491+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0007c90 con 0x7f63a0005000 2023-11-06T13:27:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.491+0000 7f63b67fc700 1 -- 172.21.15.38:0/1626380269 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0015640 con 0x7f63a0005000 2023-11-06T13:27:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 -- 172.21.15.38:0/1626380269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 msgr2=0x7f63a000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63a000b8e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f63b0007440 tx=0x7f63b0009720).stop 2023-11-06T13:27:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 -- 172.21.15.38:0/1626380269 shutdown_connections 2023-11-06T13:27:22.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 --2- 172.21.15.38:0/1626380269 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63a000b8e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 -- 172.21.15.38:0/1626380269 >> 172.21.15.38:0/1626380269 conn(0x7f63b80ee9e0 msgr2=0x7f63b80eedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 -- 172.21.15.38:0/1626380269 shutdown_connections 2023-11-06T13:27:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.492+0000 7f63bcfb0700 1 -- 172.21.15.38:0/1626380269 wait complete. 2023-11-06T13:27:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.494+0000 7f63bcfb0700 1 Processor -- start 2023-11-06T13:27:22.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.494+0000 7f63bcfb0700 1 -- start start 2023-11-06T13:27:22.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63bcfb0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63b80ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63bcfb0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63b80ef7c0 0x7f63b8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63bcfb0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b8152920 0x7f63b817e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:22.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63bcfb0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8152da0 con 0x7f63a0005000 2023-11-06T13:27:22.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63bcfb0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8171530 con 0x7f63b8152920 2023-11-06T13:27:22.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63bcfb0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b81706d0 con 0x7f63b80ef7c0 2023-11-06T13:27:22.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63b80ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63b80ef2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42022/0 (socket says 172.21.15.38:42022) 2023-11-06T13:27:22.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 -- 172.21.15.38:0/3177907462 learned_addr learned my addr 172.21.15.38:0/3177907462 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:22.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b6ffd700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63b80ef7c0 0x7f63b8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b7fff700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b8152920 0x7f63b817e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:22.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 -- 172.21.15.38:0/3177907462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63b80ef7c0 msgr2=0x7f63b8152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:22.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63b80ef7c0 0x7f63b8152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 -- 172.21.15.38:0/3177907462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b8152920 msgr2=0x7f63b817e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:22.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b8152920 0x7f63b817e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 -- 172.21.15.38:0/3177907462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b81709b0 con 0x7f63a0005000 2023-11-06T13:27:22.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b7fff700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b8152920 0x7f63b817e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:22.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.495+0000 7f63b77fe700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63b80ef2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f63a8006980 tx=0x7f63a8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:22.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800b4c0 con 0x7f63a0005000 2023-11-06T13:27:22.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800e690 con 0x7f63a0005000 2023-11-06T13:27:22.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b8170c90 con 0x7f63a0005000 2023-11-06T13:27:22.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800ea30 con 0x7f63a0005000 2023-11-06T13:27:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b8171250 con 0x7f63a0005000 2023-11-06T13:27:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f63a8005880 con 0x7f63a0005000 2023-11-06T13:27:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.496+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f63a8006640 con 0x7f63a0005000 2023-11-06T13:27:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.497+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b817dfc0 con 0x7f63a0005000 2023-11-06T13:27:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.502+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f63a8005dd0 con 0x7f63a0005000 2023-11-06T13:27:22.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.583+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f63b80efba0 con 0x7f63a0005000 2023-11-06T13:27:22.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.586+0000 7f639f7fe700 1 -- 172.21.15.38:0/3177907462 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f63b80efba0 con 0x7f63a0005000 2023-11-06T13:27:22.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 msgr2=0x7f63b80ef2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:22.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63b80ef2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f63a8006980 tx=0x7f63a8008040).stop 2023-11-06T13:27:22.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 shutdown_connections 2023-11-06T13:27:22.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b8152920 0x7f63b817e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f63a0005000 0x7f63b80ef2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 --2- 172.21.15.38:0/3177907462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f63b80ef7c0 0x7f63b8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:22.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 >> 172.21.15.38:0/3177907462 conn(0x7f63b80ee9e0 msgr2=0x7f63b806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:22.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 shutdown_connections 2023-11-06T13:27:22.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:22.587+0000 7f63bcfb0700 1 -- 172.21.15.38:0/3177907462 wait complete. 2023-11-06T13:27:22.592 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2023-11-06T13:27:22.602 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-06T13:27:22.603 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:22.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-06T13:27:22.626 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:22.622+0000 7f39be409680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-06T13:27:22.629 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:22.626+0000 7f02a31ca680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-06T13:27:22.630 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:22.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-06T13:27:22.640 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:22.636+0000 7f10a58be680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-06T13:27:22.664 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:22.665 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-06T13:27:22.693 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:22.690+0000 7f39be409680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-06T13:27:22.701 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:22.698+0000 7f02a31ca680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-06T13:27:22.713 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:22.710+0000 7f10a58be680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-06T13:27:22.731 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:27:22.731 DEBUG:teuthology.orchestra.run.smithi038:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2023-11-06T13:27:22.796 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:22.797 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-06T13:27:22.821 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:22.822 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-06T13:27:22.887 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:22.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-06T13:27:22.951 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2023-11-06T13:27:22.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2023-11-06T13:27:23.016 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:23.016 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-06T13:27:23.041 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:23.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-06T13:27:23.105 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:23.105 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2023-11-06T13:27:23.154 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:23.151+0000 7f39be409680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-06T13:27:23.169 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-11-06T13:27:23.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2023-11-06T13:27:23.208 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:23.205+0000 7f02a31ca680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-06T13:27:23.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 70dffe1e-03ba-483c-bbdb-4618ba574c34 0 2023-11-06T13:27:23.238 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:23.235+0000 7f10a58be680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-06T13:27:23.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.382+0000 7fb8670a2700 1 Processor -- start 2023-11-06T13:27:23.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.382+0000 7fb8670a2700 1 -- start start 2023-11-06T13:27:23.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb8670a2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb860178a70 0x7fb860178e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb8670a2700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb86017e7a0 0x7fb860064600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb8670a2700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86017dc00 con 0x7fb860064150 2023-11-06T13:27:23.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb8670a2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb860064af0 con 0x7fb860178a70 2023-11-06T13:27:23.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb8670a2700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86017cd10 con 0x7fb86017e7a0 2023-11-06T13:27:23.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb85ffff700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fb860064150 0x7fb86017e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:33314/0 (socket says 172.21.15.163:33314) 2023-11-06T13:27:23.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb86563f700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb86017e7a0 0x7fb860064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb85ffff700 1 -- 172.21.15.163:0/2392270058 learned_addr learned my addr 172.21.15.163:0/2392270058 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-11-06T13:27:23.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb864e3e700 1 --2- 172.21.15.163:0/2392270058 >> v2:172.21.15.44:3300/0 conn(0x7fb860178a70 0x7fb860178e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb86563f700 1 -- 172.21.15.163:0/2392270058 >> v2:172.21.15.44:3300/0 conn(0x7fb860178a70 msgr2=0x7fb860178e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:23.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb86563f700 1 --2- 172.21.15.163:0/2392270058 >> v2:172.21.15.44:3300/0 conn(0x7fb860178a70 0x7fb860178e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb86563f700 1 -- 172.21.15.163:0/2392270058 >> v1:172.21.15.163:6789/0 conn(0x7fb860064150 legacy=0x7fb86017e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb86563f700 1 -- 172.21.15.163:0/2392270058 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86017cff0 con 0x7fb86017e7a0 2023-11-06T13:27:23.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb85f7fe700 1 -- 172.21.15.163:0/2392270058 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429465303 0 0) 0x7fb86017dc00 con 0x7fb860064150 2023-11-06T13:27:23.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb864e3e700 1 --2- 172.21.15.163:0/2392270058 >> v2:172.21.15.44:3300/0 conn(0x7fb860178a70 0x7fb860178e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:23.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb86563f700 1 --2- 172.21.15.163:0/2392270058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860064600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb86006ab80 tx=0x7fb858009780).ready entity=mon.2 client_cookie=ec27ffb33b6c471d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:23.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.384+0000 7fb85f7fe700 1 -- 172.21.15.163:0/2392270058 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800e070 con 0x7fb86017e7a0 2023-11-06T13:27:23.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb85f7fe700 1 -- 172.21.15.163:0/2392270058 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85800bc30 con 0x7fb86017e7a0 2023-11-06T13:27:23.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb85f7fe700 1 -- 172.21.15.163:0/2392270058 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858012410 con 0x7fb86017e7a0 2023-11-06T13:27:23.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 -- 172.21.15.163:0/2392270058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 msgr2=0x7fb860064600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 --2- 172.21.15.163:0/2392270058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860064600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb86006ab80 tx=0x7fb858009780).stop 2023-11-06T13:27:23.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 -- 172.21.15.163:0/2392270058 shutdown_connections 2023-11-06T13:27:23.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 --2- 172.21.15.163:0/2392270058 >> v2:172.21.15.44:3300/0 conn(0x7fb860178a70 0x7fb860178e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 --2- 172.21.15.163:0/2392270058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860064600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 -- 172.21.15.163:0/2392270058 >> 172.21.15.163:0/2392270058 conn(0x7fb860069ea0 msgr2=0x7fb86006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:23.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 -- 172.21.15.163:0/2392270058 shutdown_connections 2023-11-06T13:27:23.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.385+0000 7fb8670a2700 1 -- 172.21.15.163:0/2392270058 wait complete. 2023-11-06T13:27:23.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.386+0000 7fb8670a2700 1 Processor -- start 2023-11-06T13:27:23.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.387+0000 7fb8670a2700 1 -- start start 2023-11-06T13:27:23.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860064150 0x7fb860192710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb860178a70 0x7fb86015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860162210 con 0x7fb860178a70 2023-11-06T13:27:23.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860181690 con 0x7fb860064150 2023-11-06T13:27:23.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860181970 con 0x7fb86017e7a0 2023-11-06T13:27:23.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54746/0 (socket says 172.21.15.163:54746) 2023-11-06T13:27:23.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 -- 172.21.15.163:0/803473102 learned_addr learned my addr 172.21.15.163:0/803473102 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:23.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb864e3e700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860064150 0x7fb860192710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb85ffff700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb860178a70 0x7fb86015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 -- 172.21.15.163:0/803473102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860064150 msgr2=0x7fb860192710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860064150 0x7fb860192710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 -- 172.21.15.163:0/803473102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb860178a70 msgr2=0x7fb86015fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb860178a70 0x7fb86015fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 -- 172.21.15.163:0/803473102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009a20 con 0x7fb86017e7a0 2023-11-06T13:27:23.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb86563f700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860160270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb8580097c0 tx=0x7fb86017ed20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:23.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858009440 con 0x7fb86017e7a0 2023-11-06T13:27:23.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85801d630 con 0x7fb86017e7a0 2023-11-06T13:27:23.404 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb860181c50 con 0x7fb86017e7a0 2023-11-06T13:27:23.404 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85801d9d0 con 0x7fb86017e7a0 2023-11-06T13:27:23.404 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb860161ea0 con 0x7fb86017e7a0 2023-11-06T13:27:23.404 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb858003040 con 0x7fb86017e7a0 2023-11-06T13:27:23.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.388+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb85801de00 con 0x7fb86017e7a0 2023-11-06T13:27:23.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.389+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860162380 con 0x7fb86017e7a0 2023-11-06T13:27:23.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.393+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb858017070 con 0x7fb86017e7a0 2023-11-06T13:27:23.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.472+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "70dffe1e-03ba-483c-bbdb-4618ba574c34", "id": 0} v 0) v1 -- 0x7fb86006c580 con 0x7fb86017e7a0 2023-11-06T13:27:23.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.476+0000 7fb85cff9700 1 -- 172.21.15.163:0/803473102 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70dffe1e-03ba-483c-bbdb-4618ba574c34", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8580278a0 con 0x7fb86017e7a0 2023-11-06T13:27:23.480 INFO:teuthology.orchestra.run.smithi163.stdout:0 2023-11-06T13:27:23.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 msgr2=0x7fb860160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860160270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fb8580097c0 tx=0x7fb86017ed20).stop 2023-11-06T13:27:23.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 shutdown_connections 2023-11-06T13:27:23.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb86017e7a0 0x7fb860160270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb860064150 0x7fb860192710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 --2- 172.21.15.163:0/803473102 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb860178a70 0x7fb86015fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 >> 172.21.15.163:0/803473102 conn(0x7fb860069ea0 msgr2=0x7fb8600f1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:23.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 shutdown_connections 2023-11-06T13:27:23.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.477+0000 7fb8670a2700 1 -- 172.21.15.163:0/803473102 wait complete. 2023-11-06T13:27:23.492 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new efb0ea04-0df6-4615-b30e-30c437f23069 1 2023-11-06T13:27:23.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.600+0000 7f373f8ad700 1 Processor -- start 2023-11-06T13:27:23.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.601+0000 7f373f8ad700 1 -- start start 2023-11-06T13:27:23.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373f8ad700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f373817e650 0x7f373817eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373f8ad700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37380c7210 con 0x7f3738180340 2023-11-06T13:27:23.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373f8ad700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37380c74f0 con 0x7f373817e270 2023-11-06T13:27:23.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373f8ad700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37380c77d0 con 0x7f373817e650 2023-11-06T13:27:23.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f373817e650 0x7f373817eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f373817e650 0x7f373817eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54752/0 (socket says 172.21.15.163:54752) 2023-11-06T13:27:23.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 -- 172.21.15.163:0/30193631 learned_addr learned my addr 172.21.15.163:0/30193631 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:23.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 -- 172.21.15.163:0/30193631 >> v1:172.21.15.44:6789/0 conn(0x7f373817e270 legacy=0x7f37381827e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 -- 172.21.15.163:0/30193631 >> v1:172.21.15.38:6789/0 conn(0x7f3738180340 legacy=0x7f37381807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 -- 172.21.15.163:0/30193631 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37380c7ab0 con 0x7f373817e650 2023-11-06T13:27:23.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f373de4a700 1 --2- 172.21.15.163:0/30193631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f373817eac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f3730009f20 tx=0x7f3730009840).ready entity=mon.2 client_cookie=b71640714f6b7e4d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:23.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f372ffff700 1 -- 172.21.15.163:0/30193631 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000e070 con 0x7f373817e650 2023-11-06T13:27:23.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f372ffff700 1 -- 172.21.15.163:0/30193631 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000ba80 con 0x7f373817e650 2023-11-06T13:27:23.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.602+0000 7f372ffff700 1 -- 172.21.15.163:0/30193631 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000be00 con 0x7f373817e650 2023-11-06T13:27:23.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 -- 172.21.15.163:0/30193631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 msgr2=0x7f373817eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 --2- 172.21.15.163:0/30193631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f373817eac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f3730009f20 tx=0x7f3730009840).stop 2023-11-06T13:27:23.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 -- 172.21.15.163:0/30193631 shutdown_connections 2023-11-06T13:27:23.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 --2- 172.21.15.163:0/30193631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f373817eac0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 -- 172.21.15.163:0/30193631 >> 172.21.15.163:0/30193631 conn(0x7f37380f22b0 msgr2=0x7f37380ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:23.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 -- 172.21.15.163:0/30193631 shutdown_connections 2023-11-06T13:27:23.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.603+0000 7f373f8ad700 1 -- 172.21.15.163:0/30193631 wait complete. 2023-11-06T13:27:23.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.605+0000 7f373f8ad700 1 Processor -- start 2023-11-06T13:27:23.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.605+0000 7f373f8ad700 1 -- start start 2023-11-06T13:27:23.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373f8ad700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373817e270 0x7f3738172240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373f8ad700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f37380c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373f8ad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3738180340 0x7f37380c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373f8ad700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37380ef8e0 con 0x7f373817e270 2023-11-06T13:27:23.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373f8ad700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37380f0140 con 0x7f3738180340 2023-11-06T13:27:23.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373f8ad700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373818fc10 con 0x7f373817e650 2023-11-06T13:27:23.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f37380c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373d649700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373817e270 0x7f3738172240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f37380c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54756/0 (socket says 172.21.15.163:54756) 2023-11-06T13:27:23.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 -- 172.21.15.163:0/1650947430 learned_addr learned my addr 172.21.15.163:0/1650947430 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:23.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373de4a700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3738180340 0x7f37380c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 -- 172.21.15.163:0/1650947430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3738180340 msgr2=0x7f37380c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3738180340 0x7f37380c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 -- 172.21.15.163:0/1650947430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373817e270 msgr2=0x7f3738172240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373817e270 0x7f3738172240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 -- 172.21.15.163:0/1650947430 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009ae0 con 0x7f373817e650 2023-11-06T13:27:23.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373d649700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373817e270 0x7f3738172240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:27:23.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.606+0000 7f373ce48700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f37380c4250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f373400c470 tx=0x7f3734007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:23.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.607+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734007020 con 0x7f373817e650 2023-11-06T13:27:23.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.607+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734007180 con 0x7f373817e650 2023-11-06T13:27:23.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.607+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373818fef0 con 0x7f373817e650 2023-11-06T13:27:23.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.607+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734007520 con 0x7f373817e650 2023-11-06T13:27:23.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.607+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37380efdd0 con 0x7f373817e650 2023-11-06T13:27:23.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.608+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3734006b10 con 0x7f373817e650 2023-11-06T13:27:23.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.608+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f3734012c60 con 0x7f373817e650 2023-11-06T13:27:23.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.608+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373806c580 con 0x7f373817e650 2023-11-06T13:27:23.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.610+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3734020060 con 0x7f373817e650 2023-11-06T13:27:23.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.689+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "efb0ea04-0df6-4615-b30e-30c437f23069", "id": 1} v 0) v1 -- 0x7f37380f0280 con 0x7f373817e650 2023-11-06T13:27:23.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.694+0000 7f372d7fa700 1 -- 172.21.15.163:0/1650947430 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efb0ea04-0df6-4615-b30e-30c437f23069", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37340290b0 con 0x7f373817e650 2023-11-06T13:27:23.698 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-11-06T13:27:23.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.695+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 msgr2=0x7f37380c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.695+0000 7f373f8ad700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f37380c4250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f373400c470 tx=0x7f3734007e00).stop 2023-11-06T13:27:23.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.695+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 shutdown_connections 2023-11-06T13:27:23.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.695+0000 7f373f8ad700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3738180340 0x7f37380c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.695+0000 7f373f8ad700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f373817e270 0x7f3738172240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.696+0000 7f373f8ad700 1 --2- 172.21.15.163:0/1650947430 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f373817e650 0x7f37380c4250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.696+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 >> 172.21.15.163:0/1650947430 conn(0x7f37380f22b0 msgr2=0x7f3738063860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:23.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.696+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 shutdown_connections 2023-11-06T13:27:23.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.696+0000 7f373f8ad700 1 -- 172.21.15.163:0/1650947430 wait complete. 2023-11-06T13:27:23.711 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 5df266ba-af44-408a-913f-bbcee7dc4434 2 2023-11-06T13:27:23.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.820+0000 7f19bfc2d700 1 Processor -- start 2023-11-06T13:27:23.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.821+0000 7f19bfc2d700 1 -- start start 2023-11-06T13:27:23.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bfc2d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f19b8178f80 0x7f19b8085400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bfc2d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f19b8180e80 0x7f19b8181300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bfc2d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f19b81817f0 0x7f19b817eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bfc2d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b80858f0 con 0x7f19b81817f0 2023-11-06T13:27:23.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bfc2d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b81809f0 con 0x7f19b8178f80 2023-11-06T13:27:23.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bfc2d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b80eb8e0 con 0x7f19b8180e80 2023-11-06T13:27:23.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f19b8180e80 0x7f19b8181300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f19b8180e80 0x7f19b8181300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54762/0 (socket says 172.21.15.163:54762) 2023-11-06T13:27:23.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 -- 172.21.15.163:0/3063143252 learned_addr learned my addr 172.21.15.163:0/3063143252 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:23.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd9c9700 1 --2- 172.21.15.163:0/3063143252 >> v2:172.21.15.44:3300/0 conn(0x7f19b8178f80 0x7f19b8085400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 -- 172.21.15.163:0/3063143252 >> v2:172.21.15.44:3300/0 conn(0x7f19b8178f80 msgr2=0x7f19b8085400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:23.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 --2- 172.21.15.163:0/3063143252 >> v2:172.21.15.44:3300/0 conn(0x7f19b8178f80 0x7f19b8085400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 -- 172.21.15.163:0/3063143252 >> v2:172.21.15.38:3300/0 conn(0x7f19b81817f0 msgr2=0x7f19b817eea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:27:23.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 --2- 172.21.15.163:0/3063143252 >> v2:172.21.15.38:3300/0 conn(0x7f19b81817f0 0x7f19b817eea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:23.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 -- 172.21.15.163:0/3063143252 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80ebbc0 con 0x7f19b8180e80 2023-11-06T13:27:23.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bd1c8700 1 --2- 172.21.15.163:0/3063143252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b8180e80 0x7f19b8181300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f19b8086750 tx=0x7f19b40090f0).ready entity=mon.2 client_cookie=9b8550f7acfabac2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:23.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bc9c7700 1 -- 172.21.15.163:0/3063143252 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400b600 con 0x7f19b8180e80 2023-11-06T13:27:23.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bc9c7700 1 -- 172.21.15.163:0/3063143252 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400b760 con 0x7f19b8180e80 2023-11-06T13:27:23.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.822+0000 7f19bc9c7700 1 -- 172.21.15.163:0/3063143252 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400bae0 con 0x7f19b8180e80 2023-11-06T13:27:23.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3063143252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b8180e80 msgr2=0x7f19b8181300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3063143252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b8180e80 0x7f19b8181300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f19b8086750 tx=0x7f19b40090f0).stop 2023-11-06T13:27:23.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3063143252 shutdown_connections 2023-11-06T13:27:23.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3063143252 >> v2:172.21.15.38:3300/0 conn(0x7f19b81817f0 0x7f19b817eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:23.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3063143252 >> v2:172.21.15.44:3300/0 conn(0x7f19b8178f80 0x7f19b8085400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3063143252 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b8180e80 0x7f19b8181300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3063143252 >> 172.21.15.163:0/3063143252 conn(0x7f19b80ef620 msgr2=0x7f19b805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:23.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3063143252 shutdown_connections 2023-11-06T13:27:23.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.823+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3063143252 wait complete. 2023-11-06T13:27:23.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.824+0000 7f19bfc2d700 1 Processor -- start 2023-11-06T13:27:23.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.824+0000 7f19bfc2d700 1 -- start start 2023-11-06T13:27:23.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.825+0000 7f19bfc2d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19b8178f80 0x7f19b8172c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.825+0000 7f19bfc2d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b8180e80 0x7f19b816f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bfc2d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 0x7f19b816fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:23.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bfc2d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8173160 con 0x7f19b8178f80 2023-11-06T13:27:23.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bfc2d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80e62c0 con 0x7f19b8180e80 2023-11-06T13:27:23.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bfc2d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b81923b0 con 0x7f19b81817f0 2023-11-06T13:27:23.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 0x7f19b816fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 0x7f19b816fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54770/0 (socket says 172.21.15.163:54770) 2023-11-06T13:27:23.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 -- 172.21.15.163:0/3045271969 learned_addr learned my addr 172.21.15.163:0/3045271969 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:23.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bd1c8700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b8180e80 0x7f19b816f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bd9c9700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19b8178f80 0x7f19b8172c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:23.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 -- 172.21.15.163:0/3045271969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b8180e80 msgr2=0x7f19b816f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b8180e80 0x7f19b816f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 -- 172.21.15.163:0/3045271969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19b8178f80 msgr2=0x7f19b8172c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19b8178f80 0x7f19b8172c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 -- 172.21.15.163:0/3045271969 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009370 con 0x7f19b81817f0 2023-11-06T13:27:23.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bd1c8700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b8180e80 0x7f19b816f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:27:23.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19be1ca700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 0x7f19b816fba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f19b000b840 tx=0x7f19b0009270).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:23.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000d4a0 con 0x7f19b81817f0 2023-11-06T13:27:23.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b000d640 con 0x7f19b81817f0 2023-11-06T13:27:23.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b8192690 con 0x7f19b81817f0 2023-11-06T13:27:23.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.826+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b000da00 con 0x7f19b81817f0 2023-11-06T13:27:23.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.827+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80e5c70 con 0x7f19b81817f0 2023-11-06T13:27:23.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.827+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f19b001b440 con 0x7f19b81817f0 2023-11-06T13:27:23.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.827+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f19b0011850 con 0x7f19b81817f0 2023-11-06T13:27:23.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.827+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b817fe70 con 0x7f19b81817f0 2023-11-06T13:27:23.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.830+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f19b0020060 con 0x7f19b81817f0 2023-11-06T13:27:23.930 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:23.927+0000 7f39be409680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-06T13:27:23.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.941+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5df266ba-af44-408a-913f-bbcee7dc4434", "id": 2} v 0) v1 -- 0x7f19b806c580 con 0x7f19b81817f0 2023-11-06T13:27:23.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.947+0000 7f19adffb700 1 -- 172.21.15.163:0/3045271969 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5df266ba-af44-408a-913f-bbcee7dc4434", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f19b0016070 con 0x7f19b81817f0 2023-11-06T13:27:23.951 INFO:teuthology.orchestra.run.smithi163.stdout:2 2023-11-06T13:27:23.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.948+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 msgr2=0x7f19b816fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:23.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.948+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 0x7f19b816fba0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f19b000b840 tx=0x7f19b0009270).stop 2023-11-06T13:27:23.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 shutdown_connections 2023-11-06T13:27:23.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f19b81817f0 0x7f19b816fba0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f19b8178f80 0x7f19b8172c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 --2- 172.21.15.163:0/3045271969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19b8180e80 0x7f19b816f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:23.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 >> 172.21.15.163:0/3045271969 conn(0x7f19b80ef620 msgr2=0x7f19b80f1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:23.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 shutdown_connections 2023-11-06T13:27:23.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:23.949+0000 7f19bfc2d700 1 -- 172.21.15.163:0/3045271969 wait complete. 2023-11-06T13:27:23.963 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 07f1cee1-e1d2-450d-b9b1-79ef56cd178a 3 2023-11-06T13:27:23.997 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:23.994+0000 7f02a31ca680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-06T13:27:24.001 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:23.997+0000 7f39be409680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-06T13:27:24.037 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:24.034+0000 7f10a58be680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-06T13:27:24.066 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:24.063+0000 7f02a31ca680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-06T13:27:24.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.074+0000 7f0877181700 1 Processor -- start 2023-11-06T13:27:24.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.074+0000 7f0877181700 1 -- start start 2023-11-06T13:27:24.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0877181700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f087017e270 0x7f08701827e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0877181700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0870182cd0 0x7f0870180340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0877181700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0870180830 0x7f0870180ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0877181700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08700c7210 con 0x7f0870182cd0 2023-11-06T13:27:24.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0877181700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08700c74f0 con 0x7f087017e270 2023-11-06T13:27:24.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0877181700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08700c77d0 con 0x7f0870180830 2023-11-06T13:27:24.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f087571e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0870180830 0x7f0870180ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f087571e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0870180830 0x7f0870180ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54776/0 (socket says 172.21.15.163:54776) 2023-11-06T13:27:24.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f087571e700 1 -- 172.21.15.163:0/3682370929 learned_addr learned my addr 172.21.15.163:0/3682370929 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:24.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f0874f1d700 1 --2- 172.21.15.163:0/3682370929 >> v2:172.21.15.44:3300/0 conn(0x7f087017e270 0x7f08701827e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.075+0000 7f086ffff700 1 --2- 172.21.15.163:0/3682370929 >> v2:172.21.15.38:3300/0 conn(0x7f0870182cd0 0x7f0870180340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f087571e700 1 -- 172.21.15.163:0/3682370929 >> v2:172.21.15.44:3300/0 conn(0x7f087017e270 msgr2=0x7f08701827e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:24.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f087571e700 1 --2- 172.21.15.163:0/3682370929 >> v2:172.21.15.44:3300/0 conn(0x7f087017e270 0x7f08701827e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f087571e700 1 -- 172.21.15.163:0/3682370929 >> v2:172.21.15.38:3300/0 conn(0x7f0870182cd0 msgr2=0x7f0870180340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:24.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f087571e700 1 --2- 172.21.15.163:0/3682370929 >> v2:172.21.15.38:3300/0 conn(0x7f0870182cd0 0x7f0870180340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f087571e700 1 -- 172.21.15.163:0/3682370929 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700c7ab0 con 0x7f0870180830 2023-11-06T13:27:24.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f087571e700 1 --2- 172.21.15.163:0/3682370929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f0870180ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0870086130 tx=0x7f0868009840).ready entity=mon.2 client_cookie=6823b9aa62579dda server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f086f7fe700 1 -- 172.21.15.163:0/3682370929 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800e070 con 0x7f0870180830 2023-11-06T13:27:24.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f086f7fe700 1 -- 172.21.15.163:0/3682370929 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800b940 con 0x7f0870180830 2023-11-06T13:27:24.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f086f7fe700 1 -- 172.21.15.163:0/3682370929 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800bcc0 con 0x7f0870180830 2023-11-06T13:27:24.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 -- 172.21.15.163:0/3682370929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 msgr2=0x7f0870180ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 --2- 172.21.15.163:0/3682370929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f0870180ca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0870086130 tx=0x7f0868009840).stop 2023-11-06T13:27:24.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 -- 172.21.15.163:0/3682370929 shutdown_connections 2023-11-06T13:27:24.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 --2- 172.21.15.163:0/3682370929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f0870180ca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 --2- 172.21.15.163:0/3682370929 >> v2:172.21.15.44:3300/0 conn(0x7f087017e270 0x7f08701827e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 --2- 172.21.15.163:0/3682370929 >> v2:172.21.15.38:3300/0 conn(0x7f0870182cd0 0x7f0870180340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.076+0000 7f0877181700 1 -- 172.21.15.163:0/3682370929 >> 172.21.15.163:0/3682370929 conn(0x7f08700f22b0 msgr2=0x7f08700ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.077+0000 7f0877181700 1 -- 172.21.15.163:0/3682370929 shutdown_connections 2023-11-06T13:27:24.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.077+0000 7f0877181700 1 -- 172.21.15.163:0/3682370929 wait complete. 2023-11-06T13:27:24.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.078+0000 7f0877181700 1 Processor -- start 2023-11-06T13:27:24.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.078+0000 7f0877181700 1 -- start start 2023-11-06T13:27:24.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0877181700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f087017e270 0x7f08700f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0877181700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f08700c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0877181700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0870182cd0 0x7f0870175680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0877181700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700f0bc0 con 0x7f087017e270 2023-11-06T13:27:24.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0877181700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08700f1660 con 0x7f0870182cd0 2023-11-06T13:27:24.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0877181700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0870190470 con 0x7f0870180830 2023-11-06T13:27:24.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f08700c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f08700c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54780/0 (socket says 172.21.15.163:54780) 2023-11-06T13:27:24.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 -- 172.21.15.163:0/1520579987 learned_addr learned my addr 172.21.15.163:0/1520579987 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:24.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f0874f1d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f087017e270 0x7f08700f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f087571e700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0870182cd0 0x7f0870175680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 -- 172.21.15.163:0/1520579987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0870182cd0 msgr2=0x7f0870175680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0870182cd0 0x7f0870175680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 -- 172.21.15.163:0/1520579987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f087017e270 msgr2=0x7f08700f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f087017e270 0x7f08700f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.079+0000 7f086ffff700 1 -- 172.21.15.163:0/1520579987 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009ae0 con 0x7f0870180830 2023-11-06T13:27:24.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f086ffff700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f08700c5ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f085c00e930 tx=0x7f085c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c012600 con 0x7f0870180830 2023-11-06T13:27:24.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c012760 con 0x7f0870180830 2023-11-06T13:27:24.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0870190140 con 0x7f0870180830 2023-11-06T13:27:24.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c012ae0 con 0x7f0870180830 2023-11-06T13:27:24.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08700f0dc0 con 0x7f0870180830 2023-11-06T13:27:24.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f085c01b660 con 0x7f0870180830 2023-11-06T13:27:24.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.080+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f085c01a870 con 0x7f0870180830 2023-11-06T13:27:24.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.081+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087006c580 con 0x7f0870180830 2023-11-06T13:27:24.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.085+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f085c016020 con 0x7f0870180830 2023-11-06T13:27:24.106 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:24.104+0000 7f10a58be680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-06T13:27:24.167 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.164+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07f1cee1-e1d2-450d-b9b1-79ef56cd178a", "id": 3} v 0) v1 -- 0x7f08700649b0 con 0x7f0870180830 2023-11-06T13:27:24.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.169+0000 7f086cff9700 1 -- 172.21.15.163:0/1520579987 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07f1cee1-e1d2-450d-b9b1-79ef56cd178a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f085c01baf0 con 0x7f0870180830 2023-11-06T13:27:24.173 INFO:teuthology.orchestra.run.smithi163.stdout:3 2023-11-06T13:27:24.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 msgr2=0x7f08700c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f08700c5ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f085c00e930 tx=0x7f085c009060).stop 2023-11-06T13:27:24.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 shutdown_connections 2023-11-06T13:27:24.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0870182cd0 0x7f0870175680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f087017e270 0x7f08700f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 --2- 172.21.15.163:0/1520579987 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0870180830 0x7f08700c5ad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 >> 172.21.15.163:0/1520579987 conn(0x7f08700f22b0 msgr2=0x7f0870177800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 shutdown_connections 2023-11-06T13:27:24.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.170+0000 7f0877181700 1 -- 172.21.15.163:0/1520579987 wait complete. 2023-11-06T13:27:24.186 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new edf7bf5d-22a4-4cd2-bbfc-d2422221b587 4 2023-11-06T13:27:24.196 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:24.192+0000 7f39be409680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-06T13:27:24.260 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:24.257+0000 7f02a31ca680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-06T13:27:24.301 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:24.298+0000 7f10a58be680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-06T13:27:24.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.306+0000 7f083ac34700 1 Processor -- start 2023-11-06T13:27:24.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.306+0000 7f083ac34700 1 -- start start 2023-11-06T13:27:24.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f083ac34700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0834062770 0x7f0834062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f083ac34700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f083417cbe0 con 0x7f0834178c60 2023-11-06T13:27:24.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f083ac34700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08340640e0 con 0x7f0834179040 2023-11-06T13:27:24.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f083ac34700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0834064370 con 0x7f0834062770 2023-11-06T13:27:24.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08391d1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0834062770 0x7f0834062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08389d0700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0834178c60 0x7f083417d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.163:42350/0 (socket says 172.21.15.163:42350) 2023-11-06T13:27:24.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08389d0700 1 -- 172.21.15.163:0/142914634 learned_addr learned my addr 172.21.15.163:0/142914634 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-11-06T13:27:24.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08337fe700 1 -- 172.21.15.163:0/142914634 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962348954 0 0) 0x7f083417cbe0 con 0x7f0834178c60 2023-11-06T13:27:24.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08337fe700 1 -- 172.21.15.163:0/142914634 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08240033f0 con 0x7f0834178c60 2023-11-06T13:27:24.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08391d1700 1 -- 172.21.15.163:0/142914634 >> v1:172.21.15.44:6789/0 conn(0x7f0834179040 legacy=0x7f083417e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08391d1700 1 -- 172.21.15.163:0/142914634 >> v1:172.21.15.38:6789/0 conn(0x7f0834178c60 legacy=0x7f083417d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08391d1700 1 -- 172.21.15.163:0/142914634 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083417ce80 con 0x7f0834062770 2023-11-06T13:27:24.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.307+0000 7f08391d1700 1 --2- 172.21.15.163:0/142914634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834062770 0x7f0834062be0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f082c009e60 tx=0x7f082c009780).ready entity=mon.1 client_cookie=68c9eb6c9dd84698 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f08337fe700 1 -- 172.21.15.163:0/142914634 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c00e070 con 0x7f0834062770 2023-11-06T13:27:24.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f08337fe700 1 -- 172.21.15.163:0/142914634 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082c00bb60 con 0x7f0834062770 2023-11-06T13:27:24.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f08337fe700 1 -- 172.21.15.163:0/142914634 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082c012410 con 0x7f0834062770 2023-11-06T13:27:24.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 -- 172.21.15.163:0/142914634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834062770 msgr2=0x7f0834062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 --2- 172.21.15.163:0/142914634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834062770 0x7f0834062be0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f082c009e60 tx=0x7f082c009780).stop 2023-11-06T13:27:24.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 -- 172.21.15.163:0/142914634 shutdown_connections 2023-11-06T13:27:24.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 --2- 172.21.15.163:0/142914634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834062770 0x7f0834062be0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 -- 172.21.15.163:0/142914634 >> 172.21.15.163:0/142914634 conn(0x7f08340f5ea0 msgr2=0x7f08340f1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 -- 172.21.15.163:0/142914634 shutdown_connections 2023-11-06T13:27:24.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.308+0000 7f083ac34700 1 -- 172.21.15.163:0/142914634 wait complete. 2023-11-06T13:27:24.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.310+0000 7f083ac34700 1 Processor -- start 2023-11-06T13:27:24.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.310+0000 7f083ac34700 1 -- start start 2023-11-06T13:27:24.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f083ac34700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 0x7f08340cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f083ac34700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834178c60 0x7f0834167640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f083ac34700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0834179040 0x7f083417e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f083ac34700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083416bf40 con 0x7f0834179040 2023-11-06T13:27:24.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f083ac34700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08340ed610 con 0x7f0834178c60 2023-11-06T13:27:24.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f083ac34700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083416b2c0 con 0x7f0834062770 2023-11-06T13:27:24.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 0x7f08340cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 0x7f08340cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54790/0 (socket says 172.21.15.163:54790) 2023-11-06T13:27:24.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 -- 172.21.15.163:0/3202930508 learned_addr learned my addr 172.21.15.163:0/3202930508 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:24.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f0833fff700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834178c60 0x7f0834167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08391d1700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0834179040 0x7f083417e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 -- 172.21.15.163:0/3202930508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834178c60 msgr2=0x7f0834167640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834178c60 0x7f0834167640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 -- 172.21.15.163:0/3202930508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0834179040 msgr2=0x7f083417e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0834179040 0x7f083417e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 -- 172.21.15.163:0/3202930508 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c009a20 con 0x7f0834062770 2023-11-06T13:27:24.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.311+0000 7f08389d0700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 0x7f08340cbe80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f082800c410 tx=0x7f0828007c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280070d0 con 0x7f0834062770 2023-11-06T13:27:24.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828007230 con 0x7f0834062770 2023-11-06T13:27:24.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083416b5a0 con 0x7f0834062770 2023-11-06T13:27:24.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280075f0 con 0x7f0834062770 2023-11-06T13:27:24.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083416bb60 con 0x7f0834062770 2023-11-06T13:27:24.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0828005c10 con 0x7f0834062770 2023-11-06T13:27:24.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.312+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f0828013cf0 con 0x7f0834062770 2023-11-06T13:27:24.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.313+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083406c580 con 0x7f0834062770 2023-11-06T13:27:24.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.315+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f0828018020 con 0x7f0834062770 2023-11-06T13:27:24.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.394+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edf7bf5d-22a4-4cd2-bbfc-d2422221b587", "id": 4} v 0) v1 -- 0x7f083417d160 con 0x7f0834062770 2023-11-06T13:27:24.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.400+0000 7f0830ff9700 1 -- 172.21.15.163:0/3202930508 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edf7bf5d-22a4-4cd2-bbfc-d2422221b587", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f083417d160 con 0x7f0834062770 2023-11-06T13:27:24.404 INFO:teuthology.orchestra.run.smithi163.stdout:4 2023-11-06T13:27:24.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 msgr2=0x7f08340cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 0x7f08340cbe80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f082800c410 tx=0x7f0828007c70).stop 2023-11-06T13:27:24.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 shutdown_connections 2023-11-06T13:27:24.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0834179040 0x7f083417e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0834062770 0x7f08340cbe80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 --2- 172.21.15.163:0/3202930508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0834178c60 0x7f0834167640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 >> 172.21.15.163:0/3202930508 conn(0x7f08340f5ea0 msgr2=0x7f08340c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 shutdown_connections 2023-11-06T13:27:24.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.401+0000 7f083ac34700 1 -- 172.21.15.163:0/3202930508 wait complete. 2023-11-06T13:27:24.417 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new d6273ae2-d646-44f0-ac1f-f8eef352449f 5 2023-11-06T13:27:24.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.528+0000 7fbf8b168700 1 Processor -- start 2023-11-06T13:27:24.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.528+0000 7fbf8b168700 1 -- start start 2023-11-06T13:27:24.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.529+0000 7fbf8b168700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbf84172480 0x7fbf84172860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.529+0000 7fbf8b168700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fbf8417d9f0 0x7fbf840eb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.529+0000 7fbf8b168700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf84084390 con 0x7fbf84083bc0 2023-11-06T13:27:24.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.529+0000 7fbf8b168700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf84084670 con 0x7fbf8417d9f0 2023-11-06T13:27:24.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.529+0000 7fbf8b168700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf84084950 con 0x7fbf84172480 2023-11-06T13:27:24.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbf84172480 0x7fbf84172860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbf84172480 0x7fbf84172860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54796/0 (socket says 172.21.15.163:54796) 2023-11-06T13:27:24.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 -- 172.21.15.163:0/3819914255 learned_addr learned my addr 172.21.15.163:0/3819914255 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:24.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf89705700 1 --2- 172.21.15.163:0/3819914255 >> v2:172.21.15.38:3300/0 conn(0x7fbf8417d9f0 0x7fbf840eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 -- 172.21.15.163:0/3819914255 >> v2:172.21.15.38:3300/0 conn(0x7fbf8417d9f0 msgr2=0x7fbf840eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:24.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 --2- 172.21.15.163:0/3819914255 >> v2:172.21.15.38:3300/0 conn(0x7fbf8417d9f0 0x7fbf840eb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 -- 172.21.15.163:0/3819914255 >> v1:172.21.15.44:6789/0 conn(0x7fbf84083bc0 legacy=0x7fbf8417d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 -- 172.21.15.163:0/3819914255 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84084c30 con 0x7fbf84172480 2023-11-06T13:27:24.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf88f04700 1 --2- 172.21.15.163:0/3819914255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84172480 0x7fbf84172860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fbf840c4280 tx=0x7fbf7800b3b0).ready entity=mon.2 client_cookie=4e3dbd7935cf06d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf837fe700 1 -- 172.21.15.163:0/3819914255 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800da40 con 0x7fbf84172480 2023-11-06T13:27:24.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf837fe700 1 -- 172.21.15.163:0/3819914255 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7800dba0 con 0x7fbf84172480 2023-11-06T13:27:24.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.530+0000 7fbf837fe700 1 -- 172.21.15.163:0/3819914255 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78010470 con 0x7fbf84172480 2023-11-06T13:27:24.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 -- 172.21.15.163:0/3819914255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84172480 msgr2=0x7fbf84172860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 --2- 172.21.15.163:0/3819914255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84172480 0x7fbf84172860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fbf840c4280 tx=0x7fbf7800b3b0).stop 2023-11-06T13:27:24.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 -- 172.21.15.163:0/3819914255 shutdown_connections 2023-11-06T13:27:24.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 --2- 172.21.15.163:0/3819914255 >> v2:172.21.15.38:3300/0 conn(0x7fbf8417d9f0 0x7fbf840eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 --2- 172.21.15.163:0/3819914255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84172480 0x7fbf84172860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 -- 172.21.15.163:0/3819914255 >> 172.21.15.163:0/3819914255 conn(0x7fbf840ef620 msgr2=0x7fbf8405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 -- 172.21.15.163:0/3819914255 shutdown_connections 2023-11-06T13:27:24.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.531+0000 7fbf8b168700 1 -- 172.21.15.163:0/3819914255 wait complete. 2023-11-06T13:27:24.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.532+0000 7fbf8b168700 1 Processor -- start 2023-11-06T13:27:24.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.532+0000 7fbf8b168700 1 -- start start 2023-11-06T13:27:24.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf8b168700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 0x7fbf84179820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf8b168700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf84172480 0x7fbf8416a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf8b168700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf8417d9f0 0x7fbf84177b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf8b168700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8417ae70 con 0x7fbf8417d9f0 2023-11-06T13:27:24.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf8b168700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84179d10 con 0x7fbf84172480 2023-11-06T13:27:24.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf8b168700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8416a9b0 con 0x7fbf84083bc0 2023-11-06T13:27:24.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.533+0000 7fbf88f04700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 0x7fbf84179820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 0x7fbf84179820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54800/0 (socket says 172.21.15.163:54800) 2023-11-06T13:27:24.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 -- 172.21.15.163:0/2876364185 learned_addr learned my addr 172.21.15.163:0/2876364185 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:24.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf83fff700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf84172480 0x7fbf8416a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf89705700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf8417d9f0 0x7fbf84177b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 -- 172.21.15.163:0/2876364185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf84172480 msgr2=0x7fbf8416a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf84172480 0x7fbf8416a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 -- 172.21.15.163:0/2876364185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf8417d9f0 msgr2=0x7fbf84177b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf8417d9f0 0x7fbf84177b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 -- 172.21.15.163:0/2876364185 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7800b610 con 0x7fbf84083bc0 2023-11-06T13:27:24.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf88f04700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 0x7fbf84179820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbf78006fd0 tx=0x7fbf7800b3b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78020070 con 0x7fbf84083bc0 2023-11-06T13:27:24.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78006910 con 0x7fbf84083bc0 2023-11-06T13:27:24.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf84179f80 con 0x7fbf84083bc0 2023-11-06T13:27:24.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78019680 con 0x7fbf84083bc0 2023-11-06T13:27:24.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8417a540 con 0x7fbf84083bc0 2023-11-06T13:27:24.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fbf78019c90 con 0x7fbf84083bc0 2023-11-06T13:27:24.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.534+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fbf78025dd0 con 0x7fbf84083bc0 2023-11-06T13:27:24.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.535+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf841777c0 con 0x7fbf84083bc0 2023-11-06T13:27:24.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.537+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fbf78044e50 con 0x7fbf84083bc0 2023-11-06T13:27:24.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.616+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6273ae2-d646-44f0-ac1f-f8eef352449f", "id": 5} v 0) v1 -- 0x7fbf8406c580 con 0x7fbf84083bc0 2023-11-06T13:27:24.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.620+0000 7fbf80ff9700 1 -- 172.21.15.163:0/2876364185 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6273ae2-d646-44f0-ac1f-f8eef352449f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf78033070 con 0x7fbf84083bc0 2023-11-06T13:27:24.624 INFO:teuthology.orchestra.run.smithi163.stdout:5 2023-11-06T13:27:24.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 msgr2=0x7fbf84179820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 0x7fbf84179820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fbf78006fd0 tx=0x7fbf7800b3b0).stop 2023-11-06T13:27:24.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 shutdown_connections 2023-11-06T13:27:24.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbf8417d9f0 0x7fbf84177b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbf84083bc0 0x7fbf84179820 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 --2- 172.21.15.163:0/2876364185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf84172480 0x7fbf8416a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 >> 172.21.15.163:0/2876364185 conn(0x7fbf840ef620 msgr2=0x7fbf840eb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 shutdown_connections 2023-11-06T13:27:24.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.621+0000 7fbf8b168700 1 -- 172.21.15.163:0/2876364185 wait complete. 2023-11-06T13:27:24.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 324af172-8b41-451b-95b8-85fc8525db70 6 2023-11-06T13:27:24.654 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:24.650+0000 7f39be409680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-06T13:27:24.715 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:24.712+0000 7f02a31ca680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-06T13:27:24.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.746+0000 7fdb72fed700 1 Processor -- start 2023-11-06T13:27:24.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.746+0000 7fdb72fed700 1 -- start start 2023-11-06T13:27:24.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb72fed700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb6c178e50 0x7fdb6c17e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb72fed700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c17dc00 con 0x7fdb6c178a70 2023-11-06T13:27:24.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb72fed700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c17cd10 con 0x7fdb6c17e580 2023-11-06T13:27:24.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb72fed700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c17cff0 con 0x7fdb6c178e50 2023-11-06T13:27:24.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb7158a700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fdb6c17e580 0x7fdb6c185670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:33386/0 (socket says 172.21.15.163:33386) 2023-11-06T13:27:24.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb7158a700 1 -- 172.21.15.163:0/1025417587 learned_addr learned my addr 172.21.15.163:0/1025417587 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-11-06T13:27:24.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6bfff700 1 --2- 172.21.15.163:0/1025417587 >> v2:172.21.15.38:3300/0 conn(0x7fdb6c178e50 0x7fdb6c17e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155900179 0 0) 0x7fdb6c17cd10 con 0x7fdb6c17e580 2023-11-06T13:27:24.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5c0033f0 con 0x7fdb6c17e580 2023-11-06T13:27:24.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239197441 0 0) 0x7fdb6c17dc00 con 0x7fdb6c178a70 2023-11-06T13:27:24.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c17cd10 con 0x7fdb6c178a70 2023-11-06T13:27:24.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6bfff700 1 -- 172.21.15.163:0/1025417587 >> v1:172.21.15.163:6789/0 conn(0x7fdb6c17e580 legacy=0x7fdb6c185670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6bfff700 1 -- 172.21.15.163:0/1025417587 >> v1:172.21.15.44:6789/0 conn(0x7fdb6c178a70 legacy=0x7fdb6c064150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6bfff700 1 -- 172.21.15.163:0/1025417587 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c17d2d0 con 0x7fdb6c178e50 2023-11-06T13:27:24.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.747+0000 7fdb6bfff700 1 --2- 172.21.15.163:0/1025417587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178e50 0x7fdb6c17e090 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fdb58009760 tx=0x7fdb58009060).ready entity=mon.0 client_cookie=8b1439310d1ef55e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800d4a0 con 0x7fdb6c178e50 2023-11-06T13:27:24.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5800d600 con 0x7fdb6c178e50 2023-11-06T13:27:24.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb6b7fe700 1 -- 172.21.15.163:0/1025417587 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800d980 con 0x7fdb6c178e50 2023-11-06T13:27:24.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 -- 172.21.15.163:0/1025417587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178e50 msgr2=0x7fdb6c17e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 --2- 172.21.15.163:0/1025417587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178e50 0x7fdb6c17e090 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fdb58009760 tx=0x7fdb58009060).stop 2023-11-06T13:27:24.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 -- 172.21.15.163:0/1025417587 shutdown_connections 2023-11-06T13:27:24.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 --2- 172.21.15.163:0/1025417587 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178e50 0x7fdb6c17e090 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 -- 172.21.15.163:0/1025417587 >> 172.21.15.163:0/1025417587 conn(0x7fdb6c069ea0 msgr2=0x7fdb6c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 -- 172.21.15.163:0/1025417587 shutdown_connections 2023-11-06T13:27:24.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.748+0000 7fdb72fed700 1 -- 172.21.15.163:0/1025417587 wait complete. 2023-11-06T13:27:24.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.749+0000 7fdb72fed700 1 Processor -- start 2023-11-06T13:27:24.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.750+0000 7fdb72fed700 1 -- start start 2023-11-06T13:27:24.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178a70 0x7fdb6c166120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb6c178e50 0x7fdb6c0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 0x7fdb6c0ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:24.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c18fb70 con 0x7fdb6c178a70 2023-11-06T13:27:24.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c166610 con 0x7fdb6c178e50 2023-11-06T13:27:24.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c18ef30 con 0x7fdb6c17e580 2023-11-06T13:27:24.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 0x7fdb6c0ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 0x7fdb6c0ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54816/0 (socket says 172.21.15.163:54816) 2023-11-06T13:27:24.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 -- 172.21.15.163:0/1403456356 learned_addr learned my addr 172.21.15.163:0/1403456356 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:24.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb6bfff700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb6c178e50 0x7fdb6c0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb70d89700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178a70 0x7fdb6c166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:24.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 -- 172.21.15.163:0/1403456356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb6c178e50 msgr2=0x7fdb6c0c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb6c178e50 0x7fdb6c0c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 -- 172.21.15.163:0/1403456356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178a70 msgr2=0x7fdb6c166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178a70 0x7fdb6c166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 -- 172.21.15.163:0/1403456356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580092a0 con 0x7fdb6c17e580 2023-11-06T13:27:24.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb6bfff700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb6c178e50 0x7fdb6c0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:27:24.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb7158a700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 0x7fdb6c0ca4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fdb64001560 tx=0x7fdb640015b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:24.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005d30 con 0x7fdb6c17e580 2023-11-06T13:27:24.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64005e90 con 0x7fdb6c17e580 2023-11-06T13:27:24.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c18f1d0 con 0x7fdb6c17e580 2023-11-06T13:27:24.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64007300 con 0x7fdb6c17e580 2023-11-06T13:27:24.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.751+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c18f790 con 0x7fdb6c17e580 2023-11-06T13:27:24.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.752+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fdb64013450 con 0x7fdb6c17e580 2023-11-06T13:27:24.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.752+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fdb64007910 con 0x7fdb6c17e580 2023-11-06T13:27:24.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.752+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c18fcb0 con 0x7fdb6c17e580 2023-11-06T13:27:24.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.755+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fdb6c18fcb0 con 0x7fdb6c17e580 2023-11-06T13:27:24.767 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:24.756+0000 7f10a58be680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-06T13:27:24.767 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:24.758+0000 7f39be409680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-06T13:27:24.822 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:24.819+0000 7f02a31ca680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-06T13:27:24.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.832+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "324af172-8b41-451b-95b8-85fc8525db70", "id": 6} v 0) v1 -- 0x7fdb6c06c580 con 0x7fdb6c17e580 2023-11-06T13:27:24.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.838+0000 7fdb68ff9700 1 -- 172.21.15.163:0/1403456356 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "324af172-8b41-451b-95b8-85fc8525db70", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb64018070 con 0x7fdb6c17e580 2023-11-06T13:27:24.841 INFO:teuthology.orchestra.run.smithi163.stdout:6 2023-11-06T13:27:24.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 msgr2=0x7fdb6c0ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:24.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 0x7fdb6c0ca4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fdb64001560 tx=0x7fdb640015b0).stop 2023-11-06T13:27:24.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 shutdown_connections 2023-11-06T13:27:24.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb6c17e580 0x7fdb6c0ca4e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb6c178a70 0x7fdb6c166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 --2- 172.21.15.163:0/1403456356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb6c178e50 0x7fdb6c0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:24.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 >> 172.21.15.163:0/1403456356 conn(0x7fdb6c069ea0 msgr2=0x7fdb6c064150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:24.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 shutdown_connections 2023-11-06T13:27:24.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:24.839+0000 7fdb72fed700 1 -- 172.21.15.163:0/1403456356 wait complete. 2023-11-06T13:27:24.855 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 110ee541-83b3-4e88-a815-3aeef680ebd8 7 2023-11-06T13:27:24.867 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:24.864+0000 7f10a58be680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-06T13:27:24.920 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:24.917+0000 7f39be409680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-06T13:27:24.979 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:24.976+0000 7f02a31ca680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-06T13:27:24.998 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:24.995+0000 7f39be409680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-06T13:27:25.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.005+0000 7fea5800a700 1 Processor -- start 2023-11-06T13:27:25.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.005+0000 7fea5800a700 1 -- start start 2023-11-06T13:27:25.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.006+0000 7fea5800a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fea50175540 0x7fea50182d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea5800a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fea50175920 0x7fea500cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea5800a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fea5017e4d0 0x7fea5017c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea5800a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5017e040 con 0x7fea50175920 2023-11-06T13:27:25.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea5800a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5017d150 con 0x7fea50175540 2023-11-06T13:27:25.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea5800a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5017d430 con 0x7fea5017e4d0 2023-11-06T13:27:25.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fea5017e4d0 0x7fea5017c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fea5017e4d0 0x7fea5017c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54820/0 (socket says 172.21.15.163:54820) 2023-11-06T13:27:25.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 -- 172.21.15.163:0/164093610 learned_addr learned my addr 172.21.15.163:0/164093610 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea555a5700 1 --2- 172.21.15.163:0/164093610 >> v2:172.21.15.38:3300/0 conn(0x7fea50175920 0x7fea500cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea55da6700 1 --2- 172.21.15.163:0/164093610 >> v2:172.21.15.44:3300/0 conn(0x7fea50175540 0x7fea50182d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 -- 172.21.15.163:0/164093610 >> v2:172.21.15.44:3300/0 conn(0x7fea50175540 msgr2=0x7fea50182d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:25.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 --2- 172.21.15.163:0/164093610 >> v2:172.21.15.44:3300/0 conn(0x7fea50175540 0x7fea50182d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 -- 172.21.15.163:0/164093610 >> v2:172.21.15.38:3300/0 conn(0x7fea50175920 msgr2=0x7fea500cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:25.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 --2- 172.21.15.163:0/164093610 >> v2:172.21.15.38:3300/0 conn(0x7fea50175920 0x7fea500cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 -- 172.21.15.163:0/164093610 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5017d710 con 0x7fea5017e4d0 2023-11-06T13:27:25.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea565a7700 1 --2- 172.21.15.163:0/164093610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea5017e4d0 0x7fea5017c810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fea500f1d60 tx=0x7fea48009840).ready entity=mon.2 client_cookie=56d8e2f216d6dce server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea54da4700 1 -- 172.21.15.163:0/164093610 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800e070 con 0x7fea5017e4d0 2023-11-06T13:27:25.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea54da4700 1 -- 172.21.15.163:0/164093610 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4800b940 con 0x7fea5017e4d0 2023-11-06T13:27:25.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.007+0000 7fea54da4700 1 -- 172.21.15.163:0/164093610 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800bcc0 con 0x7fea5017e4d0 2023-11-06T13:27:25.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 -- 172.21.15.163:0/164093610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea5017e4d0 msgr2=0x7fea5017c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 --2- 172.21.15.163:0/164093610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea5017e4d0 0x7fea5017c810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fea500f1d60 tx=0x7fea48009840).stop 2023-11-06T13:27:25.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 -- 172.21.15.163:0/164093610 shutdown_connections 2023-11-06T13:27:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 --2- 172.21.15.163:0/164093610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea5017e4d0 0x7fea5017c810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 --2- 172.21.15.163:0/164093610 >> v2:172.21.15.44:3300/0 conn(0x7fea50175540 0x7fea50182d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 --2- 172.21.15.163:0/164093610 >> v2:172.21.15.38:3300/0 conn(0x7fea50175920 0x7fea500cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 -- 172.21.15.163:0/164093610 >> 172.21.15.163:0/164093610 conn(0x7fea500f53b0 msgr2=0x7fea500f57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 -- 172.21.15.163:0/164093610 shutdown_connections 2023-11-06T13:27:25.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.008+0000 7fea5800a700 1 -- 172.21.15.163:0/164093610 wait complete. 2023-11-06T13:27:25.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.009+0000 7fea5800a700 1 Processor -- start 2023-11-06T13:27:25.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.009+0000 7fea5800a700 1 -- start start 2023-11-06T13:27:25.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea5800a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 0x7fea500c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea5800a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea50175920 0x7fea5016e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea5800a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea5017e4d0 0x7fea5016ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea5800a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501903e0 con 0x7fea50175920 2023-11-06T13:27:25.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea5800a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5017c190 con 0x7fea5017e4d0 2023-11-06T13:27:25.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea5800a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5017b610 con 0x7fea50175540 2023-11-06T13:27:25.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea55da6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 0x7fea500c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea55da6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 0x7fea500c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54822/0 (socket says 172.21.15.163:54822) 2023-11-06T13:27:25.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.010+0000 7fea55da6700 1 -- 172.21.15.163:0/1690886024 learned_addr learned my addr 172.21.15.163:0/1690886024 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea555a5700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea50175920 0x7fea5016e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea565a7700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea5017e4d0 0x7fea5016ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea55da6700 1 -- 172.21.15.163:0/1690886024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea5017e4d0 msgr2=0x7fea5016ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea55da6700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea5017e4d0 0x7fea5016ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea55da6700 1 -- 172.21.15.163:0/1690886024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea50175920 msgr2=0x7fea5016e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea55da6700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea50175920 0x7fea5016e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea55da6700 1 -- 172.21.15.163:0/1690886024 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48009ae0 con 0x7fea50175540 2023-11-06T13:27:25.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea55da6700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 0x7fea500c90d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fea4000e980 tx=0x7fea40009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40009530 con 0x7fea50175540 2023-11-06T13:27:25.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40012600 con 0x7fea50175540 2023-11-06T13:27:25.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5017b8f0 con 0x7fea50175540 2023-11-06T13:27:25.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea40012980 con 0x7fea50175540 2023-11-06T13:27:25.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fea4001b400 con 0x7fea50175540 2023-11-06T13:27:25.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5017beb0 con 0x7fea50175540 2023-11-06T13:27:25.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.011+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fea4001b930 con 0x7fea50175540 2023-11-06T13:27:25.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.012+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5006c580 con 0x7fea50175540 2023-11-06T13:27:25.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.014+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fea40016020 con 0x7fea50175540 2023-11-06T13:27:25.026 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:25.022+0000 7f10a58be680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-06T13:27:25.059 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:25.056+0000 7f02a31ca680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-06T13:27:25.070 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:25.067+0000 7f39be409680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-06T13:27:25.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.093+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "110ee541-83b3-4e88-a815-3aeef680ebd8", "id": 7} v 0) v1 -- 0x7fea500c47c0 con 0x7fea50175540 2023-11-06T13:27:25.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.098+0000 7fea45ffb700 1 -- 172.21.15.163:0/1690886024 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "110ee541-83b3-4e88-a815-3aeef680ebd8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fea40025480 con 0x7fea50175540 2023-11-06T13:27:25.101 INFO:teuthology.orchestra.run.smithi163.stdout:7 2023-11-06T13:27:25.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 msgr2=0x7fea500c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 0x7fea500c90d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fea4000e980 tx=0x7fea40009060).stop 2023-11-06T13:27:25.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 shutdown_connections 2023-11-06T13:27:25.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea5017e4d0 0x7fea5016ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fea50175540 0x7fea500c90d0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0x7fea4000e980 tx=0x7fea40009060).stop 2023-11-06T13:27:25.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 --2- 172.21.15.163:0/1690886024 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fea50175920 0x7fea5016e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 >> 172.21.15.163:0/1690886024 conn(0x7fea500f53b0 msgr2=0x7fea5017c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 shutdown_connections 2023-11-06T13:27:25.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.099+0000 7fea5800a700 1 -- 172.21.15.163:0/1690886024 wait complete. 2023-11-06T13:27:25.105 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:25.102+0000 7f10a58be680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-06T13:27:25.114 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 03b86b1b-6b0e-441a-a3b8-6164aa1e2f06 8 2023-11-06T13:27:25.130 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:25.128+0000 7f02a31ca680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-06T13:27:25.178 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:25.175+0000 7f10a58be680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-06T13:27:25.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.262+0000 7ff87d7a7700 1 Processor -- start 2023-11-06T13:27:25.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.262+0000 7ff87d7a7700 1 -- start start 2023-11-06T13:27:25.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff87d7a7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff878175890 0x7ff8780f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff87d7a7700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff8780cb960 0x7ff87817e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff87d7a7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87817e250 con 0x7ff87817cac0 2023-11-06T13:27:25.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff87d7a7700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87817d360 con 0x7ff8780cb960 2023-11-06T13:27:25.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff87d7a7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87817d640 con 0x7ff878175890 2023-11-06T13:27:25.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff877fff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff878175890 0x7ff8780f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff877fff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff878175890 0x7ff8780f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54828/0 (socket says 172.21.15.163:54828) 2023-11-06T13:27:25.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.263+0000 7ff877fff700 1 -- 172.21.15.163:0/634961714 learned_addr learned my addr 172.21.15.163:0/634961714 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff8777fe700 1 --2- 172.21.15.163:0/634961714 >> v2:172.21.15.38:3300/0 conn(0x7ff8780cb960 0x7ff87817e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff877fff700 1 -- 172.21.15.163:0/634961714 >> v2:172.21.15.38:3300/0 conn(0x7ff8780cb960 msgr2=0x7ff87817e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:25.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff877fff700 1 --2- 172.21.15.163:0/634961714 >> v2:172.21.15.38:3300/0 conn(0x7ff8780cb960 0x7ff87817e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff877fff700 1 -- 172.21.15.163:0/634961714 >> v1:172.21.15.38:6789/0 conn(0x7ff87817cac0 legacy=0x7ff878182420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff877fff700 1 -- 172.21.15.163:0/634961714 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87817d920 con 0x7ff878175890 2023-11-06T13:27:25.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff877fff700 1 --2- 172.21.15.163:0/634961714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780f10d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff8780894b0 tx=0x7ff86c0090f0).ready entity=mon.2 client_cookie=1529832edc214ff2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff876ffd700 1 -- 172.21.15.163:0/634961714 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00b520 con 0x7ff878175890 2023-11-06T13:27:25.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff876ffd700 1 -- 172.21.15.163:0/634961714 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00b680 con 0x7ff878175890 2023-11-06T13:27:25.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff876ffd700 1 -- 172.21.15.163:0/634961714 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00ba00 con 0x7ff878175890 2023-11-06T13:27:25.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff87d7a7700 1 -- 172.21.15.163:0/634961714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 msgr2=0x7ff8780f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/634961714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780f10d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff8780894b0 tx=0x7ff86c0090f0).stop 2023-11-06T13:27:25.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.264+0000 7ff87d7a7700 1 -- 172.21.15.163:0/634961714 shutdown_connections 2023-11-06T13:27:25.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.265+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/634961714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780f10d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.265+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/634961714 >> v2:172.21.15.38:3300/0 conn(0x7ff8780cb960 0x7ff87817e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.265+0000 7ff87d7a7700 1 -- 172.21.15.163:0/634961714 >> 172.21.15.163:0/634961714 conn(0x7ff8780f5d20 msgr2=0x7ff8780f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.265+0000 7ff87d7a7700 1 -- 172.21.15.163:0/634961714 shutdown_connections 2023-11-06T13:27:25.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.265+0000 7ff87d7a7700 1 -- 172.21.15.163:0/634961714 wait complete. 2023-11-06T13:27:25.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.266+0000 7ff87d7a7700 1 Processor -- start 2023-11-06T13:27:25.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.266+0000 7ff87d7a7700 1 -- start start 2023-11-06T13:27:25.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87d7a7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8780cb960 0x7ff878157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87d7a7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87d7a7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87817cac0 0x7ff8780c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87d7a7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87816f7f0 con 0x7ff8780cb960 2023-11-06T13:27:25.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87d7a7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780c6a60 con 0x7ff87817cac0 2023-11-06T13:27:25.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87d7a7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780c64a0 con 0x7ff878175890 2023-11-06T13:27:25.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff8777fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff8777fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54836/0 (socket says 172.21.15.163:54836) 2023-11-06T13:27:25.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff877fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8780cb960 0x7ff878157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff8777fe700 1 -- 172.21.15.163:0/4149856073 learned_addr learned my addr 172.21.15.163:0/4149856073 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.267+0000 7ff87cfa6700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87817cac0 0x7ff8780c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff8777fe700 1 -- 172.21.15.163:0/4149856073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87817cac0 msgr2=0x7ff8780c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff8777fe700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87817cac0 0x7ff8780c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff8777fe700 1 -- 172.21.15.163:0/4149856073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8780cb960 msgr2=0x7ff878157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff8777fe700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8780cb960 0x7ff878157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff8777fe700 1 -- 172.21.15.163:0/4149856073 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009370 con 0x7ff878175890 2023-11-06T13:27:25.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff877fff700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8780cb960 0x7ff878157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:27:25.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff87cfa6700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87817cac0 0x7ff8780c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:25.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff8777fe700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780c5960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff86800e900 tx=0x7ff868009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680093b0 con 0x7ff878175890 2023-11-06T13:27:25.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868012600 con 0x7ff878175890 2023-11-06T13:27:25.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8780c6780 con 0x7ff878175890 2023-11-06T13:27:25.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868012980 con 0x7ff878175890 2023-11-06T13:27:25.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff878166fc0 con 0x7ff878175890 2023-11-06T13:27:25.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff86801b400 con 0x7ff878175890 2023-11-06T13:27:25.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.268+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7ff86801aab0 con 0x7ff878175890 2023-11-06T13:27:25.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.269+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8780475a0 con 0x7ff878175890 2023-11-06T13:27:25.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.271+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff86803ae50 con 0x7ff878175890 2023-11-06T13:27:25.349 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:25.346+0000 7f39be409680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-06T13:27:25.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.361+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "03b86b1b-6b0e-441a-a3b8-6164aa1e2f06", "id": 8} v 0) v1 -- 0x7ff87817dc00 con 0x7ff878175890 2023-11-06T13:27:25.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.364+0000 7ff85ffff700 1 -- 172.21.15.163:0/4149856073 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03b86b1b-6b0e-441a-a3b8-6164aa1e2f06", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff868029030 con 0x7ff878175890 2023-11-06T13:27:25.368 INFO:teuthology.orchestra.run.smithi163.stdout:8 2023-11-06T13:27:25.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 msgr2=0x7ff8780c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780c5960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff86800e900 tx=0x7ff868009060).stop 2023-11-06T13:27:25.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 shutdown_connections 2023-11-06T13:27:25.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff87817cac0 0x7ff8780c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff8780cb960 0x7ff878157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 --2- 172.21.15.163:0/4149856073 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff878175890 0x7ff8780c5960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 >> 172.21.15.163:0/4149856073 conn(0x7ff8780f5d20 msgr2=0x7ff8780cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 shutdown_connections 2023-11-06T13:27:25.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.365+0000 7ff87d7a7700 1 -- 172.21.15.163:0/4149856073 wait complete. 2023-11-06T13:27:25.380 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new b523c4f6-8029-4e95-8c2f-b0899cf5f730 9 2023-11-06T13:27:25.406 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:25.404+0000 7f02a31ca680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-06T13:27:25.457 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:25.454+0000 7f10a58be680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-06T13:27:25.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.494+0000 7f6284434700 1 Processor -- start 2023-11-06T13:27:25.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.494+0000 7f6284434700 1 -- start start 2023-11-06T13:27:25.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f6284434700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f627c0638a0 0x7f627c063cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f6284434700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0c7220 con 0x7f627c180440 2023-11-06T13:27:25.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f6284434700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0c7500 con 0x7f627c15ac10 2023-11-06T13:27:25.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f6284434700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c15aff0 con 0x7f627c0638a0 2023-11-06T13:27:25.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62821d0700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f627c15ac10 0x7f627c17f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:33416/0 (socket says 172.21.15.163:33416) 2023-11-06T13:27:25.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62821d0700 1 -- 172.21.15.163:0/3358408415 learned_addr learned my addr 172.21.15.163:0/3358408415 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-11-06T13:27:25.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62829d1700 1 --2- 172.21.15.163:0/3358408415 >> v2:172.21.15.38:3300/0 conn(0x7f627c0638a0 0x7f627c063cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652649527 0 0) 0x7f627c0c7500 con 0x7f627c15ac10 2023-11-06T13:27:25.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62680033f0 con 0x7f627c15ac10 2023-11-06T13:27:25.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57122818 0 0) 0x7f627c0c7220 con 0x7f627c180440 2023-11-06T13:27:25.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c0c7500 con 0x7f627c180440 2023-11-06T13:27:25.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62829d1700 1 -- 172.21.15.163:0/3358408415 >> v1:172.21.15.163:6789/0 conn(0x7f627c15ac10 legacy=0x7f627c17f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62829d1700 1 -- 172.21.15.163:0/3358408415 >> v1:172.21.15.38:6789/0 conn(0x7f627c180440 legacy=0x7f627c1808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62829d1700 1 -- 172.21.15.163:0/3358408415 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0c77e0 con 0x7f627c0638a0 2023-11-06T13:27:25.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62829d1700 1 --2- 172.21.15.163:0/3358408415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c0638a0 0x7f627c063cf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6274009e60 tx=0x7f6274009780).ready entity=mon.0 client_cookie=3a998ba402d808d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400e070 con 0x7f627c0638a0 2023-11-06T13:27:25.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627400bab0 con 0x7f627c0638a0 2023-11-06T13:27:25.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.496+0000 7f62811ce700 1 -- 172.21.15.163:0/3358408415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400be30 con 0x7f627c0638a0 2023-11-06T13:27:25.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 -- 172.21.15.163:0/3358408415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c0638a0 msgr2=0x7f627c063cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 --2- 172.21.15.163:0/3358408415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c0638a0 0x7f627c063cf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f6274009e60 tx=0x7f6274009780).stop 2023-11-06T13:27:25.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 -- 172.21.15.163:0/3358408415 shutdown_connections 2023-11-06T13:27:25.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 --2- 172.21.15.163:0/3358408415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c0638a0 0x7f627c063cf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 -- 172.21.15.163:0/3358408415 >> 172.21.15.163:0/3358408415 conn(0x7f627c0ee290 msgr2=0x7f627c0ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 -- 172.21.15.163:0/3358408415 shutdown_connections 2023-11-06T13:27:25.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.497+0000 7f6284434700 1 -- 172.21.15.163:0/3358408415 wait complete. 2023-11-06T13:27:25.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.499+0000 7f6284434700 1 Processor -- start 2023-11-06T13:27:25.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.499+0000 7f6284434700 1 -- start start 2023-11-06T13:27:25.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627c0638a0 0x7f627c175700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c15ac10 0x7f627c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 0x7f627c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c175bf0 con 0x7f627c15ac10 2023-11-06T13:27:25.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c191ff0 con 0x7f627c0638a0 2023-11-06T13:27:25.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c192e50 con 0x7f627c180440 2023-11-06T13:27:25.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 0x7f627c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 0x7f627c152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54850/0 (socket says 172.21.15.163:54850) 2023-11-06T13:27:25.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 -- 172.21.15.163:0/310324335 learned_addr learned my addr 172.21.15.163:0/310324335 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62819cf700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c15ac10 0x7f627c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62821d0700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627c0638a0 0x7f627c175700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 -- 172.21.15.163:0/310324335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627c0638a0 msgr2=0x7f627c175700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627c0638a0 0x7f627c175700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 -- 172.21.15.163:0/310324335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c15ac10 msgr2=0x7f627c153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c15ac10 0x7f627c153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 -- 172.21.15.163:0/310324335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274009a20 con 0x7f627c180440 2023-11-06T13:27:25.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62821d0700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627c0638a0 0x7f627c175700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:25.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62829d1700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 0x7f627c152a80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f627c085cb0 tx=0x7f6274009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62740070e0 con 0x7f627c180440 2023-11-06T13:27:25.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627401d5a0 con 0x7f627c180440 2023-11-06T13:27:25.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c192240 con 0x7f627c180440 2023-11-06T13:27:25.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627401d920 con 0x7f627c180440 2023-11-06T13:27:25.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.500+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c192800 con 0x7f627c180440 2023-11-06T13:27:25.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.501+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f6274003040 con 0x7f627c180440 2023-11-06T13:27:25.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.501+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7f6274028d10 con 0x7f627c180440 2023-11-06T13:27:25.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.501+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c1527a0 con 0x7f627c180440 2023-11-06T13:27:25.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.506+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f627c1527a0 con 0x7f627c180440 2023-11-06T13:27:25.553 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:25.549+0000 7f39be409680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-06T13:27:25.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.584+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b523c4f6-8029-4e95-8c2f-b0899cf5f730", "id": 9} v 0) v1 -- 0x7f627c06c580 con 0x7f627c180440 2023-11-06T13:27:25.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.590+0000 7f62727fc700 1 -- 172.21.15.163:0/310324335 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b523c4f6-8029-4e95-8c2f-b0899cf5f730", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6274017070 con 0x7f627c180440 2023-11-06T13:27:25.593 INFO:teuthology.orchestra.run.smithi163.stdout:9 2023-11-06T13:27:25.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 msgr2=0x7f627c152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 0x7f627c152a80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f627c085cb0 tx=0x7f6274009780).stop 2023-11-06T13:27:25.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 shutdown_connections 2023-11-06T13:27:25.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f627c180440 0x7f627c152a80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627c0638a0 0x7f627c175700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 --2- 172.21.15.163:0/310324335 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f627c15ac10 0x7f627c153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 >> 172.21.15.163:0/310324335 conn(0x7f627c0ee290 msgr2=0x7f627c0f0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 shutdown_connections 2023-11-06T13:27:25.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.591+0000 7f6284434700 1 -- 172.21.15.163:0/310324335 wait complete. 2023-11-06T13:27:25.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new b6b05e5a-2758-4224-9cdb-3abf69fc3124 10 2023-11-06T13:27:25.608 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:25.605+0000 7f02a31ca680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-06T13:27:25.659 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:25.657+0000 7f10a58be680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-06T13:27:25.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.715+0000 7fcb1c832700 1 Processor -- start 2023-11-06T13:27:25.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.715+0000 7fcb1c832700 1 -- start start 2023-11-06T13:27:25.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb1c832700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb18175890 0x7fcb180f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb1c832700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1817e250 con 0x7fcb180cb960 2023-11-06T13:27:25.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb1c832700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1817d360 con 0x7fcb1817cac0 2023-11-06T13:27:25.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb1c832700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1817d640 con 0x7fcb18175890 2023-11-06T13:27:25.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb16d9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fcb18175890 0x7fcb180f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb1759e700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fcb1817cac0 0x7fcb181857a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:33428/0 (socket says 172.21.15.163:33428) 2023-11-06T13:27:25.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb1759e700 1 -- 172.21.15.163:0/3256930012 learned_addr learned my addr 172.21.15.163:0/3256930012 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-11-06T13:27:25.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3256930012 >> v1:172.21.15.163:6789/0 conn(0x7fcb1817cac0 legacy=0x7fcb181857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3256930012 >> v1:172.21.15.44:6789/0 conn(0x7fcb180cb960 legacy=0x7fcb1817e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.716+0000 7fcb15d9b700 1 -- 172.21.15.163:0/3256930012 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686428742 0 0) 0x7fcb1817d360 con 0x7fcb1817cac0 2023-11-06T13:27:25.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3256930012 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1817d920 con 0x7fcb18175890 2023-11-06T13:27:25.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb16d9d700 1 --2- 172.21.15.163:0/3256930012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb18175890 0x7fcb180f10d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb08009760 tx=0x7fcb08009060).ready entity=mon.2 client_cookie=7a1a53e3c48bb166 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb15d9b700 1 -- 172.21.15.163:0/3256930012 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080090d0 con 0x7fcb18175890 2023-11-06T13:27:25.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb15d9b700 1 -- 172.21.15.163:0/3256930012 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0800f510 con 0x7fcb18175890 2023-11-06T13:27:25.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb15d9b700 1 -- 172.21.15.163:0/3256930012 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800f890 con 0x7fcb18175890 2023-11-06T13:27:25.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 -- 172.21.15.163:0/3256930012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb18175890 msgr2=0x7fcb180f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 --2- 172.21.15.163:0/3256930012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb18175890 0x7fcb180f10d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb08009760 tx=0x7fcb08009060).stop 2023-11-06T13:27:25.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 -- 172.21.15.163:0/3256930012 shutdown_connections 2023-11-06T13:27:25.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 --2- 172.21.15.163:0/3256930012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb18175890 0x7fcb180f10d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 -- 172.21.15.163:0/3256930012 >> 172.21.15.163:0/3256930012 conn(0x7fcb180f5d20 msgr2=0x7fcb180f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 -- 172.21.15.163:0/3256930012 shutdown_connections 2023-11-06T13:27:25.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.717+0000 7fcb1c832700 1 -- 172.21.15.163:0/3256930012 wait complete. 2023-11-06T13:27:25.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.719+0000 7fcb1c832700 1 Processor -- start 2023-11-06T13:27:25.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.719+0000 7fcb1c832700 1 -- start start 2023-11-06T13:27:25.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1c832700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 0x7fcb18157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1c832700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb18175890 0x7fcb18177570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1c832700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1817cac0 0x7fcb18177a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1c832700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18177120 con 0x7fcb1817cac0 2023-11-06T13:27:25.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1c832700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181812c0 con 0x7fcb18175890 2023-11-06T13:27:25.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1c832700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181815a0 con 0x7fcb180cb960 2023-11-06T13:27:25.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 0x7fcb18157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 0x7fcb18157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54856/0 (socket says 172.21.15.163:54856) 2023-11-06T13:27:25.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3854080712 learned_addr learned my addr 172.21.15.163:0/3854080712 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1659c700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb18175890 0x7fcb18177570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1759e700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1817cac0 0x7fcb18177a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3854080712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb18175890 msgr2=0x7fcb18177570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb18175890 0x7fcb18177570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3854080712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1817cac0 msgr2=0x7fcb18177a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1817cac0 0x7fcb18177a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 -- 172.21.15.163:0/3854080712 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080092a0 con 0x7fcb180cb960 2023-11-06T13:27:25.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb1759e700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1817cac0 0x7fcb18177a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:25.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.720+0000 7fcb16d9d700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 0x7fcb18157220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcb08009eb0 tx=0x7fcb08017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800fea0 con 0x7fcb180cb960 2023-11-06T13:27:25.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb08006910 con 0x7fcb180cb960 2023-11-06T13:27:25.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18181880 con 0x7fcb180cb960 2023-11-06T13:27:25.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0800f890 con 0x7fcb180cb960 2023-11-06T13:27:25.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb18181e40 con 0x7fcb180cb960 2023-11-06T13:27:25.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fcb0801b880 con 0x7fcb180cb960 2023-11-06T13:27:25.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.721+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7fcb08024d20 con 0x7fcb180cb960 2023-11-06T13:27:25.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.722+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb181773c0 con 0x7fcb180cb960 2023-11-06T13:27:25.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.724+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fcb08029060 con 0x7fcb180cb960 2023-11-06T13:27:25.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.804+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b6b05e5a-2758-4224-9cdb-3abf69fc3124", "id": 10} v 0) v1 -- 0x7fcb180475a0 con 0x7fcb180cb960 2023-11-06T13:27:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.807+0000 7fcafeffd700 1 -- 172.21.15.163:0/3854080712 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6b05e5a-2758-4224-9cdb-3abf69fc3124", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7fcb0801f070 con 0x7fcb180cb960 2023-11-06T13:27:25.811 INFO:teuthology.orchestra.run.smithi163.stdout:10 2023-11-06T13:27:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 msgr2=0x7fcb18157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 0x7fcb18157220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcb08009eb0 tx=0x7fcb08017000).stop 2023-11-06T13:27:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 shutdown_connections 2023-11-06T13:27:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcb1817cac0 0x7fcb18177a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcb180cb960 0x7fcb18157220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 --2- 172.21.15.163:0/3854080712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb18175890 0x7fcb18177570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 >> 172.21.15.163:0/3854080712 conn(0x7fcb180f5d20 msgr2=0x7fcb180cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 shutdown_connections 2023-11-06T13:27:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.808+0000 7fcb1c832700 1 -- 172.21.15.163:0/3854080712 wait complete. 2023-11-06T13:27:25.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 74a1c2f7-c63a-45aa-8da3-35539631c9dc 11 2023-11-06T13:27:25.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.931+0000 7ff97eed5700 1 Processor -- start 2023-11-06T13:27:25.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.931+0000 7ff97eed5700 1 -- start start 2023-11-06T13:27:25.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.932+0000 7ff97eed5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff978175700 0x7ff978180340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.932+0000 7ff97eed5700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9780c9090 con 0x7ff978181d20 2023-11-06T13:27:25.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.932+0000 7ff97eed5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff978181890 con 0x7ff978175ae0 2023-11-06T13:27:25.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.932+0000 7ff97eed5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff978182190 con 0x7ff978175700 2023-11-06T13:27:25.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff977fff700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff978175ae0 0x7ff9780c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.163:33438/0 (socket says 172.21.15.163:33438) 2023-11-06T13:27:25.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff977fff700 1 -- 172.21.15.163:0/2401078957 learned_addr learned my addr 172.21.15.163:0/2401078957 (peer_addr_for_me v1:172.21.15.163:0/0) 2023-11-06T13:27:25.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff97cc71700 1 --2- 172.21.15.163:0/2401078957 >> v2:172.21.15.38:3300/0 conn(0x7ff978175700 0x7ff978180340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff9777fe700 1 -- 172.21.15.163:0/2401078957 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782227601 0 0) 0x7ff978181890 con 0x7ff978175ae0 2023-11-06T13:27:25.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff9777fe700 1 -- 172.21.15.163:0/2401078957 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9680033f0 con 0x7ff978175ae0 2023-11-06T13:27:25.940 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff97cc71700 1 -- 172.21.15.163:0/2401078957 >> v1:172.21.15.163:6789/0 conn(0x7ff978175ae0 legacy=0x7ff9780c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.940 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff97cc71700 1 -- 172.21.15.163:0/2401078957 >> v1:172.21.15.44:6789/0 conn(0x7ff978181d20 legacy=0x7ff978182ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.940 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff9777fe700 1 -- 172.21.15.163:0/2401078957 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625927048 0 0) 0x7ff970001490 con 0x7ff978181d20 2023-11-06T13:27:25.940 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff97cc71700 1 -- 172.21.15.163:0/2401078957 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9781809a0 con 0x7ff978175700 2023-11-06T13:27:25.940 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff97cc71700 1 --2- 172.21.15.163:0/2401078957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff978180340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff96c009760 tx=0x7ff96c009060).ready entity=mon.0 client_cookie=8b627cdd305f8966 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff9777fe700 1 -- 172.21.15.163:0/2401078957 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00f510 con 0x7ff978175700 2023-11-06T13:27:25.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff9777fe700 1 -- 172.21.15.163:0/2401078957 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c00f670 con 0x7ff978175700 2023-11-06T13:27:25.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.933+0000 7ff9777fe700 1 -- 172.21.15.163:0/2401078957 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00f9f0 con 0x7ff978175700 2023-11-06T13:27:25.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 -- 172.21.15.163:0/2401078957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 msgr2=0x7ff978180340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 --2- 172.21.15.163:0/2401078957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff978180340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff96c009760 tx=0x7ff96c009060).stop 2023-11-06T13:27:25.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 -- 172.21.15.163:0/2401078957 shutdown_connections 2023-11-06T13:27:25.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 --2- 172.21.15.163:0/2401078957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff978180340 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 -- 172.21.15.163:0/2401078957 >> 172.21.15.163:0/2401078957 conn(0x7ff978069ea0 msgr2=0x7ff97806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:25.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 -- 172.21.15.163:0/2401078957 shutdown_connections 2023-11-06T13:27:25.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.934+0000 7ff97eed5700 1 -- 172.21.15.163:0/2401078957 wait complete. 2023-11-06T13:27:25.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.935+0000 7ff97eed5700 1 Processor -- start 2023-11-06T13:27:25.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.935+0000 7ff97eed5700 1 -- start start 2023-11-06T13:27:25.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff97eed5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff97817f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff97eed5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 0x7ff978154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff97eed5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff978181d20 0x7ff978154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:25.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff97eed5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97817ca00 con 0x7ff978175700 2023-11-06T13:27:25.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff97eed5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97817ccc0 con 0x7ff978181d20 2023-11-06T13:27:25.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff97eed5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97817cfa0 con 0x7ff978175ae0 2023-11-06T13:27:25.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.936+0000 7ff977fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 0x7ff978154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 0x7ff978154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54866/0 (socket says 172.21.15.163:54866) 2023-11-06T13:27:25.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 -- 172.21.15.163:0/3024706425 learned_addr learned my addr 172.21.15.163:0/3024706425 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-11-06T13:27:25.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff97cc71700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff97817f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff97d472700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff978181d20 0x7ff978154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:25.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 -- 172.21.15.163:0/3024706425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff978181d20 msgr2=0x7ff978154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff978181d20 0x7ff978154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 -- 172.21.15.163:0/3024706425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 msgr2=0x7ff97817f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:25.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff97817f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:25.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 -- 172.21.15.163:0/3024706425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0092a0 con 0x7ff978175ae0 2023-11-06T13:27:25.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff97cc71700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff97817f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:27:25.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff977fff700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 0x7ff978154490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff96400c420 tx=0x7ff964007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:25.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640070d0 con 0x7ff978175ae0 2023-11-06T13:27:25.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964007230 con 0x7ff978175ae0 2023-11-06T13:27:25.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9640075b0 con 0x7ff978175ae0 2023-11-06T13:27:25.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97817d280 con 0x7ff978175ae0 2023-11-06T13:27:25.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97817d840 con 0x7ff978175ae0 2023-11-06T13:27:25.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff964005c10 con 0x7ff978175ae0 2023-11-06T13:27:25.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.937+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2019+0+0 (secure 0 0 0) 0x7ff96401dc50 con 0x7ff978175ae0 2023-11-06T13:27:25.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.938+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9781541b0 con 0x7ff978175ae0 2023-11-06T13:27:25.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:25.940+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff9781541b0 con 0x7ff978175ae0 2023-11-06T13:27:26.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.018+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74a1c2f7-c63a-45aa-8da3-35539631c9dc", "id": 11} v 0) v1 -- 0x7ff97806c580 con 0x7ff978175ae0 2023-11-06T13:27:26.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.023+0000 7ff974ff9700 1 -- 172.21.15.163:0/3024706425 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74a1c2f7-c63a-45aa-8da3-35539631c9dc", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7ff964013450 con 0x7ff978175ae0 2023-11-06T13:27:26.027 INFO:teuthology.orchestra.run.smithi163.stdout:11 2023-11-06T13:27:26.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 msgr2=0x7ff978154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:26.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 0x7ff978154490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff96400c420 tx=0x7ff964007c80).stop 2023-11-06T13:27:26.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 shutdown_connections 2023-11-06T13:27:26.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff978181d20 0x7ff978154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff978175700 0x7ff97817f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 --2- 172.21.15.163:0/3024706425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff978175ae0 0x7ff978154490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 >> 172.21.15.163:0/3024706425 conn(0x7ff978069ea0 msgr2=0x7ff978156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:26.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 shutdown_connections 2023-11-06T13:27:26.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-11-06T13:27:26.024+0000 7ff97eed5700 1 -- 172.21.15.163:0/3024706425 wait complete. 2023-11-06T13:27:26.039 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-06T13:27:26.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-06T13:27:26.042 INFO:tasks.ceph.osd.0:Started 2023-11-06T13:27:26.042 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-06T13:27:26.043 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-06T13:27:26.045 INFO:tasks.ceph.osd.3:Started 2023-11-06T13:27:26.045 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-06T13:27:26.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-06T13:27:26.048 INFO:tasks.ceph.osd.6:Started 2023-11-06T13:27:26.048 INFO:tasks.ceph.osd.9:Restarting daemon 2023-11-06T13:27:26.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2023-11-06T13:27:26.050 INFO:tasks.ceph.osd.9:Started 2023-11-06T13:27:26.051 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-06T13:27:26.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-06T13:27:26.053 INFO:tasks.ceph.osd.1:Started 2023-11-06T13:27:26.054 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-06T13:27:26.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-06T13:27:26.056 INFO:tasks.ceph.osd.4:Started 2023-11-06T13:27:26.057 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-06T13:27:26.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-06T13:27:26.060 INFO:tasks.ceph.osd.7:Started 2023-11-06T13:27:26.061 INFO:tasks.ceph.osd.10:Restarting daemon 2023-11-06T13:27:26.061 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2023-11-06T13:27:26.064 INFO:tasks.ceph.osd.10:Started 2023-11-06T13:27:26.064 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-06T13:27:26.065 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-06T13:27:26.067 INFO:tasks.ceph.osd.2:Started 2023-11-06T13:27:26.067 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-06T13:27:26.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-06T13:27:26.070 INFO:tasks.ceph.osd.5:Started 2023-11-06T13:27:26.070 INFO:tasks.ceph.osd.8:Restarting daemon 2023-11-06T13:27:26.070 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2023-11-06T13:27:26.073 INFO:tasks.ceph.osd.8:Started 2023-11-06T13:27:26.073 INFO:tasks.ceph.osd.11:Restarting daemon 2023-11-06T13:27:26.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2023-11-06T13:27:26.076 INFO:tasks.ceph.osd.11:Started 2023-11-06T13:27:26.076 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:26.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.226+0000 7f1438387700 1 Processor -- start 2023-11-06T13:27:26.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.226+0000 7f1438387700 1 -- start start 2023-11-06T13:27:26.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1438387700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f143015a7c0 0x7f143015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:26.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1438387700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f14300643d0 0x7f14300c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:26.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1438387700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14300e9c90 con 0x7f1430063f20 2023-11-06T13:27:26.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1438387700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143017fc90 con 0x7f143015a7c0 2023-11-06T13:27:26.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1438387700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300e8da0 con 0x7f14300643d0 2023-11-06T13:27:26.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1436123700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f143015a7c0 0x7f143015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:26.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1436123700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f143015a7c0 0x7f143015aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42052/0 (socket says 172.21.15.38:42052) 2023-11-06T13:27:26.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1436123700 1 -- 172.21.15.38:0/3102213564 learned_addr learned my addr 172.21.15.38:0/3102213564 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:26.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.227+0000 7f1436924700 1 --2- 172.21.15.38:0/3102213564 >> v2:172.21.15.44:3300/0 conn(0x7f14300643d0 0x7f14300c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1436123700 1 -- 172.21.15.38:0/3102213564 >> v2:172.21.15.44:3300/0 conn(0x7f14300643d0 msgr2=0x7f14300c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1436123700 1 --2- 172.21.15.38:0/3102213564 >> v2:172.21.15.44:3300/0 conn(0x7f14300643d0 0x7f14300c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1436123700 1 -- 172.21.15.38:0/3102213564 >> v1:172.21.15.163:6789/0 conn(0x7f1430063f20 legacy=0x7f14300c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1436123700 1 -- 172.21.15.38:0/3102213564 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300e9080 con 0x7f143015a7c0 2023-11-06T13:27:26.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1436123700 1 --2- 172.21.15.38:0/3102213564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f143015a7c0 0x7f143015aba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f14300e8830 tx=0x7f142c0090f0).ready entity=mon.0 client_cookie=a7ae43a4a4ff743d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1435121700 1 -- 172.21.15.38:0/3102213564 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00b520 con 0x7f143015a7c0 2023-11-06T13:27:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1435121700 1 -- 172.21.15.38:0/3102213564 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00b680 con 0x7f143015a7c0 2023-11-06T13:27:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1435121700 1 -- 172.21.15.38:0/3102213564 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00ba00 con 0x7f143015a7c0 2023-11-06T13:27:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1438387700 1 -- 172.21.15.38:0/3102213564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f143015a7c0 msgr2=0x7f143015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.228+0000 7f1438387700 1 --2- 172.21.15.38:0/3102213564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f143015a7c0 0x7f143015aba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f14300e8830 tx=0x7f142c0090f0).stop 2023-11-06T13:27:26.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.229+0000 7f1438387700 1 -- 172.21.15.38:0/3102213564 shutdown_connections 2023-11-06T13:27:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.229+0000 7f1438387700 1 --2- 172.21.15.38:0/3102213564 >> v2:172.21.15.44:3300/0 conn(0x7f14300643d0 0x7f14300c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.229+0000 7f1438387700 1 --2- 172.21.15.38:0/3102213564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f143015a7c0 0x7f143015aba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.229+0000 7f1438387700 1 -- 172.21.15.38:0/3102213564 >> 172.21.15.38:0/3102213564 conn(0x7f143005e1b0 msgr2=0x7f143005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.229+0000 7f1438387700 1 -- 172.21.15.38:0/3102213564 shutdown_connections 2023-11-06T13:27:26.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.229+0000 7f1438387700 1 -- 172.21.15.38:0/3102213564 wait complete. 2023-11-06T13:27:26.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.230+0000 7f1438387700 1 Processor -- start 2023-11-06T13:27:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.230+0000 7f1438387700 1 -- start start 2023-11-06T13:27:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1438387700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 0x7f1430190540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1438387700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14300643d0 0x7f1430174290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1438387700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f143015a7c0 0x7f14300c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:26.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1438387700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c6280 con 0x7f1430063f20 2023-11-06T13:27:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1438387700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c5390 con 0x7f14300643d0 2023-11-06T13:27:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1438387700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c5670 con 0x7f143015a7c0 2023-11-06T13:27:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 0x7f1430190540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 0x7f1430190540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42066/0 (socket says 172.21.15.38:42066) 2023-11-06T13:27:26.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 -- 172.21.15.38:0/2073498169 learned_addr learned my addr 172.21.15.38:0/2073498169 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436924700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f143015a7c0 0x7f14300c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1435922700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14300643d0 0x7f1430174290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 -- 172.21.15.38:0/2073498169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f143015a7c0 msgr2=0x7f14300c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f143015a7c0 0x7f14300c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 -- 172.21.15.38:0/2073498169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14300643d0 msgr2=0x7f1430174290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14300643d0 0x7f1430174290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.231+0000 7f1436123700 1 -- 172.21.15.38:0/2073498169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c009370 con 0x7f1430063f20 2023-11-06T13:27:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f1436123700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 0x7f1430190540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f142c009130 tx=0x7f142c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c000bc0 con 0x7f1430063f20 2023-11-06T13:27:26.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00b7f0 con 0x7f1430063f20 2023-11-06T13:27:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14300c5950 con 0x7f1430063f20 2023-11-06T13:27:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c000d20 con 0x7f1430063f20 2023-11-06T13:27:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300c5f10 con 0x7f1430063f20 2023-11-06T13:27:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f142c01cb20 con 0x7f1430063f20 2023-11-06T13:27:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.232+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2134+0+0 (secure 0 0 0) 0x7f142c01b3b0 con 0x7f1430063f20 2023-11-06T13:27:26.244 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.233+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14300c6560 con 0x7f1430063f20 2023-11-06T13:27:26.245 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.235+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f142c044e50 con 0x7f1430063f20 2023-11-06T13:27:26.253 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.249+0000 7f39be409680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-06T13:27:26.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.305+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f143006c580 con 0x7f1430063f20 2023-11-06T13:27:26.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.305+0000 7f14267fc700 1 -- 172.21.15.38:0/2073498169 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9954 (secure 0 0 0) 0x7f142c033070 con 0x7f1430063f20 2023-11-06T13:27:26.309 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:26.309 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":14,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:26.021334+0000","last_up_change":"0.000000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 msgr2=0x7f1430190540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:26.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 0x7f1430190540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f142c009130 tx=0x7f142c017000).stop 2023-11-06T13:27:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 shutdown_connections 2023-11-06T13:27:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f143015a7c0 0x7f14300c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1430063f20 0x7f1430190540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 --2- 172.21.15.38:0/2073498169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14300643d0 0x7f1430174290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:26.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 >> 172.21.15.38:0/2073498169 conn(0x7f143005e1b0 msgr2=0x7f1430159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:26.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 shutdown_connections 2023-11-06T13:27:26.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:26.306+0000 7f1438387700 1 -- 172.21.15.38:0/2073498169 wait complete. 2023-11-06T13:27:26.315 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.312+0000 7f02a31ca680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-06T13:27:26.320 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.317+0000 7f39be409680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-06T13:27:26.322 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-06T13:27:26.322 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-06T13:27:26.387 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.384+0000 7f02a31ca680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-06T13:27:26.396 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.393+0000 7f39be409680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-06T13:27:26.411 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:26.408+0000 7f10a58be680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-06T13:27:26.467 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.464+0000 7f02a31ca680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-06T13:27:26.483 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:26.480+0000 7f10a58be680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-06T13:27:26.545 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.541+0000 7f39be409680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-06T13:27:26.566 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:26.563+0000 7f10a58be680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-06T13:27:26.614 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.610+0000 7f39be409680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-06T13:27:26.620 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.617+0000 7f02a31ca680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-06T13:27:26.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-11-06T13:27:26.642+0000 7fcec6c09380 -1 Falling back to public interface 2023-11-06T13:27:26.654 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:27:26.655 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-06T13:27:26.652+0000 7f279795c380 -1 Falling back to public interface 2023-11-06T13:27:26.656 INFO:tasks.ceph.osd.7.smithi044.stderr:2023-11-06T13:27:26.652+0000 7fefe6b49380 -1 Falling back to public interface 2023-11-06T13:27:26.656 INFO:tasks.ceph.osd.7.smithi044.stderr:2023-11-06T13:27:26.652+0000 7fefe0d0e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-11-06T13:27:26.658 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:27:26.660 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:27:26.669 INFO:tasks.ceph.osd.6.smithi038.stderr:2023-11-06T13:27:26.666+0000 7fede2b73380 -1 Falling back to public interface 2023-11-06T13:27:26.670 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-11-06T13:27:26.666+0000 7fc754a9e380 -1 Falling back to public interface 2023-11-06T13:27:26.670 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-11-06T13:27:26.667+0000 7fc74ec63700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-11-06T13:27:26.671 INFO:tasks.ceph.osd.4.smithi044.stderr:2023-11-06T13:27:26.668+0000 7fdd22bdc380 -1 Falling back to public interface 2023-11-06T13:27:26.674 INFO:tasks.ceph.osd.8.smithi163.stderr:2023-11-06T13:27:26.670+0000 7f3218964380 -1 Falling back to public interface 2023-11-06T13:27:26.677 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-11-06T13:27:26.674+0000 7f4f63710380 -1 Falling back to public interface 2023-11-06T13:27:26.682 INFO:tasks.ceph.osd.10.smithi044.stderr:2023-11-06T13:27:26.679+0000 7f5df4ca5380 -1 Falling back to public interface 2023-11-06T13:27:26.683 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-11-06T13:27:26.679+0000 7fe1c3ff9380 -1 Falling back to public interface 2023-11-06T13:27:26.684 INFO:tasks.ceph.osd.9.smithi038.stderr:2023-11-06T13:27:26.681+0000 7fdfe3bbc380 -1 Falling back to public interface 2023-11-06T13:27:26.697 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.694+0000 7f02a31ca680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-06T13:27:26.698 INFO:tasks.ceph.osd.11.smithi163.stderr:2023-11-06T13:27:26.694+0000 7fc02fc18380 -1 Falling back to public interface 2023-11-06T13:27:26.722 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:26.719+0000 7f10a58be680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-06T13:27:26.733 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.730+0000 7f39be409680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-06T13:27:26.796 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:26.793+0000 7f10a58be680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-06T13:27:26.818 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.815+0000 7f02a31ca680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-06T13:27:26.841 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:26.837+0000 7f39be409680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-06T13:27:26.918 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:26.915+0000 7f10a58be680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-06T13:27:26.930 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:26.927+0000 7f02a31ca680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-06T13:27:27.031 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:27.028+0000 7f10a58be680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-06T13:27:27.159 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:27.156+0000 7f39be409680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-06T13:27:27.230 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:27.226+0000 7f39be409680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-06T13:27:27.261 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:27.258+0000 7f02a31ca680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-06T13:27:27.334 INFO:tasks.ceph.mgr.y.smithi044.stderr:2023-11-06T13:27:27.332+0000 7f02a31ca680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-06T13:27:27.367 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:27.364+0000 7f10a58be680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-06T13:27:27.440 INFO:tasks.ceph.mgr.x.smithi038.stderr:2023-11-06T13:27:27.437+0000 7f10a58be680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-06T13:27:27.532 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:27.640 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.637+0000 7fa8cfa08700 1 Processor -- start 2023-11-06T13:27:27.640 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.637+0000 7fa8cfa08700 1 -- start start 2023-11-06T13:27:27.643 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8cfa08700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa8c81809e0 0x7fa8c817e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:27.643 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8cfa08700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c8084be0 con 0x7fa8c80cafc0 2023-11-06T13:27:27.643 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8cfa08700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c80eebb0 con 0x7fa8c817e550 2023-11-06T13:27:27.643 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8cfa08700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c8085ed0 con 0x7fa8c81809e0 2023-11-06T13:27:27.644 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8ccfa3700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa8c80cafc0 0x7fa8c81802d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:41752/0 (socket says 172.21.15.38:41752) 2023-11-06T13:27:27.644 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8ccfa3700 1 -- 172.21.15.38:0/2288050582 learned_addr learned my addr 172.21.15.38:0/2288050582 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:27.644 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8cdfa5700 1 --2- 172.21.15.38:0/2288050582 >> v2:172.21.15.44:3300/0 conn(0x7fa8c81809e0 0x7fa8c817e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:27.644 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.638+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351835724 0 0) 0x7fa8c8084be0 con 0x7fa8c80cafc0 2023-11-06T13:27:27.644 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b00033f0 con 0x7fa8c80cafc0 2023-11-06T13:27:27.645 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723995480 0 0) 0x7fa8c80eebb0 con 0x7fa8c817e550 2023-11-06T13:27:27.645 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8c8084be0 con 0x7fa8c817e550 2023-11-06T13:27:27.645 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cdfa5700 1 -- 172.21.15.38:0/2288050582 >> v1:172.21.15.163:6789/0 conn(0x7fa8c817e550 legacy=0x7fa8c80ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:27.645 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cdfa5700 1 -- 172.21.15.38:0/2288050582 >> v1:172.21.15.38:6789/0 conn(0x7fa8c80cafc0 legacy=0x7fa8c81802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:27.645 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cdfa5700 1 -- 172.21.15.38:0/2288050582 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8084e30 con 0x7fa8c81809e0 2023-11-06T13:27:27.646 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cdfa5700 1 --2- 172.21.15.38:0/2288050582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c817e930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa8c0009e60 tx=0x7fa8c0009780).ready entity=mon.1 client_cookie=f5617fd5529d020d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:27.646 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000e070 con 0x7fa8c81809e0 2023-11-06T13:27:27.646 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c000bab0 con 0x7fa8c81809e0 2023-11-06T13:27:27.647 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8c7fff700 1 -- 172.21.15.38:0/2288050582 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c000be30 con 0x7fa8c81809e0 2023-11-06T13:27:27.647 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cfa08700 1 -- 172.21.15.38:0/2288050582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 msgr2=0x7fa8c817e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:27.647 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cfa08700 1 --2- 172.21.15.38:0/2288050582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c817e930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa8c0009e60 tx=0x7fa8c0009780).stop 2023-11-06T13:27:27.647 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cfa08700 1 -- 172.21.15.38:0/2288050582 shutdown_connections 2023-11-06T13:27:27.647 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cfa08700 1 --2- 172.21.15.38:0/2288050582 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c817e930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:27.648 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.639+0000 7fa8cfa08700 1 -- 172.21.15.38:0/2288050582 >> 172.21.15.38:0/2288050582 conn(0x7fa8c80efca0 msgr2=0x7fa8c80f00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:27.648 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.640+0000 7fa8cfa08700 1 -- 172.21.15.38:0/2288050582 shutdown_connections 2023-11-06T13:27:27.648 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.640+0000 7fa8cfa08700 1 -- 172.21.15.38:0/2288050582 wait complete. 2023-11-06T13:27:27.650 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.641+0000 7fa8cfa08700 1 Processor -- start 2023-11-06T13:27:27.651 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.641+0000 7fa8cfa08700 1 -- start start 2023-11-06T13:27:27.651 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cfa08700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c80cafc0 0x7fa8c8174b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:27.651 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cfa08700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 0x7fa8c816f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:27.651 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cfa08700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c81683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:27.652 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cfa08700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8190ea0 con 0x7fa8c817e550 2023-11-06T13:27:27.652 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cfa08700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8170030 con 0x7fa8c81809e0 2023-11-06T13:27:27.652 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cfa08700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8170310 con 0x7fa8c80cafc0 2023-11-06T13:27:27.652 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 0x7fa8c816f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:27.652 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 0x7fa8c816f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37574/0 (socket says 172.21.15.38:37574) 2023-11-06T13:27:27.652 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 -- 172.21.15.38:0/3553205136 learned_addr learned my addr 172.21.15.38:0/3553205136 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:27.653 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cd7a4700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c80cafc0 0x7fa8c8174b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:27.653 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8cdfa5700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c81683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:27.653 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 -- 172.21.15.38:0/3553205136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c80cafc0 msgr2=0x7fa8c8174b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:27.653 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c80cafc0 0x7fa8c8174b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:27.653 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 -- 172.21.15.38:0/3553205136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 msgr2=0x7fa8c81683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:27.654 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c81683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:27.654 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.642+0000 7fa8ccfa3700 1 -- 172.21.15.38:0/3553205136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0009a20 con 0x7fa8c817e550 2023-11-06T13:27:27.654 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8cdfa5700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c81683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:27.654 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8ccfa3700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 0x7fa8c816f820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa8bc00c560 tx=0x7fa8bc007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:27.655 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0072e0 con 0x7fa8c817e550 2023-11-06T13:27:27.655 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc007440 con 0x7fa8c817e550 2023-11-06T13:27:27.655 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c81705f0 con 0x7fa8c817e550 2023-11-06T13:27:27.655 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0057a0 con 0x7fa8c817e550 2023-11-06T13:27:27.655 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c816fd10 con 0x7fa8c817e550 2023-11-06T13:27:27.655 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.643+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 2) v1 ==== 37661+0+0 (secure 0 0 0) 0x7fa8bc005b90 con 0x7fa8c817e550 2023-11-06T13:27:27.656 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.644+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2134+0+0 (secure 0 0 0) 0x7fa8bc041290 con 0x7fa8c817e550 2023-11-06T13:27:27.656 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.644+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c8190cf0 con 0x7fa8c817e550 2023-11-06T13:27:27.656 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.646+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa8bc005e40 con 0x7fa8c817e550 2023-11-06T13:27:27.717 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.714+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c80475a0 con 0x7fa8c817e550 2023-11-06T13:27:27.718 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.715+0000 7fa8c57fa700 1 -- 172.21.15.38:0/3553205136 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9954 (secure 0 0 0) 0x7fa8bc010300 con 0x7fa8c817e550 2023-11-06T13:27:27.719 INFO:teuthology.misc.health.smithi038.stdout: 2023-11-06T13:27:27.719 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":14,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:26.021334+0000","last_up_change":"0.000000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:27.720 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.715+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 msgr2=0x7fa8c816f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:27.720 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.715+0000 7fa8cfa08700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 0x7fa8c816f820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa8bc00c560 tx=0x7fa8bc007d20).stop 2023-11-06T13:27:27.720 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 shutdown_connections 2023-11-06T13:27:27.721 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8c81809e0 0x7fa8c81683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:27.721 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8c80cafc0 0x7fa8c8174b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:27.721 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 --2- 172.21.15.38:0/3553205136 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8c817e550 0x7fa8c816f820 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:27.721 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 >> 172.21.15.38:0/3553205136 conn(0x7fa8c80efca0 msgr2=0x7fa8c81724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:27.721 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 shutdown_connections 2023-11-06T13:27:27.722 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:27.716+0000 7fa8cfa08700 1 -- 172.21.15.38:0/3553205136 wait complete. 2023-11-06T13:27:27.729 DEBUG:teuthology.misc:0 of 12 OSDs are up 2023-11-06T13:27:28.256 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:28.253+0000 7f397462c700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-06T13:27:28.257 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:28.254+0000 7f397462c700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-06T13:27:30.074 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-11-06T13:27:30.071+0000 7fcec6c09380 -1 osd.3 0 log_to_monitors {default=true} 2023-11-06T13:27:30.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-11-06T13:27:30.115+0000 7fc754a9e380 -1 osd.0 0 log_to_monitors {default=true} 2023-11-06T13:27:30.134 INFO:tasks.ceph.osd.8.smithi163.stderr:2023-11-06T13:27:30.131+0000 7f3218964380 -1 osd.8 0 log_to_monitors {default=true} 2023-11-06T13:27:30.140 INFO:tasks.ceph.osd.7.smithi044.stderr:2023-11-06T13:27:30.138+0000 7fefe6b49380 -1 osd.7 0 log_to_monitors {default=true} 2023-11-06T13:27:30.159 INFO:tasks.ceph.osd.9.smithi038.stderr:2023-11-06T13:27:30.156+0000 7fdfe3bbc380 -1 osd.9 0 log_to_monitors {default=true} 2023-11-06T13:27:30.170 INFO:tasks.ceph.osd.6.smithi038.stderr:2023-11-06T13:27:30.167+0000 7fede2b73380 -1 osd.6 0 log_to_monitors {default=true} 2023-11-06T13:27:30.182 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-11-06T13:27:30.178+0000 7fe1c3ff9380 -1 osd.5 0 log_to_monitors {default=true} 2023-11-06T13:27:30.190 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-11-06T13:27:30.187+0000 7f4f63710380 -1 osd.2 0 log_to_monitors {default=true} 2023-11-06T13:27:30.194 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-06T13:27:30.191+0000 7f279795c380 -1 osd.1 0 log_to_monitors {default=true} 2023-11-06T13:27:30.195 INFO:tasks.ceph.osd.10.smithi044.stderr:2023-11-06T13:27:30.192+0000 7f5df4ca5380 -1 osd.10 0 log_to_monitors {default=true} 2023-11-06T13:27:30.199 INFO:tasks.ceph.osd.4.smithi044.stderr:2023-11-06T13:27:30.196+0000 7fdd22bdc380 -1 osd.4 0 log_to_monitors {default=true} 2023-11-06T13:27:30.230 INFO:tasks.ceph.osd.11.smithi163.stderr:2023-11-06T13:27:30.227+0000 7fc02fc18380 -1 osd.11 0 log_to_monitors {default=true} 2023-11-06T13:27:31.275 INFO:tasks.ceph.osd.7.smithi044.stderr:2023-11-06T13:27:31.272+0000 7fefdd507700 -1 osd.7 0 waiting for initial osdmap 2023-11-06T13:27:31.277 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-11-06T13:27:31.274+0000 7fc74b45c700 -1 osd.0 0 waiting for initial osdmap 2023-11-06T13:27:31.277 INFO:tasks.ceph.osd.9.smithi038.stderr:2023-11-06T13:27:31.274+0000 7fdfdbd7d700 -1 osd.9 0 waiting for initial osdmap 2023-11-06T13:27:31.278 INFO:tasks.ceph.osd.6.smithi038.stderr:2023-11-06T13:27:31.274+0000 7fedd9531700 -1 osd.6 0 waiting for initial osdmap 2023-11-06T13:27:31.278 INFO:tasks.ceph.osd.10.smithi044.stderr:2023-11-06T13:27:31.274+0000 7f5deb663700 -1 osd.10 0 waiting for initial osdmap 2023-11-06T13:27:31.279 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-11-06T13:27:31.275+0000 7fcebd5c7700 -1 osd.3 0 waiting for initial osdmap 2023-11-06T13:27:31.280 INFO:tasks.ceph.osd.4.smithi044.stderr:2023-11-06T13:27:31.277+0000 7fdd1959a700 -1 osd.4 0 waiting for initial osdmap 2023-11-06T13:27:31.281 INFO:tasks.ceph.osd.7.smithi044.stderr:2023-11-06T13:27:31.278+0000 7fefd9c83700 -1 osd.7 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.282 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-11-06T13:27:31.279+0000 7fe1ba9b7700 -1 osd.5 0 waiting for initial osdmap 2023-11-06T13:27:31.282 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-06T13:27:31.279+0000 7f278e31a700 -1 osd.1 0 waiting for initial osdmap 2023-11-06T13:27:31.283 INFO:tasks.ceph.osd.8.smithi163.stderr:2023-11-06T13:27:31.279+0000 7f320f322700 -1 osd.8 0 waiting for initial osdmap 2023-11-06T13:27:31.283 INFO:tasks.ceph.osd.11.smithi163.stderr:2023-11-06T13:27:31.279+0000 7fc0265d6700 -1 osd.11 0 waiting for initial osdmap 2023-11-06T13:27:31.284 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-11-06T13:27:31.279+0000 7f4f5a0ce700 -1 osd.2 0 waiting for initial osdmap 2023-11-06T13:27:31.288 INFO:tasks.ceph.osd.4.smithi044.stderr:2023-11-06T13:27:31.285+0000 7fdd15d16700 -1 osd.4 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.288 INFO:tasks.ceph.osd.0.smithi038.stderr:2023-11-06T13:27:31.286+0000 7fc747bd8700 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.289 INFO:tasks.ceph.osd.10.smithi044.stderr:2023-11-06T13:27:31.286+0000 7f5de7ddf700 -1 osd.10 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.290 INFO:tasks.ceph.osd.3.smithi038.stderr:2023-11-06T13:27:31.286+0000 7fceb9d43700 -1 osd.3 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.290 INFO:tasks.ceph.osd.1.smithi044.stderr:2023-11-06T13:27:31.286+0000 7f278aa96700 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.290 INFO:tasks.ceph.osd.9.smithi038.stderr:2023-11-06T13:27:31.286+0000 7fdfd6cf6700 -1 osd.9 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.291 INFO:tasks.ceph.osd.6.smithi038.stderr:2023-11-06T13:27:31.286+0000 7fedd5cad700 -1 osd.6 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.291 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-11-06T13:27:31.286+0000 7f4f5684a700 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.292 INFO:tasks.ceph.osd.8.smithi163.stderr:2023-11-06T13:27:31.286+0000 7f320ba9e700 -1 osd.8 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.292 INFO:tasks.ceph.osd.5.smithi163.stderr:2023-11-06T13:27:31.288+0000 7fe1b7133700 -1 osd.5 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:31.292 INFO:tasks.ceph.osd.11.smithi163.stderr:2023-11-06T13:27:31.289+0000 7fc022d52700 -1 osd.11 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-06T13:27:34.941 DEBUG:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:35.059 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.056+0000 7fc367ee6700 1 Processor -- start 2023-11-06T13:27:35.060 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.057+0000 7fc367ee6700 1 -- start start 2023-11-06T13:27:35.062 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc367ee6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc36017b640 0x7fc360084a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.063 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc367ee6700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc36017f190 0x7fc36017f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.063 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc367ee6700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc360084f50 con 0x7fc3600c75c0 2023-11-06T13:27:35.063 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc367ee6700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36017ba20 con 0x7fc36017b640 2023-11-06T13:27:35.063 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc367ee6700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36017e1c0 con 0x7fc36017f190 2023-11-06T13:27:35.064 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc36017b640 0x7fc360084a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.064 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc36017b640 0x7fc360084a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37616/0 (socket says 172.21.15.38:37616) 2023-11-06T13:27:35.064 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 -- 172.21.15.38:0/3891434638 learned_addr learned my addr 172.21.15.38:0/3891434638 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:35.064 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc366483700 1 --2- 172.21.15.38:0/3891434638 >> v2:172.21.15.44:3300/0 conn(0x7fc36017f190 0x7fc36017f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.064 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 -- 172.21.15.38:0/3891434638 >> v2:172.21.15.44:3300/0 conn(0x7fc36017f190 msgr2=0x7fc36017f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:35.065 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 --2- 172.21.15.38:0/3891434638 >> v2:172.21.15.44:3300/0 conn(0x7fc36017f190 0x7fc36017f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.065 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 -- 172.21.15.38:0/3891434638 >> v1:172.21.15.163:6789/0 conn(0x7fc3600c75c0 legacy=0x7fc3600c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.065 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 -- 172.21.15.38:0/3891434638 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36017e4a0 con 0x7fc36017b640 2023-11-06T13:27:35.065 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.058+0000 7fc365c82700 1 --2- 172.21.15.38:0/3891434638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc360084a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc360086520 tx=0x7fc3500090f0).ready entity=mon.0 client_cookie=25a3e52dbfa7318f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:35.065 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc364c80700 1 -- 172.21.15.38:0/3891434638 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000b600 con 0x7fc36017b640 2023-11-06T13:27:35.066 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc364c80700 1 -- 172.21.15.38:0/3891434638 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35000b760 con 0x7fc36017b640 2023-11-06T13:27:35.066 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc364c80700 1 -- 172.21.15.38:0/3891434638 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000bae0 con 0x7fc36017b640 2023-11-06T13:27:35.066 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 -- 172.21.15.38:0/3891434638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 msgr2=0x7fc360084a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.066 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 --2- 172.21.15.38:0/3891434638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc360084a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc360086520 tx=0x7fc3500090f0).stop 2023-11-06T13:27:35.067 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 -- 172.21.15.38:0/3891434638 shutdown_connections 2023-11-06T13:27:35.067 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 --2- 172.21.15.38:0/3891434638 >> v2:172.21.15.44:3300/0 conn(0x7fc36017f190 0x7fc36017f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.067 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 --2- 172.21.15.38:0/3891434638 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc360084a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.067 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 -- 172.21.15.38:0/3891434638 >> 172.21.15.38:0/3891434638 conn(0x7fc360083cd0 msgr2=0x7fc3600840e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:35.067 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 -- 172.21.15.38:0/3891434638 shutdown_connections 2023-11-06T13:27:35.068 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.059+0000 7fc367ee6700 1 -- 172.21.15.38:0/3891434638 wait complete. 2023-11-06T13:27:35.070 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.061+0000 7fc367ee6700 1 Processor -- start 2023-11-06T13:27:35.071 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.061+0000 7fc367ee6700 1 -- start start 2023-11-06T13:27:35.071 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3600c75c0 0x7fc36018d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.071 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc36018c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.071 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36017f190 0x7fc3600c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.071 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36018ca10 con 0x7fc36017b640 2023-11-06T13:27:35.072 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36018d4e0 con 0x7fc36017f190 2023-11-06T13:27:35.072 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c4690 con 0x7fc3600c75c0 2023-11-06T13:27:35.072 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc36018c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.072 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc36018c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37620/0 (socket says 172.21.15.38:37620) 2023-11-06T13:27:35.073 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 -- 172.21.15.38:0/2962751390 learned_addr learned my addr 172.21.15.38:0/2962751390 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:35.073 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc366483700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36017f190 0x7fc3600c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.073 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365c82700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3600c75c0 0x7fc36018d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.073 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 -- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3600c75c0 msgr2=0x7fc36018d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.073 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3600c75c0 0x7fc36018d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.074 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 -- 172.21.15.38:0/2962751390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36017f190 msgr2=0x7fc3600c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.074 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36017f190 0x7fc3600c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.074 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 -- 172.21.15.38:0/2962751390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009370 con 0x7fc36017b640 2023-11-06T13:27:35.074 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc365481700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc36018c520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc35400c440 tx=0x7fc354007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:35.075 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400cea0 con 0x7fc36017b640 2023-11-06T13:27:35.075 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400f470 con 0x7fc36017b640 2023-11-06T13:27:35.075 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400f830 con 0x7fc36017b640 2023-11-06T13:27:35.075 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.062+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36018cc40 con 0x7fc36017b640 2023-11-06T13:27:35.075 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.063+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36018d200 con 0x7fc36017b640 2023-11-06T13:27:35.076 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.064+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3600475a0 con 0x7fc36017b640 2023-11-06T13:27:35.076 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.064+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fc35400fbe0 con 0x7fc36017b640 2023-11-06T13:27:35.076 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.065+0000 7fc35dffb700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc34c08cb40 0x7fc34c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.076 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.065+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6756+0+0 (secure 0 0 0) 0x7fc3540b0c50 con 0x7fc36017b640 2023-11-06T13:27:35.076 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.065+0000 7fc365c82700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc34c08cb40 0x7fc34c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.077 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.066+0000 7fc365c82700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc34c08cb40 0x7fc34c08f000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc350009130 tx=0x7fc350017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:35.077 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.070+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc3540b6020 con 0x7fc36017b640 2023-11-06T13:27:35.250 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.246+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc36017e780 con 0x7fc36017b640 2023-11-06T13:27:35.251 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.247+0000 7fc35dffb700 1 -- 172.21.15.38:0/2962751390 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16907 (secure 0 0 0) 0x7fc354017030 con 0x7fc36017b640 2023-11-06T13:27:35.251 INFO:teuthology.misc.health.smithi038.stdout: 2023-11-06T13:27:35.252 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":19,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:34.295953+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:35.253 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc34c08cb40 msgr2=0x7fc34c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.253 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc34c08cb40 0x7fc34c08f000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc350009130 tx=0x7fc350017000).stop 2023-11-06T13:27:35.253 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 msgr2=0x7fc36018c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.254 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc36018c520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc35400c440 tx=0x7fc354007db0).stop 2023-11-06T13:27:35.254 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 shutdown_connections 2023-11-06T13:27:35.254 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc34c08cb40 0x7fc34c08f000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.254 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36017f190 0x7fc3600c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.255 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3600c75c0 0x7fc36018d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.255 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 --2- 172.21.15.38:0/2962751390 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc36017b640 0x7fc36018c520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.255 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 >> 172.21.15.38:0/2962751390 conn(0x7fc360083cd0 msgr2=0x7fc3600ef6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:35.255 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 shutdown_connections 2023-11-06T13:27:35.255 INFO:teuthology.misc.health.smithi038.stderr:2023-11-06T13:27:35.249+0000 7fc367ee6700 1 -- 172.21.15.38:0/2962751390 wait complete. 2023-11-06T13:27:35.264 DEBUG:teuthology.misc:12 of 12 OSDs are up 2023-11-06T13:27:35.264 INFO:tasks.ceph:Creating RBD pool 2023-11-06T13:27:35.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-06T13:27:35.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.381+0000 7f80c28a2700 1 Processor -- start 2023-11-06T13:27:35.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.381+0000 7f80c28a2700 1 -- start start 2023-11-06T13:27:35.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c28a2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f80bc171e20 0x7f80bc17f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c28a2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f80bc17d830 0x7f80bc17dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c28a2700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f80bc17e1a0 0x7f80bc083bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c28a2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc172200 con 0x7f80bc171e20 2023-11-06T13:27:35.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c28a2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc17d3a0 con 0x7f80bc17d830 2023-11-06T13:27:35.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c28a2700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc17c7d0 con 0x7f80bc17e1a0 2023-11-06T13:27:35.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f80bc171e20 0x7f80bc17f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f80bc171e20 0x7f80bc17f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37630/0 (socket says 172.21.15.38:37630) 2023-11-06T13:27:35.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 -- 172.21.15.38:0/1234366061 learned_addr learned my addr 172.21.15.38:0/1234366061 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:35.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bb7fe700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.44:3300/0 conn(0x7f80bc17d830 0x7f80bc17dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c0e3f700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.163:3300/0 conn(0x7f80bc17e1a0 0x7f80bc083bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 -- 172.21.15.38:0/1234366061 >> v2:172.21.15.163:3300/0 conn(0x7f80bc17e1a0 msgr2=0x7f80bc083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:35.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.163:3300/0 conn(0x7f80bc17e1a0 0x7f80bc083bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 -- 172.21.15.38:0/1234366061 >> v2:172.21.15.44:3300/0 conn(0x7f80bc17d830 msgr2=0x7f80bc17dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:35.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.44:3300/0 conn(0x7f80bc17d830 0x7f80bc17dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 -- 172.21.15.38:0/1234366061 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc17f660 con 0x7f80bc171e20 2023-11-06T13:27:35.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80c0e3f700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.163:3300/0 conn(0x7f80bc17e1a0 0x7f80bc083bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:35.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bb7fe700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.44:3300/0 conn(0x7f80bc17d830 0x7f80bc17dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:35.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.382+0000 7f80bbfff700 1 --2- 172.21.15.38:0/1234366061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc171e20 0x7f80bc17f170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f80bc0ca3b0 tx=0x7f80ac0090f0).ready entity=mon.0 client_cookie=ee1b15a12fe969e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:35.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80baffd700 1 -- 172.21.15.38:0/1234366061 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00b600 con 0x7f80bc171e20 2023-11-06T13:27:35.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80baffd700 1 -- 172.21.15.38:0/1234366061 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00b760 con 0x7f80bc171e20 2023-11-06T13:27:35.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80baffd700 1 -- 172.21.15.38:0/1234366061 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00bb00 con 0x7f80bc171e20 2023-11-06T13:27:35.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 -- 172.21.15.38:0/1234366061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc171e20 msgr2=0x7f80bc17f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 --2- 172.21.15.38:0/1234366061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc171e20 0x7f80bc17f170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f80bc0ca3b0 tx=0x7f80ac0090f0).stop 2023-11-06T13:27:35.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 -- 172.21.15.38:0/1234366061 shutdown_connections 2023-11-06T13:27:35.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.163:3300/0 conn(0x7f80bc17e1a0 0x7f80bc083bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 --2- 172.21.15.38:0/1234366061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc171e20 0x7f80bc17f170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 --2- 172.21.15.38:0/1234366061 >> v2:172.21.15.44:3300/0 conn(0x7f80bc17d830 0x7f80bc17dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 -- 172.21.15.38:0/1234366061 >> 172.21.15.38:0/1234366061 conn(0x7f80bc0eed10 msgr2=0x7f80bc05e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:35.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 -- 172.21.15.38:0/1234366061 shutdown_connections 2023-11-06T13:27:35.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.383+0000 7f80c28a2700 1 -- 172.21.15.38:0/1234366061 wait complete. 2023-11-06T13:27:35.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.385+0000 7f80c28a2700 1 Processor -- start 2023-11-06T13:27:35.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.385+0000 7f80c28a2700 1 -- start start 2023-11-06T13:27:35.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c28a2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80bc171e20 0x7f80bc0ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c28a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 0x7f80bc0f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c28a2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80bc17e1a0 0x7f80bc0c0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c28a2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0ef890 con 0x7f80bc17d830 2023-11-06T13:27:35.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c28a2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0f0980 con 0x7f80bc17e1a0 2023-11-06T13:27:35.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c28a2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0f1300 con 0x7f80bc171e20 2023-11-06T13:27:35.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 0x7f80bc0f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 0x7f80bc0f0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37638/0 (socket says 172.21.15.38:37638) 2023-11-06T13:27:35.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 -- 172.21.15.38:0/3739937090 learned_addr learned my addr 172.21.15.38:0/3739937090 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:35.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bbfff700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80bc171e20 0x7f80bc0ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80c0e3f700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80bc17e1a0 0x7f80bc0c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 -- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80bc171e20 msgr2=0x7f80bc0ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80bc171e20 0x7f80bc0ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 -- 172.21.15.38:0/3739937090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80bc17e1a0 msgr2=0x7f80bc0c0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:35.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80bc17e1a0 0x7f80bc0c0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:35.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 -- 172.21.15.38:0/3739937090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac009370 con 0x7f80bc17d830 2023-11-06T13:27:35.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.386+0000 7f80bb7fe700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 0x7f80bc0f0e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f80b000d890 tx=0x7f80b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:35.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.387+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011590 con 0x7f80bc17d830 2023-11-06T13:27:35.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.387+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b00116f0 con 0x7f80bc17d830 2023-11-06T13:27:35.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.387+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc0efa90 con 0x7f80bc17d830 2023-11-06T13:27:35.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.387+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0011a70 con 0x7f80bc17d830 2023-11-06T13:27:35.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.387+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc0f0050 con 0x7f80bc17d830 2023-11-06T13:27:35.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.388+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc0f0b30 con 0x7f80bc17d830 2023-11-06T13:27:35.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.388+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f80b0012420 con 0x7f80bc17d830 2023-11-06T13:27:35.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.389+0000 7f80a3fff700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f80a808cb40 0x7f80a808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:35.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.389+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6756+0+0 (secure 0 0 0) 0x7f80b00b1150 con 0x7f80bc17d830 2023-11-06T13:27:35.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.389+0000 7f80bbfff700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f80a808cb40 0x7f80a808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:35.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.390+0000 7f80bbfff700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f80a808cb40 0x7f80a808f000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f80bc0ca3b0 tx=0x7f80ac017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:35.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.393+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f80bc0f0b30 con 0x7f80bc17d830 2023-11-06T13:27:35.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:35.567+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f80bc0f0b30 con 0x7f80bc17d830 2023-11-06T13:27:36.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.339+0000 7f80a3fff700 1 -- 172.21.15.38:0/3739937090 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v21) v1 ==== 109+0+0 (secure 0 0 0) 0x7f80bc0f0b30 con 0x7f80bc17d830 2023-11-06T13:27:36.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f80a808cb40 msgr2=0x7f80a808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:36.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f80a808cb40 0x7f80a808f000 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f80bc0ca3b0 tx=0x7f80ac017000).stop 2023-11-06T13:27:36.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 msgr2=0x7f80bc0f0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:36.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 0x7f80bc0f0e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f80b000d890 tx=0x7f80b0008040).stop 2023-11-06T13:27:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 shutdown_connections 2023-11-06T13:27:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f80a808cb40 0x7f80a808f000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80bc17e1a0 0x7f80bc0c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80bc171e20 0x7f80bc0ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 --2- 172.21.15.38:0/3739937090 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f80bc17d830 0x7f80bc0f0e10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 >> 172.21.15.38:0/3739937090 conn(0x7f80bc0eed10 msgr2=0x7f80bc065f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:36.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 shutdown_connections 2023-11-06T13:27:36.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.342+0000 7f80c28a2700 1 -- 172.21.15.38:0/3739937090 wait complete. 2023-11-06T13:27:36.348 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2023-11-06T13:27:36.361 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-06T13:27:36.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.485+0000 7fa641ad3700 1 Processor -- start 2023-11-06T13:27:36.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.485+0000 7fa641ad3700 1 -- start start 2023-11-06T13:27:36.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa641ad3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa63c178680 0x7fa63c0ee250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:36.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa641ad3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa63c0eca50 0x7fa63c083bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:36.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa641ad3700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c0eddc0 con 0x7fa63c0840b0 2023-11-06T13:27:36.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa641ad3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0eced0 con 0x7fa63c0eca50 2023-11-06T13:27:36.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa641ad3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0ed1b0 con 0x7fa63c178680 2023-11-06T13:27:36.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa63c0eca50 0x7fa63c083bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:36.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa63c0eca50 0x7fa63c083bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58464/0 (socket says 172.21.15.38:58464) 2023-11-06T13:27:36.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 -- 172.21.15.38:0/2678521347 learned_addr learned my addr 172.21.15.38:0/2678521347 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:36.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63b7fe700 1 --2- 172.21.15.38:0/2678521347 >> v2:172.21.15.163:3300/0 conn(0x7fa63c178680 0x7fa63c0ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:36.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 -- 172.21.15.38:0/2678521347 >> v2:172.21.15.163:3300/0 conn(0x7fa63c178680 msgr2=0x7fa63c0ee250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:36.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 --2- 172.21.15.38:0/2678521347 >> v2:172.21.15.163:3300/0 conn(0x7fa63c178680 0x7fa63c0ee250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 -- 172.21.15.38:0/2678521347 >> v1:172.21.15.163:6789/0 conn(0x7fa63c0840b0 legacy=0x7fa63c178a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:36.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63affd700 1 -- 172.21.15.38:0/2678521347 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0ed490 con 0x7fa63c0eca50 2023-11-06T13:27:36.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.486+0000 7fa63b7fe700 1 --2- 172.21.15.38:0/2678521347 >> v2:172.21.15.163:3300/0 conn(0x7fa63c178680 0x7fa63c0ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:36.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa63affd700 1 --2- 172.21.15.38:0/2678521347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0eca50 0x7fa63c083bc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa63c0f1fc0 tx=0x7fa6300090f0).ready entity=mon.0 client_cookie=36a2292cc5f2a959 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:36.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa63a7fc700 1 -- 172.21.15.38:0/2678521347 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000b600 con 0x7fa63c0eca50 2023-11-06T13:27:36.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa63a7fc700 1 -- 172.21.15.38:0/2678521347 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63000b760 con 0x7fa63c0eca50 2023-11-06T13:27:36.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa63a7fc700 1 -- 172.21.15.38:0/2678521347 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000bb00 con 0x7fa63c0eca50 2023-11-06T13:27:36.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 -- 172.21.15.38:0/2678521347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0eca50 msgr2=0x7fa63c083bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:36.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 --2- 172.21.15.38:0/2678521347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0eca50 0x7fa63c083bc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa63c0f1fc0 tx=0x7fa6300090f0).stop 2023-11-06T13:27:36.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 -- 172.21.15.38:0/2678521347 shutdown_connections 2023-11-06T13:27:36.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 --2- 172.21.15.38:0/2678521347 >> v2:172.21.15.163:3300/0 conn(0x7fa63c178680 0x7fa63c0ee250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 --2- 172.21.15.38:0/2678521347 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0eca50 0x7fa63c083bc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 -- 172.21.15.38:0/2678521347 >> 172.21.15.38:0/2678521347 conn(0x7fa63c0f2b30 msgr2=0x7fa63c0eeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:36.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 -- 172.21.15.38:0/2678521347 shutdown_connections 2023-11-06T13:27:36.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.487+0000 7fa641ad3700 1 -- 172.21.15.38:0/2678521347 wait complete. 2023-11-06T13:27:36.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.489+0000 7fa641ad3700 1 Processor -- start 2023-11-06T13:27:36.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.489+0000 7fa641ad3700 1 -- start start 2023-11-06T13:27:36.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa641ad3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 0x7fa63c177570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:36.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa641ad3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa63c0eca50 0x7fa63c14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:36.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa641ad3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa63c178680 0x7fa63c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:36.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa641ad3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c154090 con 0x7fa63c0840b0 2023-11-06T13:27:36.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa641ad3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c155380 con 0x7fa63c0eca50 2023-11-06T13:27:36.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa641ad3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c14d310 con 0x7fa63c178680 2023-11-06T13:27:36.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 0x7fa63c177570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:36.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 0x7fa63c177570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58474/0 (socket says 172.21.15.38:58474) 2023-11-06T13:27:36.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 -- 172.21.15.38:0/416845627 learned_addr learned my addr 172.21.15.38:0/416845627 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:36.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63bfff700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa63c178680 0x7fa63c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:36.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63affd700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa63c0eca50 0x7fa63c14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:36.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 -- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa63c178680 msgr2=0x7fa63c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:36.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa63c178680 0x7fa63c14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 -- 172.21.15.38:0/416845627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa63c0eca50 msgr2=0x7fa63c14c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:36.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa63c0eca50 0x7fa63c14c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:36.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 -- 172.21.15.38:0/416845627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630009370 con 0x7fa63c0840b0 2023-11-06T13:27:36.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63bfff700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa63c178680 0x7fa63c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:36.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63affd700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa63c0eca50 0x7fa63c14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:36.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.490+0000 7fa63b7fe700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 0x7fa63c177570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa62c00d860 tx=0x7fa62c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:36.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.491+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c011590 con 0x7fa63c0840b0 2023-11-06T13:27:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.491+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c0116f0 con 0x7fa63c0840b0 2023-11-06T13:27:36.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.491+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c14d5f0 con 0x7fa63c0840b0 2023-11-06T13:27:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.491+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c011a70 con 0x7fa63c0840b0 2023-11-06T13:27:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.491+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c153a40 con 0x7fa63c0840b0 2023-11-06T13:27:36.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.492+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c06c580 con 0x7fa63c0840b0 2023-11-06T13:27:36.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.493+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fa62c01c460 con 0x7fa63c0840b0 2023-11-06T13:27:36.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.493+0000 7fa6237fe700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa62808cb40 0x7fa62808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:36.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.493+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7098+0+0 (secure 0 0 0) 0x7fa62c0b17b0 con 0x7fa63c0840b0 2023-11-06T13:27:36.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.493+0000 7fa63affd700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa62808cb40 0x7fa62808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:36.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.494+0000 7fa63affd700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa62808cb40 0x7fa62808f000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa63c0f1fc0 tx=0x7fa630017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:36.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.498+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa62c0824b0 con 0x7fa63c0840b0 2023-11-06T13:27:36.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:36.672+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa63c0ed770 con 0x7fa63c0840b0 2023-11-06T13:27:37.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.342+0000 7fa6237fe700 1 -- 172.21.15.38:0/416845627 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v22) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa62c085ad0 con 0x7fa63c0840b0 2023-11-06T13:27:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa62808cb40 msgr2=0x7fa62808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa62808cb40 0x7fa62808f000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa63c0f1fc0 tx=0x7fa630017000).stop 2023-11-06T13:27:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 msgr2=0x7fa63c177570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 0x7fa63c177570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa62c00d860 tx=0x7fa62c008040).stop 2023-11-06T13:27:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 shutdown_connections 2023-11-06T13:27:37.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa63c178680 0x7fa63c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.345+0000 7fa641ad3700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa63c0840b0 0x7fa63c177570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.346+0000 7fa641ad3700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa62808cb40 0x7fa62808f000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.346+0000 7fa641ad3700 1 --2- 172.21.15.38:0/416845627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa63c0eca50 0x7fa63c14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.346+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 >> 172.21.15.38:0/416845627 conn(0x7fa63c0f2b30 msgr2=0x7fa63c0efee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.346+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 shutdown_connections 2023-11-06T13:27:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.346+0000 7fa641ad3700 1 -- 172.21.15.38:0/416845627 wait complete. 2023-11-06T13:27:37.352 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-06T13:27:37.364 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-06T13:27:37.365 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-06T13:27:37.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-06T13:27:37.367 INFO:tasks.ceph.mds.a:Started 2023-11-06T13:27:37.368 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-06T13:27:37.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-06T13:27:37.370 INFO:tasks.ceph.mds.d:Started 2023-11-06T13:27:37.371 INFO:tasks.ceph.mds.g:Restarting daemon 2023-11-06T13:27:37.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2023-11-06T13:27:37.373 INFO:tasks.ceph.mds.g:Started 2023-11-06T13:27:37.374 INFO:tasks.ceph.mds.j:Restarting daemon 2023-11-06T13:27:37.374 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i j 2023-11-06T13:27:37.376 INFO:tasks.ceph.mds.j:Started 2023-11-06T13:27:37.377 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-06T13:27:37.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-06T13:27:37.379 INFO:tasks.ceph.mds.b:Started 2023-11-06T13:27:37.380 INFO:tasks.ceph.mds.e:Restarting daemon 2023-11-06T13:27:37.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-11-06T13:27:37.382 INFO:tasks.ceph.mds.e:Started 2023-11-06T13:27:37.383 INFO:tasks.ceph.mds.h:Restarting daemon 2023-11-06T13:27:37.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2023-11-06T13:27:37.385 INFO:tasks.ceph.mds.h:Started 2023-11-06T13:27:37.386 INFO:tasks.ceph.mds.k:Restarting daemon 2023-11-06T13:27:37.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i k 2023-11-06T13:27:37.388 INFO:tasks.ceph.mds.k:Started 2023-11-06T13:27:37.388 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-06T13:27:37.389 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-06T13:27:37.391 INFO:tasks.ceph.mds.c:Started 2023-11-06T13:27:37.392 INFO:tasks.ceph.mds.f:Restarting daemon 2023-11-06T13:27:37.392 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2023-11-06T13:27:37.394 INFO:tasks.ceph.mds.f:Started 2023-11-06T13:27:37.395 INFO:tasks.ceph.mds.i:Restarting daemon 2023-11-06T13:27:37.395 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2023-11-06T13:27:37.397 INFO:tasks.ceph.mds.i:Started 2023-11-06T13:27:37.398 INFO:tasks.ceph.mds.l:Restarting daemon 2023-11-06T13:27:37.398 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i l 2023-11-06T13:27:37.400 INFO:tasks.ceph.mds.l:Started 2023-11-06T13:27:37.401 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-06T13:27:37.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:37.452 INFO:tasks.ceph.mds.a.smithi038.stdout:starting mds.a at 2023-11-06T13:27:37.456 INFO:tasks.ceph.mds.d.smithi038.stdout:starting mds.d at 2023-11-06T13:27:37.462 INFO:tasks.ceph.mds.g.smithi038.stdout:starting mds.g at 2023-11-06T13:27:37.467 INFO:tasks.ceph.mds.b.smithi044.stdout:starting mds.b at 2023-11-06T13:27:37.468 INFO:tasks.ceph.mds.e.smithi044.stdout:starting mds.e at 2023-11-06T13:27:37.469 INFO:tasks.ceph.mds.e.smithi044.stderr:2023-11-06T13:27:37.467+0000 7f40d2fc4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2023-11-06T13:27:37.471 INFO:tasks.ceph.mds.h.smithi044.stdout:starting mds.h at 2023-11-06T13:27:37.473 INFO:tasks.ceph.mds.j.smithi038.stdout:starting mds.j at 2023-11-06T13:27:37.475 INFO:tasks.ceph.mds.k.smithi044.stdout:starting mds.k at 2023-11-06T13:27:37.479 INFO:tasks.ceph.mds.f.smithi163.stdout:starting mds.f at 2023-11-06T13:27:37.480 INFO:tasks.ceph.mds.c.smithi163.stdout:starting mds.c at 2023-11-06T13:27:37.483 INFO:tasks.ceph.mds.i.smithi163.stdout:starting mds.i at 2023-11-06T13:27:37.488 INFO:tasks.ceph.mds.l.smithi163.stdout:starting mds.l at 2023-11-06T13:27:37.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.540+0000 7f54023da700 1 Processor -- start 2023-11-06T13:27:37.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.540+0000 7f54023da700 1 -- start start 2023-11-06T13:27:37.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.541+0000 7f54023da700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53fc1752a0 0x7f53fc182a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.541+0000 7f54023da700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f53fc175680 0x7f53fc17ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.541+0000 7f54023da700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53fc0871b0 con 0x7f53fc180420 2023-11-06T13:27:37.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.541+0000 7f54023da700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc0882f0 con 0x7f53fc1752a0 2023-11-06T13:27:37.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.541+0000 7f54023da700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53fc182ef0 con 0x7f53fc175680 2023-11-06T13:27:37.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f54013d8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f53fc1752a0 0x7f53fc182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f5401bd9700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f53fc180420 0x7f53fc0efb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60624/0 (socket says 172.21.15.38:60624) 2023-11-06T13:27:37.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f5401bd9700 1 -- 172.21.15.38:0/3669188130 learned_addr learned my addr 172.21.15.38:0/3669188130 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:37.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f5400bd7700 1 --2- 172.21.15.38:0/3669188130 >> v2:172.21.15.163:3300/0 conn(0x7f53fc175680 0x7f53fc17ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f54013d8700 1 -- 172.21.15.38:0/3669188130 >> v2:172.21.15.163:3300/0 conn(0x7f53fc175680 msgr2=0x7f53fc17ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f54013d8700 1 --2- 172.21.15.38:0/3669188130 >> v2:172.21.15.163:3300/0 conn(0x7f53fc175680 0x7f53fc17ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f54013d8700 1 -- 172.21.15.38:0/3669188130 >> v1:172.21.15.38:6789/0 conn(0x7f53fc180420 legacy=0x7f53fc0efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f54013d8700 1 -- 172.21.15.38:0/3669188130 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc180850 con 0x7f53fc1752a0 2023-11-06T13:27:37.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f54013d8700 1 --2- 172.21.15.38:0/3669188130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc1752a0 0x7f53fc182a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f53fc0f1c60 tx=0x7f53f8009060).ready entity=mon.0 client_cookie=7592bb4c92440a75 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f53f3fff700 1 -- 172.21.15.38:0/3669188130 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f80090d0 con 0x7f53fc1752a0 2023-11-06T13:27:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f53f3fff700 1 -- 172.21.15.38:0/3669188130 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f800f510 con 0x7f53fc1752a0 2023-11-06T13:27:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.542+0000 7f53f3fff700 1 -- 172.21.15.38:0/3669188130 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800f890 con 0x7f53fc1752a0 2023-11-06T13:27:37.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 -- 172.21.15.38:0/3669188130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc1752a0 msgr2=0x7f53fc182a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 --2- 172.21.15.38:0/3669188130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc1752a0 0x7f53fc182a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f53fc0f1c60 tx=0x7f53f8009060).stop 2023-11-06T13:27:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 -- 172.21.15.38:0/3669188130 shutdown_connections 2023-11-06T13:27:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 --2- 172.21.15.38:0/3669188130 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc1752a0 0x7f53fc182a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 --2- 172.21.15.38:0/3669188130 >> v2:172.21.15.163:3300/0 conn(0x7f53fc175680 0x7f53fc17ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 -- 172.21.15.38:0/3669188130 >> 172.21.15.38:0/3669188130 conn(0x7f53fc0f51f0 msgr2=0x7f53fc0f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:37.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 -- 172.21.15.38:0/3669188130 shutdown_connections 2023-11-06T13:27:37.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.543+0000 7f54023da700 1 -- 172.21.15.38:0/3669188130 wait complete. 2023-11-06T13:27:37.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.544+0000 7f54023da700 1 Processor -- start 2023-11-06T13:27:37.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.544+0000 7f54023da700 1 -- start start 2023-11-06T13:27:37.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f54023da700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53fc1752a0 0x7f53fc1737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f54023da700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 0x7f53fc085d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f54023da700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc180420 0x7f53fc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f54023da700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc156cb0 con 0x7f53fc175680 2023-11-06T13:27:37.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f54023da700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc086650 con 0x7f53fc180420 2023-11-06T13:27:37.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f54023da700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc086930 con 0x7f53fc1752a0 2023-11-06T13:27:37.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f5400bd7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 0x7f53fc085d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f5400bd7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 0x7f53fc085d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58536/0 (socket says 172.21.15.38:58536) 2023-11-06T13:27:37.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.545+0000 7f5400bd7700 1 -- 172.21.15.38:0/3927235701 learned_addr learned my addr 172.21.15.38:0/3927235701 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:37.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5401bd9700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc180420 0x7f53fc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f54013d8700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53fc1752a0 0x7f53fc1737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5400bd7700 1 -- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53fc1752a0 msgr2=0x7f53fc1737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5400bd7700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53fc1752a0 0x7f53fc1737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5400bd7700 1 -- 172.21.15.38:0/3927235701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc180420 msgr2=0x7f53fc157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5400bd7700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc180420 0x7f53fc157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5400bd7700 1 -- 172.21.15.38:0/3927235701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80092a0 con 0x7f53fc175680 2023-11-06T13:27:37.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f5400bd7700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 0x7f53fc085d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f53ec00e900 tx=0x7f53ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:37.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec012600 con 0x7f53fc175680 2023-11-06T13:27:37.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec012760 con 0x7f53fc175680 2023-11-06T13:27:37.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc086c10 con 0x7f53fc175680 2023-11-06T13:27:37.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec012ae0 con 0x7f53fc175680 2023-11-06T13:27:37.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.546+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc173ce0 con 0x7f53fc175680 2023-11-06T13:27:37.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.547+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc1567a0 con 0x7f53fc175680 2023-11-06T13:27:37.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.548+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f53ec01b400 con 0x7f53fc175680 2023-11-06T13:27:37.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.548+0000 7f53f17fa700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f53e008cb40 0x7f53e008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.548+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f53ec0b1c70 con 0x7f53fc175680 2023-11-06T13:27:37.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.549+0000 7f54013d8700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f53e008cb40 0x7f53e008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.549+0000 7f54013d8700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f53e008cb40 0x7f53e008f000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f53fc0f1c60 tx=0x7f53f8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:37.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.552+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f53fc1567a0 con 0x7f53fc175680 2023-11-06T13:27:37.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.726+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53fc1567a0 con 0x7f53fc175680 2023-11-06T13:27:37.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.727+0000 7f53f17fa700 1 -- 172.21.15.38:0/3927235701 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f53fc1567a0 con 0x7f53fc175680 2023-11-06T13:27:37.731 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:37.731 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":22,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:37.334583+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:37.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f53e008cb40 msgr2=0x7f53e008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f53e008cb40 0x7f53e008f000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f53fc0f1c60 tx=0x7f53f8017000).stop 2023-11-06T13:27:37.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 msgr2=0x7f53fc085d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 0x7f53fc085d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f53ec00e900 tx=0x7f53ec009060).stop 2023-11-06T13:27:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 shutdown_connections 2023-11-06T13:27:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f53e008cb40 0x7f53e008f000 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53fc180420 0x7f53fc157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f53fc1752a0 0x7f53fc1737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 --2- 172.21.15.38:0/3927235701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f53fc175680 0x7f53fc085d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 >> 172.21.15.38:0/3927235701 conn(0x7f53fc0f51f0 msgr2=0x7f53fc0f1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 shutdown_connections 2023-11-06T13:27:37.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.729+0000 7f54023da700 1 -- 172.21.15.38:0/3927235701 wait complete. 2023-11-06T13:27:37.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-06T13:27:37.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:27:37.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.862+0000 7f628d120700 1 Processor -- start 2023-11-06T13:27:37.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.862+0000 7f628d120700 1 -- start start 2023-11-06T13:27:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.863+0000 7f628d120700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6288175a40 0x7f628817f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.863+0000 7f628d120700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f628817fb80 0x7f628817e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.863+0000 7f628d120700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f628817e750 0x7f62880efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.863+0000 7f628d120700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628817ddd0 con 0x7f628817fb80 2023-11-06T13:27:37.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.863+0000 7f628d120700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6288064780 con 0x7f628817e750 2023-11-06T13:27:37.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.863+0000 7f628d120700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62880c4c20 con 0x7f6288175a40 2023-11-06T13:27:37.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f628817fb80 0x7f628817e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f628817fb80 0x7f628817e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58540/0 (socket says 172.21.15.38:58540) 2023-11-06T13:27:37.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 -- 172.21.15.38:0/2674921982 learned_addr learned my addr 172.21.15.38:0/2674921982 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:37.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f6286d9d700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.163:3300/0 conn(0x7f6288175a40 0x7f628817f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628759e700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.44:3300/0 conn(0x7f628817e750 0x7f62880efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 -- 172.21.15.38:0/2674921982 >> v2:172.21.15.163:3300/0 conn(0x7f6288175a40 msgr2=0x7f628817f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:37.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.163:3300/0 conn(0x7f6288175a40 0x7f628817f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 -- 172.21.15.38:0/2674921982 >> v2:172.21.15.44:3300/0 conn(0x7f628817e750 msgr2=0x7f62880efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:37.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.44:3300/0 conn(0x7f628817e750 0x7f62880efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 -- 172.21.15.38:0/2674921982 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628817cee0 con 0x7f628817fb80 2023-11-06T13:27:37.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628759e700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.44:3300/0 conn(0x7f628817e750 0x7f62880efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:37.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f628659c700 1 --2- 172.21.15.38:0/2674921982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817fb80 0x7f628817e260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6288157d50 tx=0x7f62700090f0).ready entity=mon.0 client_cookie=483c75195166f4eb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:37.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f6285d9b700 1 -- 172.21.15.38:0/2674921982 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000b520 con 0x7f628817fb80 2023-11-06T13:27:37.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f6285d9b700 1 -- 172.21.15.38:0/2674921982 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000b680 con 0x7f628817fb80 2023-11-06T13:27:37.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.864+0000 7f6285d9b700 1 -- 172.21.15.38:0/2674921982 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627000ba00 con 0x7f628817fb80 2023-11-06T13:27:37.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 -- 172.21.15.38:0/2674921982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817fb80 msgr2=0x7f628817e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 --2- 172.21.15.38:0/2674921982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817fb80 0x7f628817e260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6288157d50 tx=0x7f62700090f0).stop 2023-11-06T13:27:37.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 -- 172.21.15.38:0/2674921982 shutdown_connections 2023-11-06T13:27:37.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.163:3300/0 conn(0x7f6288175a40 0x7f628817f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 --2- 172.21.15.38:0/2674921982 >> v2:172.21.15.44:3300/0 conn(0x7f628817e750 0x7f62880efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 --2- 172.21.15.38:0/2674921982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817fb80 0x7f628817e260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 -- 172.21.15.38:0/2674921982 >> 172.21.15.38:0/2674921982 conn(0x7f628806a970 msgr2=0x7f62880f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:37.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 -- 172.21.15.38:0/2674921982 shutdown_connections 2023-11-06T13:27:37.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.865+0000 7f628d120700 1 -- 172.21.15.38:0/2674921982 wait complete. 2023-11-06T13:27:37.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.866+0000 7f628d120700 1 Processor -- start 2023-11-06T13:27:37.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.866+0000 7f628d120700 1 -- start start 2023-11-06T13:27:37.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628d120700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6288175a40 0x7f62881802c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628d120700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 0x7f6288156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628d120700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f628817fb80 0x7f62881908e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628d120700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6288156d30 con 0x7f628817e750 2023-11-06T13:27:37.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628d120700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880cd0a0 con 0x7f628817fb80 2023-11-06T13:27:37.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628d120700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880cd530 con 0x7f6288175a40 2023-11-06T13:27:37.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 0x7f6288156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 0x7f6288156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58554/0 (socket says 172.21.15.38:58554) 2023-11-06T13:27:37.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.867+0000 7f628659c700 1 -- 172.21.15.38:0/3841571028 learned_addr learned my addr 172.21.15.38:0/3841571028 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:37.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628759e700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f628817fb80 0x7f62881908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f6286d9d700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6288175a40 0x7f62881802c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628659c700 1 -- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6288175a40 msgr2=0x7f62881802c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628659c700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6288175a40 0x7f62881802c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628659c700 1 -- 172.21.15.38:0/3841571028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f628817fb80 msgr2=0x7f62881908e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:37.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628659c700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f628817fb80 0x7f62881908e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:37.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628659c700 1 -- 172.21.15.38:0/3841571028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270009370 con 0x7f628817e750 2023-11-06T13:27:37.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628759e700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f628817fb80 0x7f62881908e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:37.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f6286d9d700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6288175a40 0x7f62881802c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:37.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628659c700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 0x7f6288156840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6288089d90 tx=0x7f6270017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:37.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270000bc0 con 0x7f628817e750 2023-11-06T13:27:37.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000b7f0 con 0x7f628817e750 2023-11-06T13:27:37.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62880cc1b0 con 0x7f628817e750 2023-11-06T13:27:37.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6270000d20 con 0x7f628817e750 2023-11-06T13:27:37.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.868+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62880cc770 con 0x7f628817e750 2023-11-06T13:27:37.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.869+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628806c580 con 0x7f628817e750 2023-11-06T13:27:37.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.870+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f627001c8c0 con 0x7f628817e750 2023-11-06T13:27:37.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.870+0000 7f627effd700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f626808cb40 0x7f626808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:37.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.870+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f62700b3540 con 0x7f628817e750 2023-11-06T13:27:37.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.871+0000 7f6286d9d700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f626808cb40 0x7f626808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:37.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.871+0000 7f6286d9d700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f626808cb40 0x7f626808f000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f62880c4460 tx=0x7f628000b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:37.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:37.874+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6270084170 con 0x7f628817e750 2023-11-06T13:27:38.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.046+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f62880c4a00 con 0x7f628817e750 2023-11-06T13:27:38.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.046+0000 7f627effd700 1 -- 172.21.15.38:0/3841571028 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f62700200b0 con 0x7f628817e750 2023-11-06T13:27:38.050 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:27:38.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f626808cb40 msgr2=0x7f626808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f626808cb40 0x7f626808f000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f62880c4460 tx=0x7f628000b040).stop 2023-11-06T13:27:38.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 msgr2=0x7f6288156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 0x7f6288156840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6288089d90 tx=0x7f6270017000).stop 2023-11-06T13:27:38.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 shutdown_connections 2023-11-06T13:27:38.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f626808cb40 0x7f626808f000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f628817fb80 0x7f62881908e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6288175a40 0x7f62881802c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 --2- 172.21.15.38:0/3841571028 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f628817e750 0x7f6288156840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 >> 172.21.15.38:0/3841571028 conn(0x7f628806a970 msgr2=0x7f62880efc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:38.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 shutdown_connections 2023-11-06T13:27:38.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.048+0000 7f628d120700 1 -- 172.21.15.38:0/3841571028 wait complete. 2023-11-06T13:27:38.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:27:38.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.182+0000 7f51e4311700 1 Processor -- start 2023-11-06T13:27:38.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.182+0000 7f51e4311700 1 -- start start 2023-11-06T13:27:38.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.183+0000 7f51e4311700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51dc1753b0 0x7f51dc175790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.183+0000 7f51e4311700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f51dc17dd00 0x7f51dc17e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.183+0000 7f51e4311700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc17d870 con 0x7f51dc064020 2023-11-06T13:27:38.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.183+0000 7f51e4311700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc17c980 con 0x7f51dc17dd00 2023-11-06T13:27:38.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.183+0000 7f51e4311700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc17cc60 con 0x7f51dc1753b0 2023-11-06T13:27:38.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f51dc17dd00 0x7f51dc17e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f51dc17dd00 0x7f51dc17e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58564/0 (socket says 172.21.15.38:58564) 2023-11-06T13:27:38.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 -- 172.21.15.38:0/2017459542 learned_addr learned my addr 172.21.15.38:0/2017459542 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:38.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e20ad700 1 --2- 172.21.15.38:0/2017459542 >> v2:172.21.15.44:3300/0 conn(0x7f51dc1753b0 0x7f51dc175790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 -- 172.21.15.38:0/2017459542 >> v2:172.21.15.44:3300/0 conn(0x7f51dc1753b0 msgr2=0x7f51dc175790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:38.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 --2- 172.21.15.38:0/2017459542 >> v2:172.21.15.44:3300/0 conn(0x7f51dc1753b0 0x7f51dc175790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 -- 172.21.15.38:0/2017459542 >> v1:172.21.15.44:6789/0 conn(0x7f51dc064020 legacy=0x7f51dc0644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 -- 172.21.15.38:0/2017459542 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc17cf40 con 0x7f51dc17dd00 2023-11-06T13:27:38.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e28ae700 1 --2- 172.21.15.38:0/2017459542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc17dd00 0x7f51dc17e0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f51dc089f00 tx=0x7f51d40090f0).ready entity=mon.0 client_cookie=342cd6b206d3de45 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e10ab700 1 -- 172.21.15.38:0/2017459542 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400b600 con 0x7f51dc17dd00 2023-11-06T13:27:38.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e10ab700 1 -- 172.21.15.38:0/2017459542 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400b760 con 0x7f51dc17dd00 2023-11-06T13:27:38.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.184+0000 7f51e10ab700 1 -- 172.21.15.38:0/2017459542 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400bae0 con 0x7f51dc17dd00 2023-11-06T13:27:38.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 -- 172.21.15.38:0/2017459542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc17dd00 msgr2=0x7f51dc17e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 --2- 172.21.15.38:0/2017459542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc17dd00 0x7f51dc17e0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f51dc089f00 tx=0x7f51d40090f0).stop 2023-11-06T13:27:38.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 -- 172.21.15.38:0/2017459542 shutdown_connections 2023-11-06T13:27:38.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 --2- 172.21.15.38:0/2017459542 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc17dd00 0x7f51dc17e0e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 --2- 172.21.15.38:0/2017459542 >> v2:172.21.15.44:3300/0 conn(0x7f51dc1753b0 0x7f51dc175790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 -- 172.21.15.38:0/2017459542 >> 172.21.15.38:0/2017459542 conn(0x7f51dc0f5370 msgr2=0x7f51dc0f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:38.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 -- 172.21.15.38:0/2017459542 shutdown_connections 2023-11-06T13:27:38.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.185+0000 7f51e4311700 1 -- 172.21.15.38:0/2017459542 wait complete. 2023-11-06T13:27:38.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.186+0000 7f51e4311700 1 Processor -- start 2023-11-06T13:27:38.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.186+0000 7f51e4311700 1 -- start start 2023-11-06T13:27:38.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e4311700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51dc064020 0x7f51dc150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e4311700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 0x7f51dc17bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e4311700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51dc17dd00 0x7f51dc18fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e4311700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc17b760 con 0x7f51dc1753b0 2023-11-06T13:27:38.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e4311700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc150d70 con 0x7f51dc17dd00 2023-11-06T13:27:38.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e4311700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc17c0e0 con 0x7f51dc064020 2023-11-06T13:27:38.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 0x7f51dc17bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 0x7f51dc17bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58572/0 (socket says 172.21.15.38:58572) 2023-11-06T13:27:38.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 -- 172.21.15.38:0/4159022187 learned_addr learned my addr 172.21.15.38:0/4159022187 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:38.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e20ad700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51dc064020 0x7f51dc150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 -- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51dc064020 msgr2=0x7f51dc150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51dc064020 0x7f51dc150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 -- 172.21.15.38:0/4159022187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51dc17dd00 msgr2=0x7f51dc18fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51dc17dd00 0x7f51dc18fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:38.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.187+0000 7f51e18ac700 1 -- 172.21.15.38:0/4159022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009370 con 0x7f51dc1753b0 2023-11-06T13:27:38.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.188+0000 7f51e18ac700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 0x7f51dc17bbf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f51d000c440 tx=0x7f51d0007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.188+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000f470 con 0x7f51dc1753b0 2023-11-06T13:27:38.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.188+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000f5d0 con 0x7f51dc1753b0 2023-11-06T13:27:38.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.188+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc17a870 con 0x7f51dc1753b0 2023-11-06T13:27:38.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.188+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000f970 con 0x7f51dc1753b0 2023-11-06T13:27:38.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.188+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc17ae30 con 0x7f51dc1753b0 2023-11-06T13:27:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.189+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc06c580 con 0x7f51dc1753b0 2023-11-06T13:27:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.190+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f51d001b3b0 con 0x7f51dc1753b0 2023-11-06T13:27:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.190+0000 7f51da7fc700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f51c808cb40 0x7f51c808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.190+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f51d00b0f30 con 0x7f51dc1753b0 2023-11-06T13:27:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.190+0000 7f51e20ad700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f51c808cb40 0x7f51c808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.191+0000 7f51e20ad700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f51c808cb40 0x7f51c808f000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f51cc0075e0 tx=0x7f51cc0097f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.193+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f51d0048af0 con 0x7f51dc1753b0 2023-11-06T13:27:38.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.368+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51dc17d220 con 0x7f51dc1753b0 2023-11-06T13:27:38.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.369+0000 7f51da7fc700 1 -- 172.21.15.38:0/4159022187 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51d0017030 con 0x7f51dc1753b0 2023-11-06T13:27:38.372 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:27:38.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f51c808cb40 msgr2=0x7f51c808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f51c808cb40 0x7f51c808f000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f51cc0075e0 tx=0x7f51cc0097f0).stop 2023-11-06T13:27:38.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 msgr2=0x7f51dc17bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 0x7f51dc17bbf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f51d000c440 tx=0x7f51d0007dc0).stop 2023-11-06T13:27:38.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 shutdown_connections 2023-11-06T13:27:38.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f51c808cb40 0x7f51c808f000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51dc17dd00 0x7f51dc18fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:38.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f51dc064020 0x7f51dc150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 --2- 172.21.15.38:0/4159022187 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f51dc1753b0 0x7f51dc17bbf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 >> 172.21.15.38:0/4159022187 conn(0x7f51dc0f5370 msgr2=0x7f51dc0f05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:38.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 shutdown_connections 2023-11-06T13:27:38.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.371+0000 7f51e4311700 1 -- 172.21.15.38:0/4159022187 wait complete. 2023-11-06T13:27:38.386 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:27:38.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.503+0000 7fe7523e3700 1 Processor -- start 2023-11-06T13:27:38.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.504+0000 7fe7523e3700 1 -- start start 2023-11-06T13:27:38.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe7523e3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe74c0cb4b0 0x7fe74c1758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe7523e3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c17e680 con 0x7fe74c17c950 2023-11-06T13:27:38.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe7523e3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c17d4f0 con 0x7fe74c175510 2023-11-06T13:27:38.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe7523e3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c17d790 con 0x7fe74c0cb4b0 2023-11-06T13:27:38.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe750980700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe74c17c950 0x7fe74c17cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60632/0 (socket says 172.21.15.38:60632) 2023-11-06T13:27:38.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe750980700 1 -- 172.21.15.38:0/3362219846 learned_addr learned my addr 172.21.15.38:0/3362219846 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:38.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74b7fe700 1 --2- 172.21.15.38:0/3362219846 >> v2:172.21.15.163:3300/0 conn(0x7fe74c0cb4b0 0x7fe74c1758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669275434 0 0) 0x7fe74c17e680 con 0x7fe74c17c950 2023-11-06T13:27:38.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7380033f0 con 0x7fe74c17c950 2023-11-06T13:27:38.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371519781 0 0) 0x7fe74c17d4f0 con 0x7fe74c175510 2023-11-06T13:27:38.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c17e680 con 0x7fe74c175510 2023-11-06T13:27:38.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3736715333 0 0) 0x7fe7380033f0 con 0x7fe74c17c950 2023-11-06T13:27:38.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 >> v2:172.21.15.163:3300/0 conn(0x7fe74c0cb4b0 msgr2=0x7fe74c1758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:38.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 --2- 172.21.15.38:0/3362219846 >> v2:172.21.15.163:3300/0 conn(0x7fe74c0cb4b0 0x7fe74c1758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 >> v1:172.21.15.44:6789/0 conn(0x7fe74c175510 legacy=0x7fe74c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c17da70 con 0x7fe74c17c950 2023-11-06T13:27:38.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7fe7440017f0 con 0x7fe74c17c950 2023-11-06T13:27:38.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 >> v1:172.21.15.38:6789/0 conn(0x7fe74c17c950 legacy=0x7fe74c17cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738003ac0 0x7fe738003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe738004690 0x7fe738004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe738005000 0x7fe73800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.505+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c17d790 con 0x7fe738005000 2023-11-06T13:27:38.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73800bf60 con 0x7fe738003ac0 2023-11-06T13:27:38.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73800c120 con 0x7fe738004690 2023-11-06T13:27:38.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe738005000 0x7fe73800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74bfff700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738003ac0 0x7fe738003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74b7fe700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe738004690 0x7fe738004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 -- 172.21.15.38:0/3362219846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe738004690 msgr2=0x7fe738004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:38.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe738004690 0x7fe738004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 -- 172.21.15.38:0/3362219846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738003ac0 msgr2=0x7fe738003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:38.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738003ac0 0x7fe738003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 -- 172.21.15.38:0/3362219846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380033f0 con 0x7fe738005000 2023-11-06T13:27:38.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 -- 172.21.15.38:0/3362219846 reap_dead start 2023-11-06T13:27:38.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe750980700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe738005000 0x7fe73800b8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe74400c5f0 tx=0x7fe74c17d680).ready entity=mon.0 client_cookie=34c1200113347cb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744001f30 con 0x7fe738005000 2023-11-06T13:27:38.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74400cdf0 con 0x7fe738005000 2023-11-06T13:27:38.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.506+0000 7fe74affd700 1 -- 172.21.15.38:0/3362219846 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744005d50 con 0x7fe738005000 2023-11-06T13:27:38.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 -- 172.21.15.38:0/3362219846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe738005000 msgr2=0x7fe73800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe738005000 0x7fe73800b8e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe74400c5f0 tx=0x7fe74c17d680).stop 2023-11-06T13:27:38.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 -- 172.21.15.38:0/3362219846 shutdown_connections 2023-11-06T13:27:38.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 --2- 172.21.15.38:0/3362219846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe738005000 0x7fe73800b8e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 -- 172.21.15.38:0/3362219846 >> 172.21.15.38:0/3362219846 conn(0x7fe74c0f28b0 msgr2=0x7fe74c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:38.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 -- 172.21.15.38:0/3362219846 shutdown_connections 2023-11-06T13:27:38.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.507+0000 7fe7523e3700 1 -- 172.21.15.38:0/3362219846 wait complete. 2023-11-06T13:27:38.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.508+0000 7fe7523e3700 1 Processor -- start 2023-11-06T13:27:38.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.508+0000 7fe7523e3700 1 -- start start 2023-11-06T13:27:38.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe7523e3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738005000 0x7fe74c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe7523e3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe74c1513b0 0x7fe74c181a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe7523e3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 0x7fe74c0ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe7523e3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0ec410 con 0x7fe74c0ece60 2023-11-06T13:27:38.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe7523e3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c181ef0 con 0x7fe738005000 2023-11-06T13:27:38.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe7523e3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c151830 con 0x7fe74c1513b0 2023-11-06T13:27:38.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe750980700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 0x7fe74c0ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe750980700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 0x7fe74c0ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58588/0 (socket says 172.21.15.38:58588) 2023-11-06T13:27:38.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.509+0000 7fe750980700 1 -- 172.21.15.38:0/1536967911 learned_addr learned my addr 172.21.15.38:0/1536967911 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:38.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe74bfff700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738005000 0x7fe74c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe74b7fe700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe74c1513b0 0x7fe74c181a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe750980700 1 -- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe74c1513b0 msgr2=0x7fe74c181a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe750980700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe74c1513b0 0x7fe74c181a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe750980700 1 -- 172.21.15.38:0/1536967911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738005000 msgr2=0x7fe74c1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe750980700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738005000 0x7fe74c1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe750980700 1 -- 172.21.15.38:0/1536967911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c151ad0 con 0x7fe74c0ece60 2023-11-06T13:27:38.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe74b7fe700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe74c1513b0 0x7fe74c181a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:38.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe74bfff700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738005000 0x7fe74c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:38.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe750980700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 0x7fe74c0ed2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe74400cbe0 tx=0x7fe744015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7440074f0 con 0x7fe74c0ece60 2023-11-06T13:27:38.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe744007650 con 0x7fe74c0ece60 2023-11-06T13:27:38.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c0ec410 con 0x7fe74c0ece60 2023-11-06T13:27:38.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744007a10 con 0x7fe74c0ece60 2023-11-06T13:27:38.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.510+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c152090 con 0x7fe74c0ece60 2023-11-06T13:27:38.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.511+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c0c84f0 con 0x7fe74c0ece60 2023-11-06T13:27:38.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.512+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fe744021670 con 0x7fe74c0ece60 2023-11-06T13:27:38.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.512+0000 7fe743fff700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe72c08cb10 0x7fe72c08efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.512+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fe744019070 con 0x7fe74c0ece60 2023-11-06T13:27:38.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.513+0000 7fe74bfff700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe72c08cb10 0x7fe72c08efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.513+0000 7fe74bfff700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe72c08cb10 0x7fe72c08efd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe73c000c00 tx=0x7fe73c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.516+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe744083b20 con 0x7fe74c0ece60 2023-11-06T13:27:38.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.732+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe74c06c580 con 0x7fe74c0ece60 2023-11-06T13:27:38.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.733+0000 7fe743fff700 1 -- 172.21.15.38:0/1536967911 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+9575 (secure 0 0 0) 0x7fe744087140 con 0x7fe74c0ece60 2023-11-06T13:27:38.737 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:38.737 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4352,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4355,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4361,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-06T13:27:38.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe72c08cb10 msgr2=0x7fe72c08efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe72c08cb10 0x7fe72c08efd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe73c000c00 tx=0x7fe73c009040).stop 2023-11-06T13:27:38.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 msgr2=0x7fe74c0ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 0x7fe74c0ed2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe74400cbe0 tx=0x7fe744015000).stop 2023-11-06T13:27:38.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 shutdown_connections 2023-11-06T13:27:38.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe74c0ece60 0x7fe74c0ed2e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe72c08cb10 0x7fe72c08efd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe738005000 0x7fe74c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 --2- 172.21.15.38:0/1536967911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe74c1513b0 0x7fe74c181a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 >> 172.21.15.38:0/1536967911 conn(0x7fe74c0f28b0 msgr2=0x7fe74c0cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:38.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 shutdown_connections 2023-11-06T13:27:38.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.735+0000 7fe7523e3700 1 -- 172.21.15.38:0/1536967911 wait complete. 2023-11-06T13:27:38.741 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 3 2023-11-06T13:27:38.751 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:38.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.866+0000 7f2929823700 1 Processor -- start 2023-11-06T13:27:38.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.866+0000 7f2929823700 1 -- start start 2023-11-06T13:27:38.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f2929823700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f29241756e0 0x7f29240640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f2929823700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f292417e570 0x7f2924185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f2929823700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292417d9d0 con 0x7f29240645d0 2023-11-06T13:27:38.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f2929823700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29240c8560 con 0x7f292417e570 2023-11-06T13:27:38.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f2929823700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2924064a50 con 0x7f29241756e0 2023-11-06T13:27:38.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f29237fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f292417e570 0x7f2924185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f29237fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f292417e570 0x7f2924185580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58590/0 (socket says 172.21.15.38:58590) 2023-11-06T13:27:38.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.867+0000 7f29237fe700 1 -- 172.21.15.38:0/4058153365 learned_addr learned my addr 172.21.15.38:0/4058153365 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:38.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f2922ffd700 1 --2- 172.21.15.38:0/4058153365 >> v2:172.21.15.163:3300/0 conn(0x7f29241756e0 0x7f29240640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f29237fe700 1 -- 172.21.15.38:0/4058153365 >> v2:172.21.15.163:3300/0 conn(0x7f29241756e0 msgr2=0x7f29240640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:38.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f29237fe700 1 --2- 172.21.15.38:0/4058153365 >> v2:172.21.15.163:3300/0 conn(0x7f29241756e0 0x7f29240640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f29237fe700 1 -- 172.21.15.38:0/4058153365 >> v1:172.21.15.163:6789/0 conn(0x7f29240645d0 legacy=0x7f292417de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f29237fe700 1 -- 172.21.15.38:0/4058153365 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292417c800 con 0x7f292417e570 2023-11-06T13:27:38.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f29237fe700 1 --2- 172.21.15.38:0/4058153365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f292417e570 0x7f2924185580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f29240ce060 tx=0x7f291c009840).ready entity=mon.0 client_cookie=32f69af3ec945e1b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f2921ffb700 1 -- 172.21.15.38:0/4058153365 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00e070 con 0x7f292417e570 2023-11-06T13:27:38.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f2921ffb700 1 -- 172.21.15.38:0/4058153365 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c00ba20 con 0x7f292417e570 2023-11-06T13:27:38.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f2921ffb700 1 -- 172.21.15.38:0/4058153365 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00bda0 con 0x7f292417e570 2023-11-06T13:27:38.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f2929823700 1 -- 172.21.15.38:0/4058153365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f292417e570 msgr2=0x7f2924185580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.868+0000 7f2929823700 1 --2- 172.21.15.38:0/4058153365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f292417e570 0x7f2924185580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f29240ce060 tx=0x7f291c009840).stop 2023-11-06T13:27:38.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.869+0000 7f2929823700 1 -- 172.21.15.38:0/4058153365 shutdown_connections 2023-11-06T13:27:38.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.869+0000 7f2929823700 1 --2- 172.21.15.38:0/4058153365 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f292417e570 0x7f2924185580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.869+0000 7f2929823700 1 --2- 172.21.15.38:0/4058153365 >> v2:172.21.15.163:3300/0 conn(0x7f29241756e0 0x7f29240640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.869+0000 7f2929823700 1 -- 172.21.15.38:0/4058153365 >> 172.21.15.38:0/4058153365 conn(0x7f2924069ea0 msgr2=0x7f292406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:38.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.869+0000 7f2929823700 1 -- 172.21.15.38:0/4058153365 shutdown_connections 2023-11-06T13:27:38.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.869+0000 7f2929823700 1 -- 172.21.15.38:0/4058153365 wait complete. 2023-11-06T13:27:38.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.870+0000 7f2929823700 1 Processor -- start 2023-11-06T13:27:38.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.870+0000 7f2929823700 1 -- start start 2023-11-06T13:27:38.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2929823700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 0x7f29241702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2929823700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29241756e0 0x7f292416ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2929823700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292417e570 0x7f29240c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2929823700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240c4a40 con 0x7f29240645d0 2023-11-06T13:27:38.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2929823700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240c4d20 con 0x7f292417e570 2023-11-06T13:27:38.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2929823700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292417a860 con 0x7f29241756e0 2023-11-06T13:27:38.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2922ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 0x7f29241702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2922ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 0x7f29241702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58596/0 (socket says 172.21.15.38:58596) 2023-11-06T13:27:38.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f2922ffd700 1 -- 172.21.15.38:0/3363012513 learned_addr learned my addr 172.21.15.38:0/3363012513 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:38.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.871+0000 7f29227fc700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29241756e0 0x7f292416ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f29237fe700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292417e570 0x7f29240c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2922ffd700 1 -- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29241756e0 msgr2=0x7f292416ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2922ffd700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29241756e0 0x7f292416ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2922ffd700 1 -- 172.21.15.38:0/3363012513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292417e570 msgr2=0x7f29240c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:38.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2922ffd700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292417e570 0x7f29240c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:38.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2922ffd700 1 -- 172.21.15.38:0/3363012513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c009ae0 con 0x7f29240645d0 2023-11-06T13:27:38.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2922ffd700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 0x7f29241702e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f291400e900 tx=0x7f2914009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914009390 con 0x7f29240645d0 2023-11-06T13:27:38.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914012600 con 0x7f29240645d0 2023-11-06T13:27:38.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292417ab40 con 0x7f29240645d0 2023-11-06T13:27:38.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914012980 con 0x7f29240645d0 2023-11-06T13:27:38.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.872+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292417b100 con 0x7f29240645d0 2023-11-06T13:27:38.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.873+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292406c580 con 0x7f29240645d0 2023-11-06T13:27:38.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.874+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f291401b400 con 0x7f29240645d0 2023-11-06T13:27:38.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.874+0000 7f290affd700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f291008cb40 0x7f291008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:38.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.874+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f29140b1be0 con 0x7f29240645d0 2023-11-06T13:27:38.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.874+0000 7f29227fc700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f291008cb40 0x7f291008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:38.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.875+0000 7f29227fc700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f291008cb40 0x7f291008f000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f292417b490 tx=0x7f2918007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:38.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:38.878+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29140828d0 con 0x7f29240645d0 2023-11-06T13:27:39.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.051+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f292417cae0 con 0x7f29240645d0 2023-11-06T13:27:39.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.052+0000 7f290affd700 1 -- 172.21.15.38:0/3363012513 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18414 (secure 0 0 0) 0x7f2914085ef0 con 0x7f29240645d0 2023-11-06T13:27:39.056 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:39.056 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":23,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:38.340022+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:39.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f291008cb40 msgr2=0x7f291008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f291008cb40 0x7f291008f000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f292417b490 tx=0x7f2918007d40).stop 2023-11-06T13:27:39.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 msgr2=0x7f29241702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 0x7f29241702e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f291400e900 tx=0x7f2914009060).stop 2023-11-06T13:27:39.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 shutdown_connections 2023-11-06T13:27:39.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f291008cb40 0x7f291008f000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f292417e570 0x7f29240c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29240645d0 0x7f29241702e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 --2- 172.21.15.38:0/3363012513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29241756e0 0x7f292416ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 >> 172.21.15.38:0/3363012513 conn(0x7f2924069ea0 msgr2=0x7f29240ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:39.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 shutdown_connections 2023-11-06T13:27:39.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.054+0000 7f2929823700 1 -- 172.21.15.38:0/3363012513 wait complete. 2023-11-06T13:27:39.070 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-11-06T13:27:39.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:27:39.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.188+0000 7f4ef7d05700 1 Processor -- start 2023-11-06T13:27:39.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.188+0000 7f4ef7d05700 1 -- start start 2023-11-06T13:27:39.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef7d05700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ef0175a40 0x7f4ef017f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef7d05700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4ef017e970 0x7f4ef0185840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef7d05700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef017ddd0 con 0x7f4ef017fb80 2023-11-06T13:27:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef7d05700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef0064780 con 0x7f4ef0175a40 2023-11-06T13:27:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef7d05700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef00c4c20 con 0x7f4ef017e970 2023-11-06T13:27:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef5aa1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ef0175a40 0x7f4ef017f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef52a0700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4ef017fb80 0x7f4ef017e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60636/0 (socket says 172.21.15.38:60636) 2023-11-06T13:27:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef52a0700 1 -- 172.21.15.38:0/2155323565 learned_addr learned my addr 172.21.15.38:0/2155323565 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef62a2700 1 --2- 172.21.15.38:0/2155323565 >> v2:172.21.15.163:3300/0 conn(0x7f4ef017e970 0x7f4ef0185840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef5aa1700 1 -- 172.21.15.38:0/2155323565 >> v2:172.21.15.163:3300/0 conn(0x7f4ef017e970 msgr2=0x7f4ef0185840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef5aa1700 1 --2- 172.21.15.38:0/2155323565 >> v2:172.21.15.163:3300/0 conn(0x7f4ef017e970 0x7f4ef0185840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef5aa1700 1 -- 172.21.15.38:0/2155323565 >> v1:172.21.15.38:6789/0 conn(0x7f4ef017fb80 legacy=0x7f4ef017e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef4a9f700 1 -- 172.21.15.38:0/2155323565 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198458646 0 0) 0x7f4ef017ddd0 con 0x7f4ef017fb80 2023-11-06T13:27:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef5aa1700 1 -- 172.21.15.38:0/2155323565 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef017cee0 con 0x7f4ef0175a40 2023-11-06T13:27:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef5aa1700 1 --2- 172.21.15.38:0/2155323565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef0175a40 0x7f4ef017f690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4ef0157d50 tx=0x7f4eec009060).ready entity=mon.0 client_cookie=259b5bd5dee77616 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef4a9f700 1 -- 172.21.15.38:0/2155323565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00b580 con 0x7f4ef0175a40 2023-11-06T13:27:39.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef4a9f700 1 -- 172.21.15.38:0/2155323565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec00b6e0 con 0x7f4ef0175a40 2023-11-06T13:27:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.190+0000 7f4ef4a9f700 1 -- 172.21.15.38:0/2155323565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00ba60 con 0x7f4ef0175a40 2023-11-06T13:27:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 -- 172.21.15.38:0/2155323565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef0175a40 msgr2=0x7f4ef017f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/2155323565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef0175a40 0x7f4ef017f690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4ef0157d50 tx=0x7f4eec009060).stop 2023-11-06T13:27:39.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 -- 172.21.15.38:0/2155323565 shutdown_connections 2023-11-06T13:27:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/2155323565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef0175a40 0x7f4ef017f690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/2155323565 >> v2:172.21.15.163:3300/0 conn(0x7f4ef017e970 0x7f4ef0185840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 -- 172.21.15.38:0/2155323565 >> 172.21.15.38:0/2155323565 conn(0x7f4ef006a970 msgr2=0x7f4ef00f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 -- 172.21.15.38:0/2155323565 shutdown_connections 2023-11-06T13:27:39.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.191+0000 7f4ef7d05700 1 -- 172.21.15.38:0/2155323565 wait complete. 2023-11-06T13:27:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.192+0000 7f4ef7d05700 1 Processor -- start 2023-11-06T13:27:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.192+0000 7f4ef7d05700 1 -- start start 2023-11-06T13:27:39.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.193+0000 7f4ef7d05700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ef0175a40 0x7f4ef016f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.193+0000 7f4ef7d05700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef017e970 0x7f4ef016fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.193+0000 7f4ef7d05700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 0x7f4ef0180020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.193+0000 7f4ef7d05700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00ca490 con 0x7f4ef017fb80 2023-11-06T13:27:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef7d05700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0182030 con 0x7f4ef017e970 2023-11-06T13:27:39.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef7d05700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0181ba0 con 0x7f4ef0175a40 2023-11-06T13:27:39.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 0x7f4ef0180020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 0x7f4ef0180020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58612/0 (socket says 172.21.15.38:58612) 2023-11-06T13:27:39.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 -- 172.21.15.38:0/272141083 learned_addr learned my addr 172.21.15.38:0/272141083 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:39.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef52a0700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef017e970 0x7f4ef016fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef5aa1700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ef0175a40 0x7f4ef016f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 -- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ef0175a40 msgr2=0x7f4ef016f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ef0175a40 0x7f4ef016f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 -- 172.21.15.38:0/272141083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef017e970 msgr2=0x7f4ef016fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef017e970 0x7f4ef016fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 -- 172.21.15.38:0/272141083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0092a0 con 0x7f4ef017fb80 2023-11-06T13:27:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef62a2700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 0x7f4ef0180020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4ee8007f20 tx=0x7f4ee8009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800eb90 con 0x7f4ef017fb80 2023-11-06T13:27:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800ecf0 con 0x7f4ef017fb80 2023-11-06T13:27:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef0180cb0 con 0x7f4ef017fb80 2023-11-06T13:27:39.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8014630 con 0x7f4ef017fb80 2023-11-06T13:27:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.194+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0181270 con 0x7f4ef017fb80 2023-11-06T13:27:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.195+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef0181d50 con 0x7f4ef017fb80 2023-11-06T13:27:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.196+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f4ee80149a0 con 0x7f4ef017fb80 2023-11-06T13:27:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.196+0000 7f4ee5ffb700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4ed408cb40 0x7f4ed408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.197+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f4ee80b1b00 con 0x7f4ef017fb80 2023-11-06T13:27:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.197+0000 7f4ef5aa1700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4ed408cb40 0x7f4ed408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.197+0000 7f4ef5aa1700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4ed408cb40 0x7f4ed408f000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4ef0157d50 tx=0x7f4eec017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.201+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ef0181d50 con 0x7f4ef017fb80 2023-11-06T13:27:39.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.373+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4ef0181d10 con 0x7f4ef017fb80 2023-11-06T13:27:39.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.373+0000 7f4ee5ffb700 1 -- 172.21.15.38:0/272141083 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4ee8019020 con 0x7f4ef017fb80 2023-11-06T13:27:39.377 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:27:39.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4ed408cb40 msgr2=0x7f4ed408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4ed408cb40 0x7f4ed408f000 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4ef0157d50 tx=0x7f4eec017000).stop 2023-11-06T13:27:39.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 msgr2=0x7f4ef0180020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 0x7f4ef0180020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4ee8007f20 tx=0x7f4ee8009860).stop 2023-11-06T13:27:39.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 shutdown_connections 2023-11-06T13:27:39.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ef017fb80 0x7f4ef0180020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ef0175a40 0x7f4ef016f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4ed408cb40 0x7f4ed408f000 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 --2- 172.21.15.38:0/272141083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ef017e970 0x7f4ef016fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 >> 172.21.15.38:0/272141083 conn(0x7f4ef006a970 msgr2=0x7f4ef017e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:39.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 shutdown_connections 2023-11-06T13:27:39.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.375+0000 7f4ef7d05700 1 -- 172.21.15.38:0/272141083 wait complete. 2023-11-06T13:27:39.390 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:27:39.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.510+0000 7f80a47ef700 1 Processor -- start 2023-11-06T13:27:39.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.510+0000 7f80a47ef700 1 -- start start 2023-11-06T13:27:39.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a47ef700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f809c0edca0 0x7f809c0ee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a47ef700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f809c0ee640 0x7f809c182700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a47ef700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c0ec9d0 con 0x7f809c178680 2023-11-06T13:27:39.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a47ef700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0ecc20 con 0x7f809c0edca0 2023-11-06T13:27:39.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a47ef700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0ecf00 con 0x7f809c0ee640 2023-11-06T13:27:39.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f809c0edca0 0x7f809c0ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f809c0edca0 0x7f809c0ee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58616/0 (socket says 172.21.15.38:58616) 2023-11-06T13:27:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 -- 172.21.15.38:0/1204528711 learned_addr learned my addr 172.21.15.38:0/1204528711 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 -- 172.21.15.38:0/1204528711 >> v2:172.21.15.163:3300/0 conn(0x7f809c0ee640 msgr2=0x7f809c182700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 --2- 172.21.15.38:0/1204528711 >> v2:172.21.15.163:3300/0 conn(0x7f809c0ee640 0x7f809c182700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:39.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 -- 172.21.15.38:0/1204528711 >> v1:172.21.15.44:6789/0 conn(0x7f809c178680 legacy=0x7f809c178a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:39.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 -- 172.21.15.38:0/1204528711 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0ed1e0 con 0x7f809c0edca0 2023-11-06T13:27:39.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.511+0000 7f80a1d8a700 1 --2- 172.21.15.38:0/1204528711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c0ee150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f808c006fd0 tx=0x7f808c0090f0).ready entity=mon.0 client_cookie=f6aacc32b3e0eee6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a1589700 1 -- 172.21.15.38:0/1204528711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00b580 con 0x7f809c0edca0 2023-11-06T13:27:39.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a1589700 1 -- 172.21.15.38:0/1204528711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00b6e0 con 0x7f809c0edca0 2023-11-06T13:27:39.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a1589700 1 -- 172.21.15.38:0/1204528711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00ba80 con 0x7f809c0edca0 2023-11-06T13:27:39.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 -- 172.21.15.38:0/1204528711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 msgr2=0x7f809c0ee150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 --2- 172.21.15.38:0/1204528711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c0ee150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f808c006fd0 tx=0x7f808c0090f0).stop 2023-11-06T13:27:39.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 -- 172.21.15.38:0/1204528711 shutdown_connections 2023-11-06T13:27:39.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 --2- 172.21.15.38:0/1204528711 >> v2:172.21.15.163:3300/0 conn(0x7f809c0ee640 0x7f809c182700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 --2- 172.21.15.38:0/1204528711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c0ee150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 -- 172.21.15.38:0/1204528711 >> 172.21.15.38:0/1204528711 conn(0x7f809c0ef5a0 msgr2=0x7f809c05e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 -- 172.21.15.38:0/1204528711 shutdown_connections 2023-11-06T13:27:39.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.512+0000 7f80a47ef700 1 -- 172.21.15.38:0/1204528711 wait complete. 2023-11-06T13:27:39.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.514+0000 7f80a47ef700 1 Processor -- start 2023-11-06T13:27:39.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.514+0000 7f80a47ef700 1 -- start start 2023-11-06T13:27:39.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809c0ee640 0x7f809c169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809c178680 0x7f809c1767c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c169ff0 con 0x7f809c0edca0 2023-11-06T13:27:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c176330 con 0x7f809c178680 2023-11-06T13:27:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c176030 con 0x7f809c0ee640 2023-11-06T13:27:39.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c169610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58632/0 (socket says 172.21.15.38:58632) 2023-11-06T13:27:39.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 -- 172.21.15.38:0/2555180320 learned_addr learned my addr 172.21.15.38:0/2555180320 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:39.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a2d8c700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809c178680 0x7f809c1767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a1d8a700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809c0ee640 0x7f809c169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 -- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809c0ee640 msgr2=0x7f809c169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809c0ee640 0x7f809c169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 -- 172.21.15.38:0/2555180320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809c178680 msgr2=0x7f809c1767c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809c178680 0x7f809c1767c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 -- 172.21.15.38:0/2555180320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c009370 con 0x7f809c0edca0 2023-11-06T13:27:39.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a1d8a700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809c0ee640 0x7f809c169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:39.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a2d8c700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809c178680 0x7f809c1767c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:39.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a258b700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c169610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f809800c470 tx=0x7f8098007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800f470 con 0x7f809c0edca0 2023-11-06T13:27:39.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800f5f0 con 0x7f809c0edca0 2023-11-06T13:27:39.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c0c8cf0 con 0x7f809c0edca0 2023-11-06T13:27:39.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800f9b0 con 0x7f809c0edca0 2023-11-06T13:27:39.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.515+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c0c92b0 con 0x7f809c0edca0 2023-11-06T13:27:39.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.516+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c176610 con 0x7f809c0edca0 2023-11-06T13:27:39.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.517+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f8098012400 con 0x7f809c0edca0 2023-11-06T13:27:39.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.518+0000 7f80927fc700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f808008cb10 0x7f808008efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.518+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f80980b0df0 con 0x7f809c0edca0 2023-11-06T13:27:39.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.518+0000 7f80a1d8a700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f808008cb10 0x7f808008efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.518+0000 7f80a1d8a700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f808008cb10 0x7f808008efd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f809c0cad40 tx=0x7f808c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.522+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8098081ae0 con 0x7f809c0edca0 2023-11-06T13:27:39.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.693+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f809c0ed4c0 con 0x7f809c0edca0 2023-11-06T13:27:39.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.694+0000 7f80927fc700 1 -- 172.21.15.38:0/2555180320 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8098017030 con 0x7f809c0edca0 2023-11-06T13:27:39.698 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:27:39.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f808008cb10 msgr2=0x7f808008efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f808008cb10 0x7f808008efd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f809c0cad40 tx=0x7f808c017000).stop 2023-11-06T13:27:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 msgr2=0x7f809c169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c169610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f809800c470 tx=0x7f8098007de0).stop 2023-11-06T13:27:39.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 shutdown_connections 2023-11-06T13:27:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f808008cb10 0x7f808008efd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809c178680 0x7f809c1767c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f809c0edca0 0x7f809c169610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 --2- 172.21.15.38:0/2555180320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f809c0ee640 0x7f809c169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 >> 172.21.15.38:0/2555180320 conn(0x7f809c0ef5a0 msgr2=0x7f809c172300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:39.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 shutdown_connections 2023-11-06T13:27:39.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.696+0000 7f80a47ef700 1 -- 172.21.15.38:0/2555180320 wait complete. 2023-11-06T13:27:39.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-06T13:27:39.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.828+0000 7f7ef5b42700 1 Processor -- start 2023-11-06T13:27:39.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.828+0000 7f7ef5b42700 1 -- start start 2023-11-06T13:27:39.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7ef5b42700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef017d9d0 con 0x7f7ef00647f0 2023-11-06T13:27:39.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7ef5b42700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef017c800 con 0x7f7ef01756e0 2023-11-06T13:27:39.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7ef5b42700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef017cae0 con 0x7f7ef017e570 2023-11-06T13:27:39.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7eeeffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7ef00647f0 0x7f7ef017de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60652/0 (socket says 172.21.15.38:60652) 2023-11-06T13:27:39.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7eeeffd700 1 -- 172.21.15.38:0/9292835 learned_addr learned my addr 172.21.15.38:0/9292835 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:39.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191469658 0 0) 0x7f7ef017d9d0 con 0x7f7ef00647f0 2023-11-06T13:27:39.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.829+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed80033f0 con 0x7f7ef00647f0 2023-11-06T13:27:39.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277193147 0 0) 0x7f7ed80033f0 con 0x7f7ef00647f0 2023-11-06T13:27:39.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 >> v1:172.21.15.163:6789/0 conn(0x7f7ef017e570 legacy=0x7f7ef0186590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 >> v1:172.21.15.44:6789/0 conn(0x7f7ef01756e0 legacy=0x7f7ef00640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef017cdc0 con 0x7f7ef00647f0 2023-11-06T13:27:39.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f7ee4001470 con 0x7f7ef00647f0 2023-11-06T13:27:39.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 >> v1:172.21.15.38:6789/0 conn(0x7f7ef00647f0 legacy=0x7f7ef017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ed8003910 0x7f7ed8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ed8004690 0x7f7ed8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed80050d0 0x7f7ed800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed800bf90 con 0x7f7ed8003910 2023-11-06T13:27:39.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed800c100 con 0x7f7ed80050d0 2023-11-06T13:27:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed800c2c0 con 0x7f7ed8004690 2023-11-06T13:27:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ed8003910 0x7f7ed8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eeeffd700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ed8004690 0x7f7ed8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eeffff700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed80050d0 0x7f7ed800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 -- 172.21.15.38:0/9292835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ed8004690 msgr2=0x7f7ed8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:39.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ed8004690 0x7f7ed8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 -- 172.21.15.38:0/9292835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed80050d0 msgr2=0x7f7ed800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:39.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed80050d0 0x7f7ed800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 -- 172.21.15.38:0/9292835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80033f0 con 0x7f7ed8003910 2023-11-06T13:27:39.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eeffff700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed80050d0 0x7f7ed800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:39.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eeffff700 1 -- 172.21.15.38:0/9292835 reap_dead start 2023-11-06T13:27:39.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.830+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ed8003910 0x7f7ed8003cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7ee00017f0 tx=0x7f7ee0007b90).ready entity=mon.0 client_cookie=d6fe8ecde8ac1e91 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0007ea0 con 0x7f7ed8003910 2023-11-06T13:27:39.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0012400 con 0x7f7ed8003910 2023-11-06T13:27:39.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7eee7fc700 1 -- 172.21.15.38:0/9292835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0012780 con 0x7f7ed8003910 2023-11-06T13:27:39.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 -- 172.21.15.38:0/9292835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ed8003910 msgr2=0x7f7ed8003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ed8003910 0x7f7ed8003cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7ee00017f0 tx=0x7f7ee0007b90).stop 2023-11-06T13:27:39.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 -- 172.21.15.38:0/9292835 shutdown_connections 2023-11-06T13:27:39.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/9292835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ed8003910 0x7f7ed8003cf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 -- 172.21.15.38:0/9292835 >> 172.21.15.38:0/9292835 conn(0x7f7ef0069ea0 msgr2=0x7f7ef006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:39.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 -- 172.21.15.38:0/9292835 shutdown_connections 2023-11-06T13:27:39.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.831+0000 7f7ef5b42700 1 -- 172.21.15.38:0/9292835 wait complete. 2023-11-06T13:27:39.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.833+0000 7f7ef5b42700 1 Processor -- start 2023-11-06T13:27:39.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.833+0000 7f7ef5b42700 1 -- start start 2023-11-06T13:27:39.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed8003910 0x7f7ef018fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef016e000 0x7f7ef016e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 0x7f7ef01810a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef017c1c0 con 0x7f7ef0180c40 2023-11-06T13:27:39.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef016e970 con 0x7f7ed8003910 2023-11-06T13:27:39.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef017bc00 con 0x7f7ef016e000 2023-11-06T13:27:39.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 0x7f7ef01810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 0x7f7ef01810a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58644/0 (socket says 172.21.15.38:58644) 2023-11-06T13:27:39.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 -- 172.21.15.38:0/3927049575 learned_addr learned my addr 172.21.15.38:0/3927049575 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:39.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed8003910 0x7f7ef018fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeeffd700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef016e000 0x7f7ef016e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 -- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef016e000 msgr2=0x7f7ef016e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef016e000 0x7f7ef016e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 -- 172.21.15.38:0/3927049575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed8003910 msgr2=0x7f7ef018fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:39.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed8003910 0x7f7ef018fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:39.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 -- 172.21.15.38:0/3927049575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef017bee0 con 0x7f7ef0180c40 2023-11-06T13:27:39.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeeffd700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef016e000 0x7f7ef016e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:39.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed8003910 0x7f7ef018fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:39.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7eeffff700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 0x7f7ef01810a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7ef006c800 tx=0x7f7ee8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8010520 con 0x7f7ef0180c40 2023-11-06T13:27:39.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8010680 con 0x7f7ef0180c40 2023-11-06T13:27:39.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef0180160 con 0x7f7ef0180c40 2023-11-06T13:27:39.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8010a40 con 0x7f7ef0180c40 2023-11-06T13:27:39.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.834+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef0180720 con 0x7f7ef0180c40 2023-11-06T13:27:39.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.835+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef0180940 con 0x7f7ef0180c40 2023-11-06T13:27:39.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.836+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f7ee8003070 con 0x7f7ef0180c40 2023-11-06T13:27:39.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.837+0000 7f7ed77fe700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7edc08cb40 0x7f7edc08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:39.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.837+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f7ee80b11d0 con 0x7f7ef0180c40 2023-11-06T13:27:39.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.837+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7edc08cb40 0x7f7edc08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:39.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.837+0000 7f7eef7fe700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7edc08cb40 0x7f7edc08f000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7ee0001050 tx=0x7f7ee0015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:39.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:39.841+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7ee8081ec0 con 0x7f7ef0180c40 2023-11-06T13:27:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.013+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7ef006c580 con 0x7f7ef0180c40 2023-11-06T13:27:40.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.013+0000 7f7ed77fe700 1 -- 172.21.15.38:0/3927049575 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v23) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7ee80854e0 con 0x7f7ef0180c40 2023-11-06T13:27:40.017 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:40.017 INFO:teuthology.orchestra.run.smithi038.stdout:[ 2023-11-06T13:27:40.017 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:27:40.017 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 1, 2023-11-06T13:27:40.018 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "device_health_metrics" 2023-11-06T13:27:40.018 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:27:40.018 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:27:40.018 INFO:teuthology.orchestra.run.smithi038.stdout: "poolnum": 2, 2023-11-06T13:27:40.019 INFO:teuthology.orchestra.run.smithi038.stdout: "poolname": "rbd" 2023-11-06T13:27:40.019 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:27:40.019 INFO:teuthology.orchestra.run.smithi038.stdout:] 2023-11-06T13:27:40.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7edc08cb40 msgr2=0x7f7edc08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7edc08cb40 0x7f7edc08f000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7ee0001050 tx=0x7f7ee0015000).stop 2023-11-06T13:27:40.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 msgr2=0x7f7ef01810a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 0x7f7ef01810a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7ef006c800 tx=0x7f7ee8009040).stop 2023-11-06T13:27:40.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 shutdown_connections 2023-11-06T13:27:40.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7ef0180c40 0x7f7ef01810a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7edc08cb40 0x7f7edc08f000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ed8003910 0x7f7ef018fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 --2- 172.21.15.38:0/3927049575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ef016e000 0x7f7ef016e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 >> 172.21.15.38:0/3927049575 conn(0x7f7ef0069ea0 msgr2=0x7f7ef016fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:40.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 shutdown_connections 2023-11-06T13:27:40.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.015+0000 7f7ef5b42700 1 -- 172.21.15.38:0/3927049575 wait complete. 2023-11-06T13:27:40.030 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-06T13:27:40.031 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-11-06T13:27:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.152+0000 7ffa6dff5700 1 Processor -- start 2023-11-06T13:27:40.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.152+0000 7ffa6dff5700 1 -- start start 2023-11-06T13:27:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa6dff5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ffa680c98d0 0x7ffa680c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa6dff5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa680ca270 0x7ffa680f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa6dff5700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa680c8600 con 0x7ffa6817e450 2023-11-06T13:27:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa6dff5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa68064730 con 0x7ffa680ca270 2023-11-06T13:27:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa6dff5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa680c8830 con 0x7ffa680c98d0 2023-11-06T13:27:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa67fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa680ca270 0x7ffa680f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa677fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ffa6817e450 0x7ffa6817e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60656/0 (socket says 172.21.15.38:60656) 2023-11-06T13:27:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa677fe700 1 -- 172.21.15.38:0/1582987381 learned_addr learned my addr 172.21.15.38:0/1582987381 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa66ffd700 1 --2- 172.21.15.38:0/1582987381 >> v2:172.21.15.163:3300/0 conn(0x7ffa680c98d0 0x7ffa680c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa67fff700 1 -- 172.21.15.38:0/1582987381 >> v2:172.21.15.163:3300/0 conn(0x7ffa680c98d0 msgr2=0x7ffa680c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:40.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa67fff700 1 --2- 172.21.15.38:0/1582987381 >> v2:172.21.15.163:3300/0 conn(0x7ffa680c98d0 0x7ffa680c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa67fff700 1 -- 172.21.15.38:0/1582987381 >> v1:172.21.15.38:6789/0 conn(0x7ffa6817e450 legacy=0x7ffa6817e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa67fff700 1 -- 172.21.15.38:0/1582987381 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680c8b10 con 0x7ffa680ca270 2023-11-06T13:27:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa667fc700 1 -- 172.21.15.38:0/1582987381 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943734646 0 0) 0x7ffa680c8600 con 0x7ffa6817e450 2023-11-06T13:27:40.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa67fff700 1 --2- 172.21.15.38:0/1582987381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa680f03e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ffa680f1310 tx=0x7ffa60009060).ready entity=mon.0 client_cookie=c10659ca8bcbea85 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.153+0000 7ffa667fc700 1 -- 172.21.15.38:0/1582987381 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000f510 con 0x7ffa680ca270 2023-11-06T13:27:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa667fc700 1 -- 172.21.15.38:0/1582987381 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6000f670 con 0x7ffa680ca270 2023-11-06T13:27:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa667fc700 1 -- 172.21.15.38:0/1582987381 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000f9f0 con 0x7ffa680ca270 2023-11-06T13:27:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 -- 172.21.15.38:0/1582987381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 msgr2=0x7ffa680f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/1582987381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa680f03e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ffa680f1310 tx=0x7ffa60009060).stop 2023-11-06T13:27:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 -- 172.21.15.38:0/1582987381 shutdown_connections 2023-11-06T13:27:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/1582987381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa680f03e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/1582987381 >> v2:172.21.15.163:3300/0 conn(0x7ffa680c98d0 0x7ffa680c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 -- 172.21.15.38:0/1582987381 >> 172.21.15.38:0/1582987381 conn(0x7ffa680f53e0 msgr2=0x7ffa680f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:40.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 -- 172.21.15.38:0/1582987381 shutdown_connections 2023-11-06T13:27:40.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.154+0000 7ffa6dff5700 1 -- 172.21.15.38:0/1582987381 wait complete. 2023-11-06T13:27:40.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.156+0000 7ffa6dff5700 1 Processor -- start 2023-11-06T13:27:40.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.156+0000 7ffa6dff5700 1 -- start start 2023-11-06T13:27:40.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa680c98d0 0x7ffa6818fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa68155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6817e450 0x7ffa681903c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa68191fb0 con 0x7ffa680ca270 2023-11-06T13:27:40.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa681910c0 con 0x7ffa680c98d0 2023-11-06T13:27:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa681913a0 con 0x7ffa6817e450 2023-11-06T13:27:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa68155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa68155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58668/0 (socket says 172.21.15.38:58668) 2023-11-06T13:27:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 -- 172.21.15.38:0/3307052184 learned_addr learned my addr 172.21.15.38:0/3307052184 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:40.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa677fe700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa680c98d0 0x7ffa6818fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 -- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6817e450 msgr2=0x7ffa681903c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6817e450 0x7ffa681903c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 -- 172.21.15.38:0/3307052184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa680c98d0 msgr2=0x7ffa6818fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa680c98d0 0x7ffa6818fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 -- 172.21.15.38:0/3307052184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600092a0 con 0x7ffa680ca270 2023-11-06T13:27:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa66ffd700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa68155cc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ffa5c00e900 tx=0x7ffa5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00c640 con 0x7ffa680ca270 2023-11-06T13:27:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c00c7a0 con 0x7ffa680ca270 2023-11-06T13:27:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa68191680 con 0x7ffa680ca270 2023-11-06T13:27:40.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00cb20 con 0x7ffa680ca270 2023-11-06T13:27:40.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.157+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa68191c40 con 0x7ffa680ca270 2023-11-06T13:27:40.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.158+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6806c580 con 0x7ffa680ca270 2023-11-06T13:27:40.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.159+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7ffa5c01b400 con 0x7ffa680ca270 2023-11-06T13:27:40.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.160+0000 7ffa4f7fe700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa5408cb40 0x7ffa5408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.160+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7109+0+0 (secure 0 0 0) 0x7ffa5c0b1d30 con 0x7ffa680ca270 2023-11-06T13:27:40.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.160+0000 7ffa677fe700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa5408cb40 0x7ffa5408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.160+0000 7ffa677fe700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa5408cb40 0x7ffa5408f000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ffa58007fd0 tx=0x7ffa58009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:40.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.164+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ffa5c082a20 con 0x7ffa680ca270 2023-11-06T13:27:40.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.335+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7ffa680c8df0 con 0x7ffa680ca270 2023-11-06T13:27:40.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.486+0000 7ffa4f7fe700 1 -- 172.21.15.38:0/3307052184 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v24) v1 ==== 152+0+0 (secure 0 0 0) 0x7ffa5c016030 con 0x7ffa680ca270 2023-11-06T13:27:40.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa5408cb40 msgr2=0x7ffa5408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa5408cb40 0x7ffa5408f000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ffa58007fd0 tx=0x7ffa58009040).stop 2023-11-06T13:27:40.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 msgr2=0x7ffa68155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa68155cc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ffa5c00e900 tx=0x7ffa5c009060).stop 2023-11-06T13:27:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 shutdown_connections 2023-11-06T13:27:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa6817e450 0x7ffa681903c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:40.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa5408cb40 0x7ffa5408f000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa680c98d0 0x7ffa6818fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 --2- 172.21.15.38:0/3307052184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa680ca270 0x7ffa68155cc0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0x7ffa5c00e900 tx=0x7ffa5c009060).stop 2023-11-06T13:27:40.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 >> 172.21.15.38:0/3307052184 conn(0x7ffa680f53e0 msgr2=0x7ffa6817efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 shutdown_connections 2023-11-06T13:27:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.491+0000 7ffa6dff5700 1 -- 172.21.15.38:0/3307052184 wait complete. 2023-11-06T13:27:40.497 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_metadata' created 2023-11-06T13:27:40.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-06T13:27:40.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.629+0000 7f85736ad700 1 Processor -- start 2023-11-06T13:27:40.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.629+0000 7f85736ad700 1 -- start start 2023-11-06T13:27:40.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.630+0000 7f85736ad700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f856c175a40 0x7f856c17f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.630+0000 7f85736ad700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f856c17e970 0x7f856c185840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f85736ad700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c17ddd0 con 0x7f856c17fb80 2023-11-06T13:27:40.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f85736ad700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c064780 con 0x7f856c17e970 2023-11-06T13:27:40.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f85736ad700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0c4c20 con 0x7f856c175a40 2023-11-06T13:27:40.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f856c17e970 0x7f856c185840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f856c17e970 0x7f856c185840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58674/0 (socket says 172.21.15.38:58674) 2023-11-06T13:27:40.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 -- 172.21.15.38:0/3936534142 learned_addr learned my addr 172.21.15.38:0/3936534142 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:40.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571449700 1 --2- 172.21.15.38:0/3936534142 >> v2:172.21.15.44:3300/0 conn(0x7f856c175a40 0x7f856c17f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 -- 172.21.15.38:0/3936534142 >> v2:172.21.15.44:3300/0 conn(0x7f856c175a40 msgr2=0x7f856c17f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:40.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 --2- 172.21.15.38:0/3936534142 >> v2:172.21.15.44:3300/0 conn(0x7f856c175a40 0x7f856c17f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 -- 172.21.15.38:0/3936534142 >> v1:172.21.15.163:6789/0 conn(0x7f856c17fb80 legacy=0x7f856c17e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:40.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 -- 172.21.15.38:0/3936534142 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c17cee0 con 0x7f856c17e970 2023-11-06T13:27:40.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f8571c4a700 1 --2- 172.21.15.38:0/3936534142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c185840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f856c0898b0 tx=0x7f855c009840).ready entity=mon.0 client_cookie=919130f560082853 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:40.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f856bfff700 1 -- 172.21.15.38:0/3936534142 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c00e070 con 0x7f856c17e970 2023-11-06T13:27:40.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f856bfff700 1 -- 172.21.15.38:0/3936534142 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c00ba10 con 0x7f856c17e970 2023-11-06T13:27:40.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.631+0000 7f856bfff700 1 -- 172.21.15.38:0/3936534142 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c00bd90 con 0x7f856c17e970 2023-11-06T13:27:40.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 -- 172.21.15.38:0/3936534142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 msgr2=0x7f856c185840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 --2- 172.21.15.38:0/3936534142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c185840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f856c0898b0 tx=0x7f855c009840).stop 2023-11-06T13:27:40.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 -- 172.21.15.38:0/3936534142 shutdown_connections 2023-11-06T13:27:40.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 --2- 172.21.15.38:0/3936534142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c185840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 --2- 172.21.15.38:0/3936534142 >> v2:172.21.15.44:3300/0 conn(0x7f856c175a40 0x7f856c17f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 -- 172.21.15.38:0/3936534142 >> 172.21.15.38:0/3936534142 conn(0x7f856c06a970 msgr2=0x7f856c0f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:40.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 -- 172.21.15.38:0/3936534142 shutdown_connections 2023-11-06T13:27:40.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.632+0000 7f85736ad700 1 -- 172.21.15.38:0/3936534142 wait complete. 2023-11-06T13:27:40.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.633+0000 7f85736ad700 1 Processor -- start 2023-11-06T13:27:40.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.633+0000 7f85736ad700 1 -- start start 2023-11-06T13:27:40.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.634+0000 7f85736ad700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f856c175a40 0x7f856c16f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.634+0000 7f85736ad700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c16fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.634+0000 7f85736ad700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c17fb80 0x7f856c18edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85736ad700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c190260 con 0x7f856c17e970 2023-11-06T13:27:40.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85736ad700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c190de0 con 0x7f856c17fb80 2023-11-06T13:27:40.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85736ad700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c18fba0 con 0x7f856c175a40 2023-11-06T13:27:40.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c16fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c16fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58682/0 (socket says 172.21.15.38:58682) 2023-11-06T13:27:40.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 -- 172.21.15.38:0/828928996 learned_addr learned my addr 172.21.15.38:0/828928996 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:40.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8571c4a700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c17fb80 0x7f856c18edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8571449700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f856c175a40 0x7f856c16f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 -- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f856c175a40 msgr2=0x7f856c16f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f856c175a40 0x7f856c16f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 -- 172.21.15.38:0/828928996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c17fb80 msgr2=0x7f856c18edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c17fb80 0x7f856c18edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:40.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 -- 172.21.15.38:0/828928996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c009ae0 con 0x7f856c17e970 2023-11-06T13:27:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f8570c48700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c16fcc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f856000b4c0 tx=0x7f8560006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856000be80 con 0x7f856c17e970 2023-11-06T13:27:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560012410 con 0x7f856c17e970 2023-11-06T13:27:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c1904b0 con 0x7f856c17e970 2023-11-06T13:27:40.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600127d0 con 0x7f856c17e970 2023-11-06T13:27:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.635+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c190a70 con 0x7f856c17e970 2023-11-06T13:27:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.636+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c06c580 con 0x7f856c17e970 2023-11-06T13:27:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.637+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f8560012bc0 con 0x7f856c17e970 2023-11-06T13:27:40.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.638+0000 7f85697fa700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f855808cb40 0x7f855808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.638+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7479+0+0 (secure 0 0 0) 0x7f85600b18b0 con 0x7f856c17e970 2023-11-06T13:27:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.638+0000 7f8571449700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f855808cb40 0x7f855808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.638+0000 7f8571449700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f855808cb40 0x7f855808f000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8564006fd0 tx=0x7f8564008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:40.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.642+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8560082370 con 0x7f856c17e970 2023-11-06T13:27:40.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:40.815+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f856c17d1c0 con 0x7f856c17e970 2023-11-06T13:27:41.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.499+0000 7f85697fa700 1 -- 172.21.15.38:0/828928996 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v25) v1 ==== 171+0+0 (secure 0 0 0) 0x7f8560085990 con 0x7f856c17e970 2023-11-06T13:27:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.504+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f855808cb40 msgr2=0x7f855808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.504+0000 7f85736ad700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f855808cb40 0x7f855808f000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8564006fd0 tx=0x7f8564008040).stop 2023-11-06T13:27:41.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.504+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 msgr2=0x7f856c16fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.504+0000 7f85736ad700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c16fcc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f856000b4c0 tx=0x7f8560006ef0).stop 2023-11-06T13:27:41.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.509+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 shutdown_connections 2023-11-06T13:27:41.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.509+0000 7f85736ad700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f855808cb40 0x7f855808f000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.509+0000 7f85736ad700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f856c17fb80 0x7f856c18edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.509+0000 7f85736ad700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f856c175a40 0x7f856c16f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.509+0000 7f85736ad700 1 --2- 172.21.15.38:0/828928996 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f856c17e970 0x7f856c16fcc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.509+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 >> 172.21.15.38:0/828928996 conn(0x7f856c06a970 msgr2=0x7f856c17ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:41.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.511+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 shutdown_connections 2023-11-06T13:27:41.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.511+0000 7f85736ad700 1 -- 172.21.15.38:0/828928996 wait complete. 2023-11-06T13:27:41.520 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data' created 2023-11-06T13:27:41.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-06T13:27:41.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.659+0000 7f04ece4f700 1 Processor -- start 2023-11-06T13:27:41.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.659+0000 7f04ece4f700 1 -- start start 2023-11-06T13:27:41.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04ece4f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04e817e260 0x7f04e817e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:41.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04ece4f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e817ddd0 con 0x7f04e8175a40 2023-11-06T13:27:41.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04ece4f700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e8064780 con 0x7f04e8183830 2023-11-06T13:27:41.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04ece4f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80c4c20 con 0x7f04e817e260 2023-11-06T13:27:41.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04e5d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04e817e260 0x7f04e817e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:41.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04e5d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f04e817e260 0x7f04e817e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58684/0 (socket says 172.21.15.38:58684) 2023-11-06T13:27:41.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.660+0000 7f04e5d9b700 1 -- 172.21.15.38:0/1231931557 learned_addr learned my addr 172.21.15.38:0/1231931557 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:41.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e5d9b700 1 -- 172.21.15.38:0/1231931557 >> v1:172.21.15.163:6789/0 conn(0x7f04e8183830 legacy=0x7f04e8185c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:41.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e5d9b700 1 -- 172.21.15.38:0/1231931557 >> v1:172.21.15.44:6789/0 conn(0x7f04e8175a40 legacy=0x7f04e817f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:41.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e5d9b700 1 -- 172.21.15.38:0/1231931557 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e817fda0 con 0x7f04e817e260 2023-11-06T13:27:41.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e5d9b700 1 --2- 172.21.15.38:0/1231931557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e817e260 0x7f04e817e6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f04d0006fd0 tx=0x7f04d00090f0).ready entity=mon.0 client_cookie=4fd91b532dbeb77e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:41.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e559a700 1 -- 172.21.15.38:0/1231931557 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000b580 con 0x7f04e817e260 2023-11-06T13:27:41.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e559a700 1 -- 172.21.15.38:0/1231931557 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d000b6e0 con 0x7f04e817e260 2023-11-06T13:27:41.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04e559a700 1 -- 172.21.15.38:0/1231931557 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d000ba60 con 0x7f04e817e260 2023-11-06T13:27:41.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 -- 172.21.15.38:0/1231931557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e817e260 msgr2=0x7f04e817e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 --2- 172.21.15.38:0/1231931557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e817e260 0x7f04e817e6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f04d0006fd0 tx=0x7f04d00090f0).stop 2023-11-06T13:27:41.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 -- 172.21.15.38:0/1231931557 shutdown_connections 2023-11-06T13:27:41.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 --2- 172.21.15.38:0/1231931557 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e817e260 0x7f04e817e6e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 -- 172.21.15.38:0/1231931557 >> 172.21.15.38:0/1231931557 conn(0x7f04e806a970 msgr2=0x7f04e80f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:41.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 -- 172.21.15.38:0/1231931557 shutdown_connections 2023-11-06T13:27:41.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.661+0000 7f04ece4f700 1 -- 172.21.15.38:0/1231931557 wait complete. 2023-11-06T13:27:41.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.663+0000 7f04ece4f700 1 Processor -- start 2023-11-06T13:27:41.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.663+0000 7f04ece4f700 1 -- start start 2023-11-06T13:27:41.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04ece4f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e8175a40 0x7f04e80c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04ece4f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04e817e260 0x7f04e81802d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04ece4f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 0x7f04e81807c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04ece4f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e8180cb0 con 0x7f04e8183830 2023-11-06T13:27:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04ece4f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c90c0 con 0x7f04e8175a40 2023-11-06T13:27:41.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04ece4f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c93a0 con 0x7f04e817e260 2023-11-06T13:27:41.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 0x7f04e81807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:41.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 0x7f04e81807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58690/0 (socket says 172.21.15.38:58690) 2023-11-06T13:27:41.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 -- 172.21.15.38:0/3158388879 learned_addr learned my addr 172.21.15.38:0/3158388879 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:41.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e5d9b700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04e817e260 0x7f04e81802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:41.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e659c700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e8175a40 0x7f04e80c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:41.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 -- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04e817e260 msgr2=0x7f04e81802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04e817e260 0x7f04e81802d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 -- 172.21.15.38:0/3158388879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e8175a40 msgr2=0x7f04e80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e8175a40 0x7f04e80c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 -- 172.21.15.38:0/3158388879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0009370 con 0x7f04e8183830 2023-11-06T13:27:41.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e659c700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e8175a40 0x7f04e80c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:41.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.664+0000 7f04e6d9d700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 0x7f04e81807c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f04e000c810 tx=0x7f04e0002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:41.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.665+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0010510 con 0x7f04e8183830 2023-11-06T13:27:41.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.665+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e0010690 con 0x7f04e8183830 2023-11-06T13:27:41.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.665+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e80c9680 con 0x7f04e8183830 2023-11-06T13:27:41.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.665+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0010a50 con 0x7f04e8183830 2023-11-06T13:27:41.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.665+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e80c9c40 con 0x7f04e8183830 2023-11-06T13:27:41.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.666+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e806c580 con 0x7f04e8183830 2023-11-06T13:27:41.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.666+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f04e001b400 con 0x7f04e8183830 2023-11-06T13:27:41.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.667+0000 7f04de7fc700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f04c808cb40 0x7f04c808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:41.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.667+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7861+0+0 (secure 0 0 0) 0x7f04e00b1ad0 con 0x7f04e8183830 2023-11-06T13:27:41.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.667+0000 7f04e659c700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f04c808cb40 0x7f04c808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:41.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.668+0000 7f04e659c700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f04c808cb40 0x7f04c808f000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f04d800a820 tx=0x7f04d8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:41.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.671+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f04e00824d0 con 0x7f04e8183830 2023-11-06T13:27:41.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.887+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f04e817cee0 con 0x7f04e8183830 2023-11-06T13:27:41.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.894+0000 7f04de7fc700 1 -- 172.21.15.38:0/3158388879 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f04e0002680 con 0x7f04e8183830 2023-11-06T13:27:41.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.899+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f04c808cb40 msgr2=0x7f04c808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.899+0000 7f04ece4f700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f04c808cb40 0x7f04c808f000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f04d800a820 tx=0x7f04d8008040).stop 2023-11-06T13:27:41.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.899+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 msgr2=0x7f04e81807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:41.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.899+0000 7f04ece4f700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 0x7f04e81807c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f04e000c810 tx=0x7f04e0002560).stop 2023-11-06T13:27:41.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.900+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 shutdown_connections 2023-11-06T13:27:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.900+0000 7f04ece4f700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f04e8183830 0x7f04e81807c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.900+0000 7f04ece4f700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f04c808cb40 0x7f04c808f000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.900+0000 7f04ece4f700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e8175a40 0x7f04e80c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.900+0000 7f04ece4f700 1 --2- 172.21.15.38:0/3158388879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04e817e260 0x7f04e81802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:41.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.900+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 >> 172.21.15.38:0/3158388879 conn(0x7f04e806a970 msgr2=0x7f04e80c6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:41.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.902+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 shutdown_connections 2023-11-06T13:27:41.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:41.903+0000 7f04ece4f700 1 -- 172.21.15.38:0/3158388879 wait complete. 2023-11-06T13:27:41.910 INFO:teuthology.orchestra.run.smithi038.stderr:new fs with metadata pool 3 and data pool 4 2023-11-06T13:27:41.925 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-06T13:27:41.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-06T13:27:42.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.046+0000 7f4476517700 1 Processor -- start 2023-11-06T13:27:42.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.046+0000 7f4476517700 1 -- start start 2023-11-06T13:27:42.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f4476517700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700c8600 con 0x7f44700c98d0 2023-11-06T13:27:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f4476517700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700c8830 con 0x7f44700f03e0 2023-11-06T13:27:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f4476517700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44700c8b10 con 0x7f447017e450 2023-11-06T13:27:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446f7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f44700c98d0 0x7f44700c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60670/0 (socket says 172.21.15.38:60670) 2023-11-06T13:27:42.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446f7fe700 1 -- 172.21.15.38:0/866224087 learned_addr learned my addr 172.21.15.38:0/866224087 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279862245 0 0) 0x7f44700c8600 con 0x7f44700c98d0 2023-11-06T13:27:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f445c0033f0 con 0x7f44700c98d0 2023-11-06T13:27:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330494463 0 0) 0x7f44700c8830 con 0x7f44700f03e0 2023-11-06T13:27:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44700c8600 con 0x7f44700f03e0 2023-11-06T13:27:42.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.047+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787105562 0 0) 0x7f44700c8b10 con 0x7f447017e450 2023-11-06T13:27:42.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44700c8830 con 0x7f447017e450 2023-11-06T13:27:42.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305376691 0 0) 0x7f445c0033f0 con 0x7f44700c98d0 2023-11-06T13:27:42.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 >> v1:172.21.15.163:6789/0 conn(0x7f447017e450 legacy=0x7f447017e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 >> v1:172.21.15.44:6789/0 conn(0x7f44700f03e0 legacy=0x7f44700f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700c8df0 con 0x7f44700c98d0 2023-11-06T13:27:42.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f4460001470 con 0x7f44700c98d0 2023-11-06T13:27:42.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 >> v1:172.21.15.38:6789/0 conn(0x7f44700c98d0 legacy=0x7f44700c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c003cd0 0x7f445c0040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c004750 0x7f445c004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0051d0 0x7f445c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c00c080 con 0x7f445c0051d0 2023-11-06T13:27:42.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c00c1f0 con 0x7f445c004750 2023-11-06T13:27:42.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c00c3b0 con 0x7f445c003cd0 2023-11-06T13:27:42.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0051d0 0x7f445c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446f7fe700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c004750 0x7f445c004bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446ffff700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c003cd0 0x7f445c0040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 -- 172.21.15.38:0/866224087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c003cd0 msgr2=0x7f445c0040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:42.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c003cd0 0x7f445c0040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 -- 172.21.15.38:0/866224087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c004750 msgr2=0x7f445c004bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:42.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c004750 0x7f445c004bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 -- 172.21.15.38:0/866224087 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0033f0 con 0x7f445c0051d0 2023-11-06T13:27:42.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446ffff700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c003cd0 0x7f445c0040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:42.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 -- 172.21.15.38:0/866224087 reap_dead start 2023-11-06T13:27:42.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f4474ab4700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0051d0 0x7f445c00b8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4468001f10 tx=0x7f4468007f10).ready entity=mon.0 client_cookie=f0199e7703827bd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:42.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800c660 con 0x7f445c0051d0 2023-11-06T13:27:42.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800c7c0 con 0x7f445c0051d0 2023-11-06T13:27:42.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.048+0000 7f446effd700 1 -- 172.21.15.38:0/866224087 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800cb60 con 0x7f445c0051d0 2023-11-06T13:27:42.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 -- 172.21.15.38:0/866224087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0051d0 msgr2=0x7f445c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0051d0 0x7f445c00b8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f4468001f10 tx=0x7f4468007f10).stop 2023-11-06T13:27:42.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 -- 172.21.15.38:0/866224087 shutdown_connections 2023-11-06T13:27:42.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 --2- 172.21.15.38:0/866224087 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c0051d0 0x7f445c00b8e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 -- 172.21.15.38:0/866224087 >> 172.21.15.38:0/866224087 conn(0x7f44700f53e0 msgr2=0x7f44700f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 -- 172.21.15.38:0/866224087 shutdown_connections 2023-11-06T13:27:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.049+0000 7f4476517700 1 -- 172.21.15.38:0/866224087 wait complete. 2023-11-06T13:27:42.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.050+0000 7f4476517700 1 Processor -- start 2023-11-06T13:27:42.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.050+0000 7f4476517700 1 -- start start 2023-11-06T13:27:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.051+0000 7f4476517700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0051d0 0x7f447017d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.051+0000 7f4476517700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44700ec750 0x7f44701574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.051+0000 7f4476517700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 0x7f4470180ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4476517700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700ecc80 con 0x7f4470157990 2023-11-06T13:27:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4476517700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700ecf60 con 0x7f44700ec750 2023-11-06T13:27:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4476517700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44700ed240 con 0x7f445c0051d0 2023-11-06T13:27:42.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 0x7f4470180ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 0x7f4470180ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58706/0 (socket says 172.21.15.38:58706) 2023-11-06T13:27:42.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 -- 172.21.15.38:0/1754712249 learned_addr learned my addr 172.21.15.38:0/1754712249 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:42.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f446f7fe700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44700ec750 0x7f44701574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f446ffff700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0051d0 0x7f447017d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 -- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0051d0 msgr2=0x7f447017d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0051d0 0x7f447017d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 -- 172.21.15.38:0/1754712249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44700ec750 msgr2=0x7f44701574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44700ec750 0x7f44701574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 -- 172.21.15.38:0/1754712249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700ed520 con 0x7f4470157990 2023-11-06T13:27:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4474ab4700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 0x7f4470180ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f4468009000 tx=0x7f4468017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800c660 con 0x7f4470157990 2023-11-06T13:27:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800ced0 con 0x7f4470157990 2023-11-06T13:27:42.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468006c50 con 0x7f4470157990 2023-11-06T13:27:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44700ed800 con 0x7f4470157990 2023-11-06T13:27:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.052+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4470180fc0 con 0x7f4470157990 2023-11-06T13:27:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.053+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447006c580 con 0x7f4470157990 2023-11-06T13:27:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.054+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f4468007030 con 0x7f4470157990 2023-11-06T13:27:42.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.054+0000 7f4467fff700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f445008cb40 0x7f445008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:42.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.055+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7961+0+0 (secure 0 0 0) 0x7f44680b2970 con 0x7f4470157990 2023-11-06T13:27:42.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.055+0000 7f446ffff700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f445008cb40 0x7f445008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:42.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.055+0000 7f446ffff700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f445008cb40 0x7f445008f000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4458003880 tx=0x7f4458009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:42.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.058+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4468083310 con 0x7f4470157990 2023-11-06T13:27:42.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.243+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f4470089d80 con 0x7f4470157990 2023-11-06T13:27:42.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.896+0000 7f4467fff700 1 -- 172.21.15.38:0/1754712249 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v27) v1 ==== 157+0+0 (secure 0 0 0) 0x7f4468022030 con 0x7f4470157990 2023-11-06T13:27:42.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f445008cb40 msgr2=0x7f445008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f445008cb40 0x7f445008f000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4458003880 tx=0x7f4458009040).stop 2023-11-06T13:27:42.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 msgr2=0x7f4470180ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:42.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 0x7f4470180ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f4468009000 tx=0x7f4468017000).stop 2023-11-06T13:27:42.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 shutdown_connections 2023-11-06T13:27:42.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4470157990 0x7f4470180ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0051d0 0x7f447017d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f445008cb40 0x7f445008f000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 --2- 172.21.15.38:0/1754712249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44700ec750 0x7f44701574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:42.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 >> 172.21.15.38:0/1754712249 conn(0x7f44700f53e0 msgr2=0x7f44701743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:42.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 shutdown_connections 2023-11-06T13:27:42.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:42.899+0000 7f4476517700 1 -- 172.21.15.38:0/1754712249 wait complete. 2023-11-06T13:27:42.917 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-06T13:27:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.049+0000 7f5a1a2c2700 1 Processor -- start 2023-11-06T13:27:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.049+0000 7f5a1a2c2700 1 -- start start 2023-11-06T13:27:43.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a1a2c2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5a1417c990 0x7f5a14186680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a1a2c2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1417de40 con 0x7f5a141758a0 2023-11-06T13:27:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a1a2c2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1417fce0 con 0x7f5a140c84b0 2023-11-06T13:27:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a1a2c2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a14175c80 con 0x7f5a1417c990 2023-11-06T13:27:43.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a13fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5a141758a0 0x7f5a1417f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:60678/0 (socket says 172.21.15.38:60678) 2023-11-06T13:27:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a13fff700 1 -- 172.21.15.38:0/1290868380 learned_addr learned my addr 172.21.15.38:0/1290868380 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588349467 0 0) 0x7f5a1417de40 con 0x7f5a141758a0 2023-11-06T13:27:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a000033f0 con 0x7f5a141758a0 2023-11-06T13:27:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1290868380 >> v2:172.21.15.44:3300/0 conn(0x7f5a1417c990 0x7f5a14186680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886583575 0 0) 0x7f5a000033f0 con 0x7f5a141758a0 2023-11-06T13:27:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 >> v2:172.21.15.44:3300/0 conn(0x7f5a1417c990 msgr2=0x7f5a14186680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 --2- 172.21.15.38:0/1290868380 >> v2:172.21.15.44:3300/0 conn(0x7f5a1417c990 0x7f5a14186680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 >> v1:172.21.15.44:6789/0 conn(0x7f5a140c84b0 legacy=0x7f5a1417e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.050+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1417cf50 con 0x7f5a141758a0 2023-11-06T13:27:43.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f5a04001470 con 0x7f5a141758a0 2023-11-06T13:27:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1290868380 >> v2:172.21.15.44:3300/0 conn(0x7f5a1417c990 0x7f5a14186680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 >> v1:172.21.15.38:6789/0 conn(0x7f5a141758a0 legacy=0x7f5a1417f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a00003930 0x7f5a00003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00004690 0x7f5a00004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a0000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a14175c80 con 0x7f5a00005120 2023-11-06T13:27:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0000bf90 con 0x7f5a00004690 2023-11-06T13:27:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0000c150 con 0x7f5a00003930 2023-11-06T13:27:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a0000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a137fe700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00004690 0x7f5a00004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a13fff700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a00003930 0x7f5a00003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 -- 172.21.15.38:0/1290868380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a00003930 msgr2=0x7f5a00003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a00003930 0x7f5a00003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 -- 172.21.15.38:0/1290868380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00004690 msgr2=0x7f5a00004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:43.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a00004690 0x7f5a00004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 -- 172.21.15.38:0/1290868380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a000033f0 con 0x7f5a00005120 2023-11-06T13:27:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 -- 172.21.15.38:0/1290868380 reap_dead start 2023-11-06T13:27:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a0000b8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5a0c007550 tx=0x7f5a0c0097d0).ready entity=mon.0 client_cookie=d78b35a28ab357c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c009ae0 con 0x7f5a00005120 2023-11-06T13:27:43.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c007da0 con 0x7f5a00005120 2023-11-06T13:27:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.051+0000 7f5a12ffd700 1 -- 172.21.15.38:0/1290868380 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c015640 con 0x7f5a00005120 2023-11-06T13:27:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1290868380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 msgr2=0x7f5a0000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a0000b8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5a0c007550 tx=0x7f5a0c0097d0).stop 2023-11-06T13:27:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1290868380 shutdown_connections 2023-11-06T13:27:43.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1290868380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a0000b8e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1290868380 >> 172.21.15.38:0/1290868380 conn(0x7f5a140f5300 msgr2=0x7f5a140f5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1290868380 shutdown_connections 2023-11-06T13:27:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.052+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1290868380 wait complete. 2023-11-06T13:27:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.053+0000 7f5a1a2c2700 1 Processor -- start 2023-11-06T13:27:43.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.053+0000 7f5a1a2c2700 1 -- start start 2023-11-06T13:27:43.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a1a2c2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a1418ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a1a2c2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a1416bb00 0x7f5a14180370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a1a2c2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a14180860 0x7f5a1416cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a1a2c2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140cad10 con 0x7f5a00005120 2023-11-06T13:27:43.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a1a2c2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1416c640 con 0x7f5a1416bb00 2023-11-06T13:27:43.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a1a2c2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1418faf0 con 0x7f5a14180860 2023-11-06T13:27:43.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a13fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a1418ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a13fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a1418ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58722/0 (socket says 172.21.15.38:58722) 2023-11-06T13:27:43.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.054+0000 7f5a13fff700 1 -- 172.21.15.38:0/1294516192 learned_addr learned my addr 172.21.15.38:0/1294516192 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:43.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a1885f700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a14180860 0x7f5a1416cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a137fe700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a1416bb00 0x7f5a14180370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a13fff700 1 -- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a14180860 msgr2=0x7f5a1416cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a13fff700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a14180860 0x7f5a1416cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a13fff700 1 -- 172.21.15.38:0/1294516192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a1416bb00 msgr2=0x7f5a14180370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a13fff700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a1416bb00 0x7f5a14180370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a13fff700 1 -- 172.21.15.38:0/1294516192 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1418f250 con 0x7f5a00005120 2023-11-06T13:27:43.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a13fff700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a1418ebf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5a0400e6d0 tx=0x7f5a04000d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04015440 con 0x7f5a00005120 2023-11-06T13:27:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04010040 con 0x7f5a00005120 2023-11-06T13:27:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1418f530 con 0x7f5a00005120 2023-11-06T13:27:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040157b0 con 0x7f5a00005120 2023-11-06T13:27:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.055+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1416c2d0 con 0x7f5a00005120 2023-11-06T13:27:43.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.056+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1416c920 con 0x7f5a00005120 2023-11-06T13:27:43.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.057+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f5a04015b20 con 0x7f5a00005120 2023-11-06T13:27:43.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.058+0000 7f5a0bfff700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f59f408cb40 0x7f59f408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:43.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.058+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8220+0+0 (secure 0 0 0) 0x7f5a040b1300 con 0x7f5a00005120 2023-11-06T13:27:43.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.058+0000 7f5a137fe700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f59f408cb40 0x7f59f408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:43.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.058+0000 7f5a137fe700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f59f408cb40 0x7f59f408f000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5a14180320 tx=0x7f59fc007bb0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:43.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.062+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5a04081b60 con 0x7f5a00005120 2023-11-06T13:27:43.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:43.236+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5a1406c580 con 0x7f5a00005120 2023-11-06T13:27:43.489 INFO:tasks.ceph.mds.l.smithi163.stderr:2023-11-06T13:27:43.485+0000 7f2da7b5b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-06T13:27:44.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.908+0000 7f5a0bfff700 1 -- 172.21.15.38:0/1294516192 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v29) v1 ==== 228+0+0 (secure 0 0 0) 0x7f5a04085180 con 0x7f5a00005120 2023-11-06T13:27:44.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f59f408cb40 msgr2=0x7f59f408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:44.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f59f408cb40 0x7f59f408f000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5a14180320 tx=0x7f59fc007bb0).stop 2023-11-06T13:27:44.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 msgr2=0x7f5a1418ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:44.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a1418ebf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5a0400e6d0 tx=0x7f5a04000d00).stop 2023-11-06T13:27:44.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 shutdown_connections 2023-11-06T13:27:44.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5a14180860 0x7f5a1416cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:44.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5a00005120 0x7f5a1418ebf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f59f408cb40 0x7f59f408f000 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 --2- 172.21.15.38:0/1294516192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a1416bb00 0x7f5a14180370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 >> 172.21.15.38:0/1294516192 conn(0x7f5a140f5300 msgr2=0x7f5a1416efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 shutdown_connections 2023-11-06T13:27:44.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:44.918+0000 7f5a1a2c2700 1 -- 172.21.15.38:0/1294516192 wait complete. 2023-11-06T13:27:44.924 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'cephfs_data_ec' created 2023-11-06T13:27:44.936 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-06T13:27:45.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.063+0000 7f01accd5700 1 Processor -- start 2023-11-06T13:27:45.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.063+0000 7f01accd5700 1 -- start start 2023-11-06T13:27:45.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01accd5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f01a817d270 0x7f01a817d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01accd5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f01a817dbc0 0x7f01a80c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01accd5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80edb70 con 0x7f01a81724d0 2023-11-06T13:27:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01accd5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80ede50 con 0x7f01a817d270 2023-11-06T13:27:45.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01accd5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80ee130 con 0x7f01a817dbc0 2023-11-06T13:27:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f01a817d270 0x7f01a817d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f01a817d270 0x7f01a817d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58738/0 (socket says 172.21.15.38:58738) 2023-11-06T13:27:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 -- 172.21.15.38:0/2955103838 learned_addr learned my addr 172.21.15.38:0/2955103838 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a6d9d700 1 --2- 172.21.15.38:0/2955103838 >> v2:172.21.15.44:3300/0 conn(0x7f01a817dbc0 0x7f01a80c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:45.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 -- 172.21.15.38:0/2955103838 >> v2:172.21.15.44:3300/0 conn(0x7f01a817dbc0 msgr2=0x7f01a80c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 --2- 172.21.15.38:0/2955103838 >> v2:172.21.15.44:3300/0 conn(0x7f01a817dbc0 0x7f01a80c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 -- 172.21.15.38:0/2955103838 >> v1:172.21.15.163:6789/0 conn(0x7f01a81724d0 legacy=0x7f01a80ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 -- 172.21.15.38:0/2955103838 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80ee410 con 0x7f01a817d270 2023-11-06T13:27:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a6d9d700 1 --2- 172.21.15.38:0/2955103838 >> v2:172.21.15.44:3300/0 conn(0x7f01a817dbc0 0x7f01a80c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:45.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a5d9b700 1 --2- 172.21.15.38:0/2955103838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817d270 0x7f01a817d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f01a80c7830 tx=0x7f01900090f0).ready entity=mon.0 client_cookie=a0049d631de1d8f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:45.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.065+0000 7f01a559a700 1 -- 172.21.15.38:0/2955103838 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000b600 con 0x7f01a817d270 2023-11-06T13:27:45.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01a559a700 1 -- 172.21.15.38:0/2955103838 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000b760 con 0x7f01a817d270 2023-11-06T13:27:45.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01a559a700 1 -- 172.21.15.38:0/2955103838 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000bae0 con 0x7f01a817d270 2023-11-06T13:27:45.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 -- 172.21.15.38:0/2955103838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817d270 msgr2=0x7f01a817d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:45.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 --2- 172.21.15.38:0/2955103838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817d270 0x7f01a817d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f01a80c7830 tx=0x7f01900090f0).stop 2023-11-06T13:27:45.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 -- 172.21.15.38:0/2955103838 shutdown_connections 2023-11-06T13:27:45.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 --2- 172.21.15.38:0/2955103838 >> v2:172.21.15.44:3300/0 conn(0x7f01a817dbc0 0x7f01a80c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 --2- 172.21.15.38:0/2955103838 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817d270 0x7f01a817d6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 -- 172.21.15.38:0/2955103838 >> 172.21.15.38:0/2955103838 conn(0x7f01a80eeb50 msgr2=0x7f01a80eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:45.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 -- 172.21.15.38:0/2955103838 shutdown_connections 2023-11-06T13:27:45.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.066+0000 7f01accd5700 1 -- 172.21.15.38:0/2955103838 wait complete. 2023-11-06T13:27:45.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.067+0000 7f01accd5700 1 Processor -- start 2023-11-06T13:27:45.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.068+0000 7f01accd5700 1 -- start start 2023-11-06T13:27:45.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.068+0000 7f01accd5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01a81724d0 0x7f01a8170a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:45.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01a817d270 0x7f01a80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 0x7f01a80c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a818cbc0 con 0x7f01a817dbc0 2023-11-06T13:27:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c6770 con 0x7f01a817d270 2023-11-06T13:27:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c75e0 con 0x7f01a81724d0 2023-11-06T13:27:45.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 0x7f01a80c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 0x7f01a80c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58752/0 (socket says 172.21.15.38:58752) 2023-11-06T13:27:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 -- 172.21.15.38:0/2310082641 learned_addr learned my addr 172.21.15.38:0/2310082641 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a5d9b700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01a817d270 0x7f01a80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a659c700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01a81724d0 0x7f01a8170a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:45.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 -- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01a81724d0 msgr2=0x7f01a8170a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01a81724d0 0x7f01a8170a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 -- 172.21.15.38:0/2310082641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01a817d270 msgr2=0x7f01a80c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01a817d270 0x7f01a80c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 -- 172.21.15.38:0/2310082641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009370 con 0x7f01a817dbc0 2023-11-06T13:27:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01a6d9d700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 0x7f01a80c70f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f01a000c650 tx=0x7f01a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0010580 con 0x7f01a817dbc0 2023-11-06T13:27:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a00106e0 con 0x7f01a817dbc0 2023-11-06T13:27:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0010a80 con 0x7f01a817dbc0 2023-11-06T13:27:45.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a818cdd0 con 0x7f01a817dbc0 2023-11-06T13:27:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.069+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a818d390 con 0x7f01a817dbc0 2023-11-06T13:27:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.070+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a806c580 con 0x7f01a817dbc0 2023-11-06T13:27:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.072+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f01a001b460 con 0x7f01a817dbc0 2023-11-06T13:27:45.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.072+0000 7f019e7fc700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f018808cb40 0x7f018808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.073+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8713+0+0 (secure 0 0 0) 0x7f01a00b2990 con 0x7f01a817dbc0 2023-11-06T13:27:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.073+0000 7f01a659c700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f018808cb40 0x7f018808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:45.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.073+0000 7f01a659c700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f018808cb40 0x7f018808f000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0198000f80 tx=0x7f0198009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:45.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.076+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f01a0082f80 con 0x7f01a817dbc0 2023-11-06T13:27:45.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.249+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f01a80ee6f0 con 0x7f01a817dbc0 2023-11-06T13:27:45.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.907+0000 7f019e7fc700 1 -- 172.21.15.38:0/2310082641 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f01a000a2c0 con 0x7f01a817dbc0 2023-11-06T13:27:45.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.912+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f018808cb40 msgr2=0x7f018808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.912+0000 7f01accd5700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f018808cb40 0x7f018808f000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0198000f80 tx=0x7f0198009040).stop 2023-11-06T13:27:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.912+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 msgr2=0x7f01a80c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.912+0000 7f01accd5700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 0x7f01a80c70f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f01a000c650 tx=0x7f01a0008040).stop 2023-11-06T13:27:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.913+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 shutdown_connections 2023-11-06T13:27:45.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.913+0000 7f01accd5700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f01a817dbc0 0x7f01a80c70f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.913+0000 7f01accd5700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01a81724d0 0x7f01a8170a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.913+0000 7f01accd5700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f018808cb40 0x7f018808f000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.913+0000 7f01accd5700 1 --2- 172.21.15.38:0/2310082641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f01a817d270 0x7f01a80c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:45.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.913+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 >> 172.21.15.38:0/2310082641 conn(0x7f01a80eeb50 msgr2=0x7f01a817e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.914+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 shutdown_connections 2023-11-06T13:27:45.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:45.915+0000 7f01accd5700 1 -- 172.21.15.38:0/2310082641 wait complete. 2023-11-06T13:27:45.921 INFO:teuthology.orchestra.run.smithi038.stderr:set pool 5 allow_ec_overwrites to true 2023-11-06T13:27:45.939 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-06T13:27:46.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.062+0000 7facf5c1a700 1 Processor -- start 2023-11-06T13:27:46.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.062+0000 7facf5c1a700 1 -- start start 2023-11-06T13:27:46.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facf5c1a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7facf0178c60 0x7facf0179040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facf5c1a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7facf00f0350 0x7facf00f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facf5c1a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf017cbe0 con 0x7facf017d960 2023-11-06T13:27:46.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facf5c1a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf0064370 con 0x7facf0178c60 2023-11-06T13:27:46.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facf5c1a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf017ce80 con 0x7facf00f0350 2023-11-06T13:27:46.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facef7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7facf0178c60 0x7facf0179040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facef7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7facf0178c60 0x7facf0179040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58766/0 (socket says 172.21.15.38:58766) 2023-11-06T13:27:46.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7facef7fe700 1 -- 172.21.15.38:0/428400083 learned_addr learned my addr 172.21.15.38:0/428400083 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:46.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.063+0000 7faceffff700 1 --2- 172.21.15.38:0/428400083 >> v2:172.21.15.44:3300/0 conn(0x7facf00f0350 0x7facf00f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facef7fe700 1 -- 172.21.15.38:0/428400083 >> v2:172.21.15.44:3300/0 conn(0x7facf00f0350 msgr2=0x7facf00f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:46.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facef7fe700 1 --2- 172.21.15.38:0/428400083 >> v2:172.21.15.44:3300/0 conn(0x7facf00f0350 0x7facf00f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facef7fe700 1 -- 172.21.15.38:0/428400083 >> v1:172.21.15.44:6789/0 conn(0x7facf017d960 legacy=0x7facf017de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facef7fe700 1 -- 172.21.15.38:0/428400083 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf017d160 con 0x7facf0178c60 2023-11-06T13:27:46.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facef7fe700 1 --2- 172.21.15.38:0/428400083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf0179040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7facf006c800 tx=0x7face00090f0).ready entity=mon.0 client_cookie=e7ac45069f220727 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facee7fc700 1 -- 172.21.15.38:0/428400083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face000b600 con 0x7facf0178c60 2023-11-06T13:27:46.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facee7fc700 1 -- 172.21.15.38:0/428400083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face000b760 con 0x7facf0178c60 2023-11-06T13:27:46.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facee7fc700 1 -- 172.21.15.38:0/428400083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face000bb00 con 0x7facf0178c60 2023-11-06T13:27:46.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 -- 172.21.15.38:0/428400083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 msgr2=0x7facf0179040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 --2- 172.21.15.38:0/428400083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf0179040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7facf006c800 tx=0x7face00090f0).stop 2023-11-06T13:27:46.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 -- 172.21.15.38:0/428400083 shutdown_connections 2023-11-06T13:27:46.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 --2- 172.21.15.38:0/428400083 >> v2:172.21.15.44:3300/0 conn(0x7facf00f0350 0x7facf00f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 --2- 172.21.15.38:0/428400083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf0179040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 -- 172.21.15.38:0/428400083 >> 172.21.15.38:0/428400083 conn(0x7facf00f5ea0 msgr2=0x7facf00f1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:46.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 -- 172.21.15.38:0/428400083 shutdown_connections 2023-11-06T13:27:46.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.064+0000 7facf5c1a700 1 -- 172.21.15.38:0/428400083 wait complete. 2023-11-06T13:27:46.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.066+0000 7facf5c1a700 1 Processor -- start 2023-11-06T13:27:46.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.066+0000 7facf5c1a700 1 -- start start 2023-11-06T13:27:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facf5c1a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf00f0350 0x7facf0169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facf5c1a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facf5c1a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facf017d960 0x7facf00cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facf5c1a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf018f3b0 con 0x7facf0178c60 2023-11-06T13:27:46.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facf5c1a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf018f690 con 0x7facf017d960 2023-11-06T13:27:46.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facf5c1a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf018f970 con 0x7facf00f0350 2023-11-06T13:27:46.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf00cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58772/0 (socket says 172.21.15.38:58772) 2023-11-06T13:27:46.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 -- 172.21.15.38:0/1023872981 learned_addr learned my addr 172.21.15.38:0/1023872981 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:46.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceffff700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facf017d960 0x7facf00cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7facef7fe700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf00f0350 0x7facf0169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 -- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf00f0350 msgr2=0x7facf0169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf00f0350 0x7facf0169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 -- 172.21.15.38:0/1023872981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facf017d960 msgr2=0x7facf00cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facf017d960 0x7facf00cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceeffd700 1 -- 172.21.15.38:0/1023872981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009370 con 0x7facf0178c60 2023-11-06T13:27:46.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.067+0000 7faceffff700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facf017d960 0x7facf00cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:46.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.068+0000 7faceeffd700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf00cbaa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7face400c440 tx=0x7face4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.068+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400cea0 con 0x7facf0178c60 2023-11-06T13:27:46.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.068+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400f470 con 0x7facf0178c60 2023-11-06T13:27:46.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.068+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400f830 con 0x7facf0178c60 2023-11-06T13:27:46.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.068+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf018fc50 con 0x7facf0178c60 2023-11-06T13:27:46.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.068+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf016a290 con 0x7facf0178c60 2023-11-06T13:27:46.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.069+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf018fe40 con 0x7facf0178c60 2023-11-06T13:27:46.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.070+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7face400fbe0 con 0x7facf0178c60 2023-11-06T13:27:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.070+0000 7facd77fe700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7facdc08cb40 0x7facdc08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.071+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8713+0+0 (secure 0 0 0) 0x7face40b1430 con 0x7facf0178c60 2023-11-06T13:27:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.071+0000 7facef7fe700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7facdc08cb40 0x7facdc08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.071+0000 7facef7fe700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7facdc08cb40 0x7facdc08f000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7face0009fd0 tx=0x7face0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.075+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7face4081aa0 con 0x7facf0178c60 2023-11-06T13:27:46.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.297+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7facf006c580 con 0x7facf0178c60 2023-11-06T13:27:46.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.306+0000 7facd77fe700 1 -- 172.21.15.38:0/1023872981 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7face4017020 con 0x7facf0178c60 2023-11-06T13:27:46.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7facdc08cb40 msgr2=0x7facdc08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7facdc08cb40 0x7facdc08f000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7face0009fd0 tx=0x7face0017000).stop 2023-11-06T13:27:46.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 msgr2=0x7facf00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf00cbaa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7face400c440 tx=0x7face4007db0).stop 2023-11-06T13:27:46.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 shutdown_connections 2023-11-06T13:27:46.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7facdc08cb40 0x7facdc08f000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7facf017d960 0x7facf00cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf00f0350 0x7facf0169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 --2- 172.21.15.38:0/1023872981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7facf0178c60 0x7facf00cbaa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 >> 172.21.15.38:0/1023872981 conn(0x7facf00f5ea0 msgr2=0x7facf00f0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:46.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 shutdown_connections 2023-11-06T13:27:46.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.308+0000 7facf5c1a700 1 -- 172.21.15.38:0/1023872981 wait complete. 2023-11-06T13:27:46.314 INFO:teuthology.orchestra.run.smithi038.stderr:added data pool 5 to fsmap 2023-11-06T13:27:46.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:27:46.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.438+0000 7fa21359e700 1 Processor -- start 2023-11-06T13:27:46.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.438+0000 7fa21359e700 1 -- start start 2023-11-06T13:27:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa21359e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa2141752a0 0x7fa214182a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa21359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa214175680 0x7fa21417ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa21359e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa214180420 0x7fa2140efb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa21359e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140871b0 con 0x7fa214180420 2023-11-06T13:27:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa21359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140882f0 con 0x7fa214175680 2023-11-06T13:27:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa21359e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa214182ef0 con 0x7fa2141752a0 2023-11-06T13:27:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa212d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa214180420 0x7fa2140efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa212d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa214180420 0x7fa2140efb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35206/0 (socket says 172.21.15.38:35206) 2023-11-06T13:27:46.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.439+0000 7fa212d9d700 1 -- 172.21.15.38:0/3402540597 learned_addr learned my addr 172.21.15.38:0/3402540597 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:46.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa21259c700 1 --2- 172.21.15.38:0/3402540597 >> v2:172.21.15.163:3300/0 conn(0x7fa2141752a0 0x7fa214182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa211d9b700 1 --2- 172.21.15.38:0/3402540597 >> v2:172.21.15.44:3300/0 conn(0x7fa214175680 0x7fa21417ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa212d9d700 1 -- 172.21.15.38:0/3402540597 >> v2:172.21.15.163:3300/0 conn(0x7fa2141752a0 msgr2=0x7fa214182a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:46.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa212d9d700 1 --2- 172.21.15.38:0/3402540597 >> v2:172.21.15.163:3300/0 conn(0x7fa2141752a0 0x7fa214182a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa212d9d700 1 -- 172.21.15.38:0/3402540597 >> v2:172.21.15.44:3300/0 conn(0x7fa214175680 msgr2=0x7fa21417ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:46.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa212d9d700 1 --2- 172.21.15.38:0/3402540597 >> v2:172.21.15.44:3300/0 conn(0x7fa214175680 0x7fa21417ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa212d9d700 1 -- 172.21.15.38:0/3402540597 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa214180850 con 0x7fa214180420 2023-11-06T13:27:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa212d9d700 1 --2- 172.21.15.38:0/3402540597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214180420 0x7fa2140efb90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa2140f1c60 tx=0x7fa20c009840).ready entity=mon.0 client_cookie=7fb005ad7bcb37df server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa21159a700 1 -- 172.21.15.38:0/3402540597 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00e070 con 0x7fa214180420 2023-11-06T13:27:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa21159a700 1 -- 172.21.15.38:0/3402540597 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00ba50 con 0x7fa214180420 2023-11-06T13:27:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa21159a700 1 -- 172.21.15.38:0/3402540597 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00bdd0 con 0x7fa214180420 2023-11-06T13:27:46.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa21359e700 1 -- 172.21.15.38:0/3402540597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214180420 msgr2=0x7fa2140efb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.440+0000 7fa21359e700 1 --2- 172.21.15.38:0/3402540597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214180420 0x7fa2140efb90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa2140f1c60 tx=0x7fa20c009840).stop 2023-11-06T13:27:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 -- 172.21.15.38:0/3402540597 shutdown_connections 2023-11-06T13:27:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 --2- 172.21.15.38:0/3402540597 >> v2:172.21.15.163:3300/0 conn(0x7fa2141752a0 0x7fa214182a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 --2- 172.21.15.38:0/3402540597 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214180420 0x7fa2140efb90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 --2- 172.21.15.38:0/3402540597 >> v2:172.21.15.44:3300/0 conn(0x7fa214175680 0x7fa21417ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 -- 172.21.15.38:0/3402540597 >> 172.21.15.38:0/3402540597 conn(0x7fa2140f51f0 msgr2=0x7fa2140f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 -- 172.21.15.38:0/3402540597 shutdown_connections 2023-11-06T13:27:46.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.441+0000 7fa21359e700 1 -- 172.21.15.38:0/3402540597 wait complete. 2023-11-06T13:27:46.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.442+0000 7fa21359e700 1 Processor -- start 2023-11-06T13:27:46.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.442+0000 7fa21359e700 1 -- start start 2023-11-06T13:27:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2141752a0 0x7fa21416dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 0x7fa2141534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21359e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa214180420 0x7fa2141539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21359e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa214153e90 con 0x7fa214175680 2023-11-06T13:27:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140ef1a0 con 0x7fa2141752a0 2023-11-06T13:27:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21359e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140ee2b0 con 0x7fa214180420 2023-11-06T13:27:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 0x7fa2141534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 0x7fa2141534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35208/0 (socket says 172.21.15.38:35208) 2023-11-06T13:27:46.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 -- 172.21.15.38:0/70916637 learned_addr learned my addr 172.21.15.38:0/70916637 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa212d9d700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa214180420 0x7fa2141539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa21259c700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2141752a0 0x7fa21416dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 -- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa214180420 msgr2=0x7fa2141539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa214180420 0x7fa2141539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 -- 172.21.15.38:0/70916637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2141752a0 msgr2=0x7fa21416dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2141752a0 0x7fa21416dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 -- 172.21.15.38:0/70916637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c009ae0 con 0x7fa214175680 2023-11-06T13:27:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.443+0000 7fa211d9b700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 0x7fa2141534b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa1fc00c650 tx=0x7fa1fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.444+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc010580 con 0x7fa214175680 2023-11-06T13:27:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.444+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0106e0 con 0x7fa214175680 2023-11-06T13:27:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.444+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2140ee590 con 0x7fa214175680 2023-11-06T13:27:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.444+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc010a60 con 0x7fa214175680 2023-11-06T13:27:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.444+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2140eeb50 con 0x7fa214175680 2023-11-06T13:27:46.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.445+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2140ef330 con 0x7fa214175680 2023-11-06T13:27:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.445+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fa1fc01b460 con 0x7fa214175680 2023-11-06T13:27:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.446+0000 7fa20a7fc700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa1f408cb40 0x7fa1f408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.446+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa1fc0b1e90 con 0x7fa214175680 2023-11-06T13:27:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.446+0000 7fa21259c700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa1f408cb40 0x7fa1f408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.447+0000 7fa21259c700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa1f408cb40 0x7fa1f408f000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa204006fd0 tx=0x7fa204008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.450+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa1fc082460 con 0x7fa214175680 2023-11-06T13:27:46.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.665+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa214087400 con 0x7fa214175680 2023-11-06T13:27:46.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.665+0000 7fa20a7fc700 1 -- 172.21.15.38:0/70916637 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+10536 (secure 0 0 0) 0x7fa1fc0b3020 con 0x7fa214175680 2023-11-06T13:27:46.669 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:46.669 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4352,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4355,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:46.299276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-11-06T13:27:46.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa1f408cb40 msgr2=0x7fa1f408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa1f408cb40 0x7fa1f408f000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa204006fd0 tx=0x7fa204008040).stop 2023-11-06T13:27:46.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 msgr2=0x7fa2141534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 0x7fa2141534b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa1fc00c650 tx=0x7fa1fc008040).stop 2023-11-06T13:27:46.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 shutdown_connections 2023-11-06T13:27:46.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa214180420 0x7fa2141539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa1f408cb40 0x7fa1f408f000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2141752a0 0x7fa21416dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.667+0000 7fa21359e700 1 --2- 172.21.15.38:0/70916637 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa214175680 0x7fa2141534b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.668+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 >> 172.21.15.38:0/70916637 conn(0x7fa2140f51f0 msgr2=0x7fa21416ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:46.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.668+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 shutdown_connections 2023-11-06T13:27:46.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.668+0000 7fa21359e700 1 -- 172.21.15.38:0/70916637 wait complete. 2023-11-06T13:27:46.674 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2023-11-06T13:27:46.683 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.798+0000 7f1230e22700 1 Processor -- start 2023-11-06T13:27:46.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.798+0000 7f1230e22700 1 -- start start 2023-11-06T13:27:46.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f1230e22700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f122c17e570 0x7f122c186590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f1230e22700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c17d9d0 con 0x7f122c1756e0 2023-11-06T13:27:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f1230e22700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c17c800 con 0x7f122c0647f0 2023-11-06T13:27:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f1230e22700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c0c8560 con 0x7f122c17e570 2023-11-06T13:27:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f122ad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f122c17e570 0x7f122c186590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f122ad9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f122c17e570 0x7f122c186590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35212/0 (socket says 172.21.15.38:35212) 2023-11-06T13:27:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.799+0000 7f122ad9d700 1 -- 172.21.15.38:0/3043874732 learned_addr learned my addr 172.21.15.38:0/3043874732 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122ad9d700 1 -- 172.21.15.38:0/3043874732 >> v1:172.21.15.163:6789/0 conn(0x7f122c0647f0 legacy=0x7f122c17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122ad9d700 1 -- 172.21.15.38:0/3043874732 >> v1:172.21.15.44:6789/0 conn(0x7f122c1756e0 legacy=0x7f122c0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122ad9d700 1 -- 172.21.15.38:0/3043874732 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c17cae0 con 0x7f122c17e570 2023-11-06T13:27:46.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122ad9d700 1 --2- 172.21.15.38:0/3043874732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c186590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1224009f20 tx=0x7f1224009840).ready entity=mon.0 client_cookie=9fc535c69988cff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122959a700 1 -- 172.21.15.38:0/3043874732 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400e070 con 0x7f122c17e570 2023-11-06T13:27:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122959a700 1 -- 172.21.15.38:0/3043874732 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400ba00 con 0x7f122c17e570 2023-11-06T13:27:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f122959a700 1 -- 172.21.15.38:0/3043874732 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400bd80 con 0x7f122c17e570 2023-11-06T13:27:46.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 -- 172.21.15.38:0/3043874732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 msgr2=0x7f122c186590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 --2- 172.21.15.38:0/3043874732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c186590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f1224009f20 tx=0x7f1224009840).stop 2023-11-06T13:27:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 -- 172.21.15.38:0/3043874732 shutdown_connections 2023-11-06T13:27:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 --2- 172.21.15.38:0/3043874732 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c186590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 -- 172.21.15.38:0/3043874732 >> 172.21.15.38:0/3043874732 conn(0x7f122c069ea0 msgr2=0x7f122c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:46.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 -- 172.21.15.38:0/3043874732 shutdown_connections 2023-11-06T13:27:46.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.800+0000 7f1230e22700 1 -- 172.21.15.38:0/3043874732 wait complete. 2023-11-06T13:27:46.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.802+0000 7f1230e22700 1 Processor -- start 2023-11-06T13:27:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.802+0000 7f1230e22700 1 -- start start 2023-11-06T13:27:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1230e22700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f122c0647f0 0x7f122c16e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1230e22700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f122c1756e0 0x7f122c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1230e22700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1230e22700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0ca3c0 con 0x7f122c17e570 2023-11-06T13:27:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1230e22700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0c94d0 con 0x7f122c0647f0 2023-11-06T13:27:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1230e22700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0c97b0 con 0x7f122c1756e0 2023-11-06T13:27:46.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c0c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35220/0 (socket says 172.21.15.38:35220) 2023-11-06T13:27:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 -- 172.21.15.38:0/130026879 learned_addr learned my addr 172.21.15.38:0/130026879 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f1229d9b700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f122c1756e0 0x7f122c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122a59c700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f122c0647f0 0x7f122c16e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 -- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f122c1756e0 msgr2=0x7f122c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f122c1756e0 0x7f122c0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 -- 172.21.15.38:0/130026879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f122c0647f0 msgr2=0x7f122c16e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f122c0647f0 0x7f122c16e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 -- 172.21.15.38:0/130026879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009ae0 con 0x7f122c17e570 2023-11-06T13:27:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122a59c700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f122c0647f0 0x7f122c16e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.803+0000 7f122ad9d700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c0c8ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f122c06ac20 tx=0x7f1224009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.804+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240092e0 con 0x7f122c17e570 2023-11-06T13:27:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.804+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122401d410 con 0x7f122c17e570 2023-11-06T13:27:46.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.804+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c0c9a90 con 0x7f122c17e570 2023-11-06T13:27:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.804+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122401d790 con 0x7f122c17e570 2023-11-06T13:27:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.804+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c0ca050 con 0x7f122c17e570 2023-11-06T13:27:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.805+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c06c580 con 0x7f122c17e570 2023-11-06T13:27:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.806+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f122401db80 con 0x7f122c17e570 2023-11-06T13:27:46.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.806+0000 7f121a7fc700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f120c08cb40 0x7f120c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.806+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f12240b3d40 con 0x7f122c17e570 2023-11-06T13:27:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.806+0000 7f122a59c700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f120c08cb40 0x7f120c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:46.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.807+0000 7f122a59c700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f120c08cb40 0x7f120c08f000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f121c0026f0 tx=0x7f121c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:46.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.810+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1224084390 con 0x7f122c17e570 2023-11-06T13:27:46.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.983+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f122c06c580 con 0x7f122c17e570 2023-11-06T13:27:46.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.984+0000 7f121a7fc700 1 -- 172.21.15.38:0/130026879 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f12240879b0 con 0x7f122c17e570 2023-11-06T13:27:46.988 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:46.988 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f120c08cb40 msgr2=0x7f120c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f120c08cb40 0x7f120c08f000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f121c0026f0 tx=0x7f121c009040).stop 2023-11-06T13:27:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 msgr2=0x7f122c0c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:46.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c0c8ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f122c06ac20 tx=0x7f1224009840).stop 2023-11-06T13:27:46.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 shutdown_connections 2023-11-06T13:27:46.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f122c17e570 0x7f122c0c8ba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f120c08cb40 0x7f120c08f000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f122c0647f0 0x7f122c16e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 --2- 172.21.15.38:0/130026879 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f122c1756e0 0x7f122c0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:46.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 >> 172.21.15.38:0/130026879 conn(0x7f122c069ea0 msgr2=0x7f122c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:46.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 shutdown_connections 2023-11-06T13:27:46.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:46.986+0000 7f1230e22700 1 -- 172.21.15.38:0/130026879 wait complete. 2023-11-06T13:27:47.002 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.116+0000 7f595fe55700 1 Processor -- start 2023-11-06T13:27:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.117+0000 7f595fe55700 1 -- start start 2023-11-06T13:27:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595fe55700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f59581756e0 0x7f59580640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595fe55700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59580645d0 0x7f595817de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595fe55700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595817d9d0 con 0x7f595817e350 2023-11-06T13:27:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595fe55700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580c8560 con 0x7f59580645d0 2023-11-06T13:27:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595fe55700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5958064a50 con 0x7f59581756e0 2023-11-06T13:27:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59580645d0 0x7f595817de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f59580645d0 0x7f595817de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35228/0 (socket says 172.21.15.38:35228) 2023-11-06T13:27:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 -- 172.21.15.38:0/2056055120 learned_addr learned my addr 172.21.15.38:0/2056055120 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595dbf1700 1 --2- 172.21.15.38:0/2056055120 >> v2:172.21.15.163:3300/0 conn(0x7f59581756e0 0x7f59580640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 -- 172.21.15.38:0/2056055120 >> v2:172.21.15.163:3300/0 conn(0x7f59581756e0 msgr2=0x7f59580640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 --2- 172.21.15.38:0/2056055120 >> v2:172.21.15.163:3300/0 conn(0x7f59581756e0 0x7f59580640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 -- 172.21.15.38:0/2056055120 >> v1:172.21.15.44:6789/0 conn(0x7f595817e350 legacy=0x7f59580f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 -- 172.21.15.38:0/2056055120 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595817c800 con 0x7f59580645d0 2023-11-06T13:27:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.118+0000 7f595d3f0700 1 --2- 172.21.15.38:0/2056055120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f595817de60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f59580ce060 tx=0x7f594c0090f0).ready entity=mon.0 client_cookie=64bc35756dc4440a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595cbef700 1 -- 172.21.15.38:0/2056055120 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c00b5a0 con 0x7f59580645d0 2023-11-06T13:27:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595cbef700 1 -- 172.21.15.38:0/2056055120 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c00b700 con 0x7f59580645d0 2023-11-06T13:27:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595cbef700 1 -- 172.21.15.38:0/2056055120 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c00ba80 con 0x7f59580645d0 2023-11-06T13:27:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 -- 172.21.15.38:0/2056055120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 msgr2=0x7f595817de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 --2- 172.21.15.38:0/2056055120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f595817de60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f59580ce060 tx=0x7f594c0090f0).stop 2023-11-06T13:27:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 -- 172.21.15.38:0/2056055120 shutdown_connections 2023-11-06T13:27:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 --2- 172.21.15.38:0/2056055120 >> v2:172.21.15.163:3300/0 conn(0x7f59581756e0 0x7f59580640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 --2- 172.21.15.38:0/2056055120 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f595817de60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 -- 172.21.15.38:0/2056055120 >> 172.21.15.38:0/2056055120 conn(0x7f5958069ea0 msgr2=0x7f595806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 -- 172.21.15.38:0/2056055120 shutdown_connections 2023-11-06T13:27:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.119+0000 7f595fe55700 1 -- 172.21.15.38:0/2056055120 wait complete. 2023-11-06T13:27:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.121+0000 7f595fe55700 1 Processor -- start 2023-11-06T13:27:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.121+0000 7f595fe55700 1 -- start start 2023-11-06T13:27:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f5958150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59581756e0 0x7f59580c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f595817e350 0x7f59580c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c86b0 con 0x7f59580645d0 2023-11-06T13:27:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c5ad0 con 0x7f595817e350 2023-11-06T13:27:47.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580c4be0 con 0x7f59581756e0 2023-11-06T13:27:47.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f5958150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f5958150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35230/0 (socket says 172.21.15.38:35230) 2023-11-06T13:27:47.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 -- 172.21.15.38:0/1808813639 learned_addr learned my addr 172.21.15.38:0/1808813639 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:47.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595d3f0700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59581756e0 0x7f59580c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595e3f2700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f595817e350 0x7f59580c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 -- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59581756e0 msgr2=0x7f59580c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59581756e0 0x7f59580c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 -- 172.21.15.38:0/1808813639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f595817e350 msgr2=0x7f59580c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f595817e350 0x7f59580c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 -- 172.21.15.38:0/1808813639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c009370 con 0x7f59580645d0 2023-11-06T13:27:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595d3f0700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59581756e0 0x7f59580c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595dbf1700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f5958150320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f595000d860 tx=0x7f5950008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950011590 con 0x7f59580645d0 2023-11-06T13:27:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500116f0 con 0x7f59580645d0 2023-11-06T13:27:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580c4ec0 con 0x7f59580645d0 2023-11-06T13:27:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.122+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950011a70 con 0x7f59580645d0 2023-11-06T13:27:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.123+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59580c5480 con 0x7f59580645d0 2023-11-06T13:27:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.124+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595806c580 con 0x7f59580645d0 2023-11-06T13:27:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.124+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f5950012420 con 0x7f59580645d0 2023-11-06T13:27:47.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.125+0000 7f5955ffb700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f594408cb40 0x7f594408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.125+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f59500b1a10 con 0x7f59580645d0 2023-11-06T13:27:47.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.125+0000 7f595d3f0700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f594408cb40 0x7f594408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.126+0000 7f595d3f0700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f594408cb40 0x7f594408f000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f594c009130 tx=0x7f594c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.129+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5950082060 con 0x7f59580645d0 2023-11-06T13:27:47.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.305+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f595817cae0 con 0x7f59580645d0 2023-11-06T13:27:47.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.306+0000 7f5955ffb700 1 -- 172.21.15.38:0/1808813639 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f5950011e60 con 0x7f59580645d0 2023-11-06T13:27:47.309 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:47.309 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f594408cb40 msgr2=0x7f594408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f594408cb40 0x7f594408f000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f594c009130 tx=0x7f594c015000).stop 2023-11-06T13:27:47.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 msgr2=0x7f5958150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f5958150320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f595000d860 tx=0x7f5950008040).stop 2023-11-06T13:27:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 shutdown_connections 2023-11-06T13:27:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f594408cb40 0x7f594408f000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f595817e350 0x7f59580c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f59580645d0 0x7f5958150320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 --2- 172.21.15.38:0/1808813639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f59581756e0 0x7f59580c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 >> 172.21.15.38:0/1808813639 conn(0x7f5958069ea0 msgr2=0x7f595817f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 shutdown_connections 2023-11-06T13:27:47.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.308+0000 7f595fe55700 1 -- 172.21.15.38:0/1808813639 wait complete. 2023-11-06T13:27:47.337 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:27:47.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.452+0000 7f6b4a12c700 1 Processor -- start 2023-11-06T13:27:47.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.452+0000 7f6b4a12c700 1 -- start start 2023-11-06T13:27:47.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.453+0000 7f6b4a12c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6b440647f0 0x7f6b4417de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b4a12c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6b4417e350 0x7f6b44185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b4a12c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4417d9d0 con 0x7f6b441756e0 2023-11-06T13:27:47.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b4a12c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b440c8560 con 0x7f6b440647f0 2023-11-06T13:27:47.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b4a12c700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4417c800 con 0x7f6b4417e350 2023-11-06T13:27:47.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6b440647f0 0x7f6b4417de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b437fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6b441756e0 0x7f6b440640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42622/0 (socket says 172.21.15.38:42622) 2023-11-06T13:27:47.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6b440647f0 0x7f6b4417de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35234/0 (socket says 172.21.15.38:35234) 2023-11-06T13:27:47.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b437fe700 1 -- 172.21.15.38:0/4041163473 learned_addr learned my addr 172.21.15.38:0/4041163473 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:47.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b43fff700 1 --2- 172.21.15.38:0/4041163473 >> v2:172.21.15.163:3300/0 conn(0x7f6b4417e350 0x7f6b44185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 -- 172.21.15.38:0/4041163473 >> v2:172.21.15.163:3300/0 conn(0x7f6b4417e350 msgr2=0x7f6b44185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 --2- 172.21.15.38:0/4041163473 >> v2:172.21.15.163:3300/0 conn(0x7f6b4417e350 0x7f6b44185580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 -- 172.21.15.38:0/4041163473 >> v1:172.21.15.38:6789/0 conn(0x7f6b441756e0 legacy=0x7f6b440640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b427fc700 1 -- 172.21.15.38:0/4041163473 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632939902 0 0) 0x7f6b4417d9d0 con 0x7f6b441756e0 2023-11-06T13:27:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 -- 172.21.15.38:0/4041163473 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4417cae0 con 0x7f6b440647f0 2023-11-06T13:27:47.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b43fff700 1 --2- 172.21.15.38:0/4041163473 >> v2:172.21.15.163:3300/0 conn(0x7f6b4417e350 0x7f6b44185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:47.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b42ffd700 1 --2- 172.21.15.38:0/4041163473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b440647f0 0x7f6b4417de60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6b44062d40 tx=0x7f6b38009060).ready entity=mon.0 client_cookie=60559f3429394c17 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b427fc700 1 -- 172.21.15.38:0/4041163473 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800b580 con 0x7f6b440647f0 2023-11-06T13:27:47.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b427fc700 1 -- 172.21.15.38:0/4041163473 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800b6e0 con 0x7f6b440647f0 2023-11-06T13:27:47.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.454+0000 7f6b427fc700 1 -- 172.21.15.38:0/4041163473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800ba60 con 0x7f6b440647f0 2023-11-06T13:27:47.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 -- 172.21.15.38:0/4041163473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b440647f0 msgr2=0x7f6b4417de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/4041163473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b440647f0 0x7f6b4417de60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6b44062d40 tx=0x7f6b38009060).stop 2023-11-06T13:27:47.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 -- 172.21.15.38:0/4041163473 shutdown_connections 2023-11-06T13:27:47.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/4041163473 >> v2:172.21.15.163:3300/0 conn(0x7f6b4417e350 0x7f6b44185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/4041163473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b440647f0 0x7f6b4417de60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 -- 172.21.15.38:0/4041163473 >> 172.21.15.38:0/4041163473 conn(0x7f6b44069ea0 msgr2=0x7f6b4406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 -- 172.21.15.38:0/4041163473 shutdown_connections 2023-11-06T13:27:47.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.455+0000 7f6b4a12c700 1 -- 172.21.15.38:0/4041163473 wait complete. 2023-11-06T13:27:47.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.457+0000 7f6b4a12c700 1 Processor -- start 2023-11-06T13:27:47.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.457+0000 7f6b4a12c700 1 -- start start 2023-11-06T13:27:47.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b440647f0 0x7f6b44179280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b441756e0 0x7f6b44179770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 0x7f6b4418f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4417a940 con 0x7f6b4417e350 2023-11-06T13:27:47.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b440f35c0 con 0x7f6b440647f0 2023-11-06T13:27:47.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44179dc0 con 0x7f6b441756e0 2023-11-06T13:27:47.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 0x7f6b4418f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 0x7f6b4418f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35236/0 (socket says 172.21.15.38:35236) 2023-11-06T13:27:47.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 -- 172.21.15.38:0/3752310886 learned_addr learned my addr 172.21.15.38:0/3752310886 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:47.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b42ffd700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b441756e0 0x7f6b44179770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b437fe700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b440647f0 0x7f6b44179280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 -- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b441756e0 msgr2=0x7f6b44179770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b441756e0 0x7f6b44179770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 -- 172.21.15.38:0/3752310886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b440647f0 msgr2=0x7f6b44179280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b440647f0 0x7f6b44179280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 -- 172.21.15.38:0/3752310886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b380092a0 con 0x7f6b4417e350 2023-11-06T13:27:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b42ffd700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b441756e0 0x7f6b44179770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b43fff700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 0x7f6b4418f530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6b3c00a380 tx=0x7f6b3c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c016470 con 0x7f6b4417e350 2023-11-06T13:27:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c0165d0 con 0x7f6b4417e350 2023-11-06T13:27:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c016970 con 0x7f6b4417e350 2023-11-06T13:27:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4417a0a0 con 0x7f6b4417e350 2023-11-06T13:27:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.458+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4417a660 con 0x7f6b4417e350 2023-11-06T13:27:47.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.459+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b440f3770 con 0x7f6b4417e350 2023-11-06T13:27:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.460+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f6b3c013070 con 0x7f6b4417e350 2023-11-06T13:27:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.461+0000 7f6b2b7fe700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6b3008cb10 0x7f6b3008efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.461+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6b3c0b2950 con 0x7f6b4417e350 2023-11-06T13:27:47.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.461+0000 7f6b437fe700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6b3008cb10 0x7f6b3008efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.462+0000 7f6b437fe700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6b3008cb10 0x7f6b3008efd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6b340011e0 tx=0x7f6b34009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.465+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6b440f3770 con 0x7f6b4417e350 2023-11-06T13:27:47.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.681+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b440f3770 con 0x7f6b4417e350 2023-11-06T13:27:47.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.681+0000 7f6b2b7fe700 1 -- 172.21.15.38:0/3752310886 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+10536 (secure 0 0 0) 0x7f6b440f3770 con 0x7f6b4417e350 2023-11-06T13:27:47.685 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:47.685 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4312,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4323,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4326,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4349,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4352,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4355,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:46.299276+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-11-06T13:27:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6b3008cb10 msgr2=0x7f6b3008efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6b3008cb10 0x7f6b3008efd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6b340011e0 tx=0x7f6b34009040).stop 2023-11-06T13:27:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 msgr2=0x7f6b4418f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 0x7f6b4418f530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6b3c00a380 tx=0x7f6b3c007900).stop 2023-11-06T13:27:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 shutdown_connections 2023-11-06T13:27:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6b4417e350 0x7f6b4418f530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6b3008cb10 0x7f6b3008efd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b440647f0 0x7f6b44179280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 --2- 172.21.15.38:0/3752310886 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6b441756e0 0x7f6b44179770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 >> 172.21.15.38:0/3752310886 conn(0x7f6b44069ea0 msgr2=0x7f6b440ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 shutdown_connections 2023-11-06T13:27:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.683+0000 7f6b4a12c700 1 -- 172.21.15.38:0/3752310886 wait complete. 2023-11-06T13:27:47.689 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 6 2023-11-06T13:27:47.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:47.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.814+0000 7f62f792c700 1 Processor -- start 2023-11-06T13:27:47.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.814+0000 7f62f792c700 1 -- start start 2023-11-06T13:27:47.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f792c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62f01756e0 0x7f62f00640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f792c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62f00645d0 0x7f62f017de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f792c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f017d9d0 con 0x7f62f017e350 2023-11-06T13:27:47.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f792c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f00c8560 con 0x7f62f01756e0 2023-11-06T13:27:47.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f792c700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f0064a50 con 0x7f62f00645d0 2023-11-06T13:27:47.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62f01756e0 0x7f62f00640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f62f01756e0 0x7f62f00640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35246/0 (socket says 172.21.15.38:35246) 2023-11-06T13:27:47.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 -- 172.21.15.38:0/4259726332 learned_addr learned my addr 172.21.15.38:0/4259726332 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:47.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f4ec7700 1 --2- 172.21.15.38:0/4259726332 >> v2:172.21.15.44:3300/0 conn(0x7f62f00645d0 0x7f62f017de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 -- 172.21.15.38:0/4259726332 >> v2:172.21.15.44:3300/0 conn(0x7f62f00645d0 msgr2=0x7f62f017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:47.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 --2- 172.21.15.38:0/4259726332 >> v2:172.21.15.44:3300/0 conn(0x7f62f00645d0 0x7f62f017de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 -- 172.21.15.38:0/4259726332 >> v1:172.21.15.163:6789/0 conn(0x7f62f017e350 legacy=0x7f62f00f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:47.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 -- 172.21.15.38:0/4259726332 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f017c800 con 0x7f62f01756e0 2023-11-06T13:27:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62f56c8700 1 --2- 172.21.15.38:0/4259726332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f00640e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f62f00cab80 tx=0x7f62e0009840).ready entity=mon.0 client_cookie=78a29f7f16a1dbb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62effff700 1 -- 172.21.15.38:0/4259726332 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000e070 con 0x7f62f01756e0 2023-11-06T13:27:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62effff700 1 -- 172.21.15.38:0/4259726332 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000ba10 con 0x7f62f01756e0 2023-11-06T13:27:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.816+0000 7f62effff700 1 -- 172.21.15.38:0/4259726332 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000bd90 con 0x7f62f01756e0 2023-11-06T13:27:47.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 -- 172.21.15.38:0/4259726332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 msgr2=0x7f62f00640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 --2- 172.21.15.38:0/4259726332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f00640e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f62f00cab80 tx=0x7f62e0009840).stop 2023-11-06T13:27:47.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 -- 172.21.15.38:0/4259726332 shutdown_connections 2023-11-06T13:27:47.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 --2- 172.21.15.38:0/4259726332 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f00640e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 --2- 172.21.15.38:0/4259726332 >> v2:172.21.15.44:3300/0 conn(0x7f62f00645d0 0x7f62f017de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 -- 172.21.15.38:0/4259726332 >> 172.21.15.38:0/4259726332 conn(0x7f62f0069ea0 msgr2=0x7f62f006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:47.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 -- 172.21.15.38:0/4259726332 shutdown_connections 2023-11-06T13:27:47.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.817+0000 7f62f792c700 1 -- 172.21.15.38:0/4259726332 wait complete. 2023-11-06T13:27:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.818+0000 7f62f792c700 1 Processor -- start 2023-11-06T13:27:47.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.818+0000 7f62f792c700 1 -- start start 2023-11-06T13:27:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.819+0000 7f62f792c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62f00645d0 0x7f62f016eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.819+0000 7f62f792c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f018d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.819+0000 7f62f792c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f017e350 0x7f62f018d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.819+0000 7f62f792c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00c69e0 con 0x7f62f01756e0 2023-11-06T13:27:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.819+0000 7f62f792c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00c6140 con 0x7f62f017e350 2023-11-06T13:27:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.819+0000 7f62f792c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00c6420 con 0x7f62f00645d0 2023-11-06T13:27:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f018d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f018d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35254/0 (socket says 172.21.15.38:35254) 2023-11-06T13:27:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 -- 172.21.15.38:0/567558080 learned_addr learned my addr 172.21.15.38:0/567558080 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:47.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f56c8700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62f00645d0 0x7f62f016eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f5ec9700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f017e350 0x7f62f018d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 -- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62f00645d0 msgr2=0x7f62f016eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62f00645d0 0x7f62f016eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 -- 172.21.15.38:0/567558080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f017e350 msgr2=0x7f62f018d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f017e350 0x7f62f018d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 -- 172.21.15.38:0/567558080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0009ae0 con 0x7f62f01756e0 2023-11-06T13:27:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f56c8700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62f00645d0 0x7f62f016eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f4ec7700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f018d3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f62e400d860 tx=0x7f62e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4011590 con 0x7f62f01756e0 2023-11-06T13:27:47.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40116f0 con 0x7f62f01756e0 2023-11-06T13:27:47.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f00c6700 con 0x7f62f01756e0 2023-11-06T13:27:47.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4011a70 con 0x7f62f01756e0 2023-11-06T13:27:47.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.820+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f018ce80 con 0x7f62f01756e0 2023-11-06T13:27:47.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.821+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f006c580 con 0x7f62f01756e0 2023-11-06T13:27:47.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.822+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f62e4012420 con 0x7f62f01756e0 2023-11-06T13:27:47.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.823+0000 7f62ed7fa700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f62dc08cb40 0x7f62dc08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:47.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.823+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f62e40b1a60 con 0x7f62f01756e0 2023-11-06T13:27:47.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.823+0000 7f62f56c8700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f62dc08cb40 0x7f62dc08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:47.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.823+0000 7f62f56c8700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f62dc08cb40 0x7f62dc08f000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f62e0009540 tx=0x7f62e0009840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:47.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:47.827+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f62e4082030 con 0x7f62f01756e0 2023-11-06T13:27:48.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.000+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62f017cae0 con 0x7f62f01756e0 2023-11-06T13:27:48.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.001+0000 7f62ed7fa700 1 -- 172.21.15.38:0/567558080 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f62e4011e60 con 0x7f62f01756e0 2023-11-06T13:27:48.005 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:48.005 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f62dc08cb40 msgr2=0x7f62dc08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f62dc08cb40 0x7f62dc08f000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f62e0009540 tx=0x7f62e0009840).stop 2023-11-06T13:27:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 msgr2=0x7f62f018d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:48.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f018d3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f62e400d860 tx=0x7f62e4008040).stop 2023-11-06T13:27:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 shutdown_connections 2023-11-06T13:27:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f62dc08cb40 0x7f62dc08f000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62f017e350 0x7f62f018d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62f00645d0 0x7f62f016eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:48.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 --2- 172.21.15.38:0/567558080 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f62f01756e0 0x7f62f018d3a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 >> 172.21.15.38:0/567558080 conn(0x7f62f0069ea0 msgr2=0x7f62f00f56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 shutdown_connections 2023-11-06T13:27:48.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:48.003+0000 7f62f792c700 1 -- 172.21.15.38:0/567558080 wait complete. 2023-11-06T13:27:49.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-06T13:27:41.889379+0000', 'modified': '2023-11-06T13:27:46.299276+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4361': {'gid': 4361, 'name': 'l', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6841/2794564975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6840', 'nonce': 2794564975}, {'type': 'v1', 'addr': '172.21.15.163:6841', 'nonce': 2794564975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-11-06T13:27:49.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-06T13:27:49.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-11-06T13:27:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.360+0000 7fa5b994e700 1 Processor -- start 2023-11-06T13:27:49.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.360+0000 7fa5b994e700 1 -- start start 2023-11-06T13:27:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b994e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa5b4183120 0x7fa5b40cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b994e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b4068dc0 con 0x7fa5b40cb530 2023-11-06T13:27:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b994e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b4181460 con 0x7fa5b40cac60 2023-11-06T13:27:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b994e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b4181720 con 0x7fa5b4183120 2023-11-06T13:27:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b37fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fa5b40cb530 0x7fa5b4069250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42636/0 (socket says 172.21.15.38:42636) 2023-11-06T13:27:49.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b37fe700 1 -- 172.21.15.38:0/691511105 learned_addr learned my addr 172.21.15.38:0/691511105 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/691511105 >> v2:172.21.15.163:3300/0 conn(0x7fa5b4183120 0x7fa5b40cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137073929 0 0) 0x7fa5b4068dc0 con 0x7fa5b40cb530 2023-11-06T13:27:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a00033f0 con 0x7fa5b40cb530 2023-11-06T13:27:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856127675 0 0) 0x7fa5a00033f0 con 0x7fa5b40cb530 2023-11-06T13:27:49.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 >> v2:172.21.15.163:3300/0 conn(0x7fa5b4183120 msgr2=0x7fa5b40cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 --2- 172.21.15.38:0/691511105 >> v2:172.21.15.163:3300/0 conn(0x7fa5b4183120 0x7fa5b40cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 >> v1:172.21.15.163:6789/0 conn(0x7fa5b40cac60 legacy=0x7fa5b4182a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4181a00 con 0x7fa5b40cb530 2023-11-06T13:27:49.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7fa5ac0017f0 con 0x7fa5b40cb530 2023-11-06T13:27:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 >> v1:172.21.15.38:6789/0 conn(0x7fa5b40cb530 legacy=0x7fa5b4069250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0003930 0x7fa5a0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0004690 0x7fa5a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4181720 con 0x7fa5a0005000 2023-11-06T13:27:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000bf30 con 0x7fa5a0003930 2023-11-06T13:27:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.362+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000c0f0 con 0x7fa5a0004690 2023-11-06T13:27:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0004690 0x7fa5a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 -- 172.21.15.38:0/691511105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0004690 msgr2=0x7fa5a0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5a0004690 0x7fa5a0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 -- 172.21.15.38:0/691511105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0003930 msgr2=0x7fa5a0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0003930 0x7fa5a0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 -- 172.21.15.38:0/691511105 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00033f0 con 0x7fa5a0005000 2023-11-06T13:27:49.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 -- 172.21.15.38:0/691511105 reap_dead start 2023-11-06T13:27:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa5ac00c480 tx=0x7fa5ac00c790).ready entity=mon.0 client_cookie=a89384b0378d24fb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac002030 con 0x7fa5a0005000 2023-11-06T13:27:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00ce20 con 0x7fa5a0005000 2023-11-06T13:27:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.363+0000 7fa5b1ffb700 1 -- 172.21.15.38:0/691511105 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac005d30 con 0x7fa5a0005000 2023-11-06T13:27:49.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 -- 172.21.15.38:0/691511105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5a0005000 msgr2=0x7fa5a000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fa5ac00c480 tx=0x7fa5ac00c790).stop 2023-11-06T13:27:49.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 -- 172.21.15.38:0/691511105 shutdown_connections 2023-11-06T13:27:49.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 --2- 172.21.15.38:0/691511105 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5a0005000 0x7fa5a000b8e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 -- 172.21.15.38:0/691511105 >> 172.21.15.38:0/691511105 conn(0x7fa5b40f3cf0 msgr2=0x7fa5b40efc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 -- 172.21.15.38:0/691511105 shutdown_connections 2023-11-06T13:27:49.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.364+0000 7fa5b994e700 1 -- 172.21.15.38:0/691511105 wait complete. 2023-11-06T13:27:49.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.365+0000 7fa5b994e700 1 Processor -- start 2023-11-06T13:27:49.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.365+0000 7fa5b994e700 1 -- start start 2023-11-06T13:27:49.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b994e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0005000 0x7fa5b41663c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b994e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b41668b0 0x7fa5b416d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b994e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 0x7fa5b4168e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b994e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b416eca0 con 0x7fa5b416de20 2023-11-06T13:27:49.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b994e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4168120 con 0x7fa5a0005000 2023-11-06T13:27:49.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b994e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b416e6e0 con 0x7fa5b41668b0 2023-11-06T13:27:49.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 0x7fa5b4168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 0x7fa5b4168e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35280/0 (socket says 172.21.15.38:35280) 2023-11-06T13:27:49.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.366+0000 7fa5b37fe700 1 -- 172.21.15.38:0/1271192550 learned_addr learned my addr 172.21.15.38:0/1271192550 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0005000 0x7fa5b41663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b41668b0 0x7fa5b416d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b37fe700 1 -- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b41668b0 msgr2=0x7fa5b416d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b41668b0 0x7fa5b416d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b37fe700 1 -- 172.21.15.38:0/1271192550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0005000 msgr2=0x7fa5b41663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0005000 0x7fa5b41663c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b37fe700 1 -- 172.21.15.38:0/1271192550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b416e9c0 con 0x7fa5b416de20 2023-11-06T13:27:49.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0005000 0x7fa5b41663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:49.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b41668b0 0x7fa5b416d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:49.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 0x7fa5b4168e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa5b4087390 tx=0x7fa5ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5aaffd700 1 -- 172.21.15.38:0/1271192550 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac002030 con 0x7fa5b416de20 2023-11-06T13:27:49.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5aaffd700 1 -- 172.21.15.38:0/1271192550 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac005e40 con 0x7fa5b416de20 2023-11-06T13:27:49.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5aaffd700 1 -- 172.21.15.38:0/1271192550 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0136a0 con 0x7fa5b416de20 2023-11-06T13:27:49.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b4168350 con 0x7fa5b416de20 2023-11-06T13:27:49.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.367+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b4168910 con 0x7fa5b416de20 2023-11-06T13:27:49.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.369+0000 7fa5aaffd700 1 -- 172.21.15.38:0/1271192550 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fa5ac013a10 con 0x7fa5b416de20 2023-11-06T13:27:49.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.370+0000 7fa5aaffd700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa59408cb10 0x7fa59408efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.370+0000 7fa5aaffd700 1 -- 172.21.15.38:0/1271192550 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa5ac0b3210 con 0x7fa5b416de20 2023-11-06T13:27:49.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.370+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa59408cb10 0x7fa59408efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.370+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa59408cb10 0x7fa59408efd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa5a4000c00 tx=0x7fa5a4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.371+0000 7fa5cb2e6b80 1 Processor -- start 2023-11-06T13:27:49.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.371+0000 7fa5cb2e6b80 1 -- start start 2023-11-06T13:27:49.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x5598136ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x559813669bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981362ff80 con 0x55981366a0c0 2023-11-06T13:27:49.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598135a71f0 con 0x5598136ad8a0 2023-11-06T13:27:49.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598135bc440 con 0x559813426e40 2023-11-06T13:27:49.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35286/0 (socket says 172.21.15.38:35286) 2023-11-06T13:27:49.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.372+0000 7fa5b37fe700 1 -- 172.21.15.38:0/2509966378 learned_addr learned my addr 172.21.15.38:0/2509966378 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x559813669bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x5598136ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b37fe700 1 -- 172.21.15.38:0/2509966378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 msgr2=0x5598136ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x5598136ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b37fe700 1 -- 172.21.15.38:0/2509966378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 msgr2=0x559813669bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x559813669bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b37fe700 1 -- 172.21.15.38:0/2509966378 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598135b5620 con 0x55981366a0c0 2023-11-06T13:27:49.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x559813669bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:49.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x5598136ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:49.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136aabb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fa5ac0839d0 tx=0x7fa5ac0b0dc0).ready entity=mon.0 client_cookie=55582a8f49451a1f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa593fff700 1 -- 172.21.15.38:0/2509966378 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac086ec0 con 0x55981366a0c0 2023-11-06T13:27:49.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa593fff700 1 -- 172.21.15.38:0/2509966378 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac087560 con 0x55981366a0c0 2023-11-06T13:27:49.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.373+0000 7fa593fff700 1 -- 172.21.15.38:0/2509966378 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0b3030 con 0x55981366a0c0 2023-11-06T13:27:49.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/2509966378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 msgr2=0x5598136aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136aabb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fa5ac0839d0 tx=0x7fa5ac0b0dc0).stop 2023-11-06T13:27:49.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/2509966378 shutdown_connections 2023-11-06T13:27:49.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136aabb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x5598136ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/2509966378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x559813669bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/2509966378 >> 172.21.15.38:0/2509966378 conn(0x5598134d44a0 msgr2=0x55981366ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/2509966378 shutdown_connections 2023-11-06T13:27:49.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.374+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/2509966378 wait complete. 2023-11-06T13:27:49.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.375+0000 7fa5cb2e6b80 1 -- start start 2023-11-06T13:27:49.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.375+0000 7fa5cb2e6b80 1 Processor -- start 2023-11-06T13:27:49.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559813426e40 0x5598136ebe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55981366a0c0 0x5598136eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x5598136ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598135bc580 con 0x5598136ad8a0 2023-11-06T13:27:49.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598135bc800 con 0x559813426e40 2023-11-06T13:27:49.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559813587e10 con 0x55981366a0c0 2023-11-06T13:27:49.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5cb2e6b80 10 client.0 ll_register_callbacks cb 0x55981362a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:27:49.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x5598136ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x5598136ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35298/0 (socket says 172.21.15.38:35298) 2023-11-06T13:27:49.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3035061686 learned_addr learned my addr 172.21.15.38:0/3035061686 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55981366a0c0 0x5598136eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559813426e40 0x5598136ebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55981366a0c0 msgr2=0x5598136eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55981366a0c0 0x5598136eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3035061686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559813426e40 msgr2=0x5598136ebe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559813426e40 0x5598136ebe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.376+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3035061686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b4168910 con 0x5598136ad8a0 2023-11-06T13:27:49.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x5598136ec6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa5ac00c7d0 tx=0x7fa5ac08a000).ready entity=mon.0 client_cookie=7d3a03f9e2cfdcf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5917fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:27:49.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5917fa700 1 -- 172.21.15.38:0/3035061686 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0b3030 con 0x5598136ad8a0 2023-11-06T13:27:49.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55981365e640 con 0x5598136ad8a0 2023-11-06T13:27:49.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5917fa700 1 -- 172.21.15.38:0/3035061686 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa5ac08ce40 con 0x5598136ad8a0 2023-11-06T13:27:49.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5917fa700 1 -- 172.21.15.38:0/3035061686 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5ac086c60 con 0x5598136ad8a0 2023-11-06T13:27:49.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 10 client.4494 fetch_fsmap learned FSMap version 6 2023-11-06T13:27:49.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5598135b09c0 con 0x5598136ad8a0 2023-11-06T13:27:49.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5917fa700 1 -- 172.21.15.38:0/3035061686 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55981365e640 con 0x5598136ad8a0 2023-11-06T13:27:49.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5917fa700 1 -- 172.21.15.38:0/3035061686 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 6) v1 ==== 7468+0+0 (secure 0 0 0) 0x7fa5ac08c9b0 con 0x5598136ad8a0 2023-11-06T13:27:49.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 10 client.4494 fetch_fsmap finished waiting for FSMap version 6 2023-11-06T13:27:49.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 10 client.4494 resolve_mds: resolved name 'l' to daemon mds.l 2023-11-06T13:27:49.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 20 client.4494 populate_metadata read hostname 'smithi038' 2023-11-06T13:27:49.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5598136699e0 0x559813699a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 4 client.4494 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:27:49.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559813422ca0 con 0x5598136699e0 2023-11-06T13:27:49.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.377+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5598136699e0 0x559813699a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.378+0000 7fa5917fa700 10 client.4494 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:27:49.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.378+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5598136699e0 0x559813699a20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=47e30c1df6d62b02 server_cookie=3724b07736e8e4e8 in_seq=0 out_seq=0 2023-11-06T13:27:49.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.378+0000 7fa5917fa700 1 -- 172.21.15.38:0/3035061686 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x559813422ca0 con 0x5598136699e0 2023-11-06T13:27:49.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.378+0000 7fa5917fa700 10 client.4494 handle_command_reply: tid=0 2023-11-06T13:27:49.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 client.4494 shutdown 2023-11-06T13:27:49.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 msgr2=0x5598136ec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x5598136ec6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa5ac00c7d0 tx=0x7fa5ac08a000).stop 2023-11-06T13:27:49.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 shutdown_connections 2023-11-06T13:27:49.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x5598136ec6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559813426e40 0x5598136ebe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5598136699e0 0x559813699a20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3035061686 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55981366a0c0 0x5598136eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 >> 172.21.15.38:0/3035061686 conn(0x5598134d44a0 msgr2=0x559813671b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5917fa700 0 client.4494 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:27:49.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 shutdown_connections 2023-11-06T13:27:49.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3035061686 wait complete. 2023-11-06T13:27:49.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.379+0000 7fa5cb2e6b80 20 client.4494 trim_cache size 0 max 16384 2023-11-06T13:27:49.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.396+0000 7fa5cb2e6b80 1 Processor -- start 2023-11-06T13:27:49.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.396+0000 7fa5cb2e6b80 1 -- start start 2023-11-06T13:27:49.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813699a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x5598137322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40628c0 con 0x55981366a0c0 2023-11-06T13:27:49.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598136f0ce0 con 0x5598136ad8a0 2023-11-06T13:27:49.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598136eb590 con 0x559813426e40 2023-11-06T13:27:49.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35310/0 (socket says 172.21.15.38:35310) 2023-11-06T13:27:49.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 -- 172.21.15.38:0/1173678360 learned_addr learned my addr 172.21.15.38:0/1173678360 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 -- 172.21.15.38:0/1173678360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 msgr2=0x559813699a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813699a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813699a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 -- 172.21.15.38:0/1173678360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 msgr2=0x5598137322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x5598137322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x5598137322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 -- 172.21.15.38:0/1173678360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55981365e260 con 0x55981366a0c0 2023-11-06T13:27:49.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136b15b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa59c009bb0 tx=0x7fa59c008040).ready entity=mon.0 client_cookie=edee1aba9e84ef9a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.397+0000 7fa5a8ff9700 1 -- 172.21.15.38:0/1173678360 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c009690 con 0x55981366a0c0 2023-11-06T13:27:49.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5a8ff9700 1 -- 172.21.15.38:0/1173678360 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c017be0 con 0x55981366a0c0 2023-11-06T13:27:49.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5a8ff9700 1 -- 172.21.15.38:0/1173678360 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c018450 con 0x55981366a0c0 2023-11-06T13:27:49.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/1173678360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 msgr2=0x5598136b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136b15b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa59c009bb0 tx=0x7fa59c008040).stop 2023-11-06T13:27:49.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/1173678360 shutdown_connections 2023-11-06T13:27:49.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598136ad8a0 0x5598137322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813699a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/1173678360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55981366a0c0 0x5598136b15b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/1173678360 >> 172.21.15.38:0/1173678360 conn(0x5598134d44a0 msgr2=0x5598136acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/1173678360 shutdown_connections 2023-11-06T13:27:49.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.398+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/1173678360 wait complete. 2023-11-06T13:27:49.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.399+0000 7fa5cb2e6b80 1 -- start start 2023-11-06T13:27:49.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.399+0000 7fa5cb2e6b80 1 Processor -- start 2023-11-06T13:27:49.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813742420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55981366a0c0 0x5598136a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x559813695550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598136aeeb0 con 0x5598136ad8a0 2023-11-06T13:27:49.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598136ec170 con 0x55981366a0c0 2023-11-06T13:27:49.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559813741f90 con 0x559813426e40 2023-11-06T13:27:49.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5cb2e6b80 10 client.0 ll_register_callbacks cb 0x55981362a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:27:49.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x559813695550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x559813695550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35312/0 (socket says 172.21.15.38:35312) 2023-11-06T13:27:49.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3351556897 learned_addr learned my addr 172.21.15.38:0/3351556897 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813742420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b27fc700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55981366a0c0 0x5598136a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 msgr2=0x559813742420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813742420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3351556897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55981366a0c0 msgr2=0x5598136a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55981366a0c0 0x5598136a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.400+0000 7fa5b37fe700 1 -- 172.21.15.38:0/3351556897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c009880 con 0x5598136ad8a0 2023-11-06T13:27:49.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5b37fe700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x559813695550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa5ac0b0fd0 tx=0x7fa5ac056040).ready entity=mon.0 client_cookie=82956342b0fc0a36 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5917fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:27:49.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5917fa700 1 -- 172.21.15.38:0/3351556897 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac086ec0 con 0x5598136ad8a0 2023-11-06T13:27:49.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5917fa700 1 -- 172.21.15.38:0/3351556897 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa5ac08ce40 con 0x5598136ad8a0 2023-11-06T13:27:49.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5ac087560 con 0x5598136ad8a0 2023-11-06T13:27:49.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5917fa700 1 -- 172.21.15.38:0/3351556897 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5ac0b3030 con 0x5598136ad8a0 2023-11-06T13:27:49.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 10 client.4500 fetch_fsmap learned FSMap version 6 2023-11-06T13:27:49.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x5598135b0710 con 0x5598136ad8a0 2023-11-06T13:27:49.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5917fa700 1 -- 172.21.15.38:0/3351556897 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac087560 con 0x5598136ad8a0 2023-11-06T13:27:49.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5917fa700 1 -- 172.21.15.38:0/3351556897 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 6) v1 ==== 7468+0+0 (secure 0 0 0) 0x7fa5ac08b120 con 0x5598136ad8a0 2023-11-06T13:27:49.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 10 client.4500 fetch_fsmap finished waiting for FSMap version 6 2023-11-06T13:27:49.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 10 client.4500 resolve_mds: resolved name 'l' to daemon mds.l 2023-11-06T13:27:49.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 20 client.4500 populate_metadata read hostname 'smithi038' 2023-11-06T13:27:49.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55981369da30 0x55981369de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 4 client.4500 mds_command: new command op to 4361 tid=0[{"prefix": "status"}] 2023-11-06T13:27:49.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559813459ca0 con 0x55981369da30 2023-11-06T13:27:49.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.401+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55981369da30 0x55981369de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5b2ffd700 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55981369da30 0x55981369de10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1a323d29c7d288aa server_cookie=6478b1674dacac13 in_seq=0 out_seq=0 2023-11-06T13:27:49.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5917fa700 10 client.4500 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:27:49.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5917fa700 1 -- 172.21.15.38:0/3351556897 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x559813459ca0 con 0x55981369da30 2023-11-06T13:27:49.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5917fa700 10 client.4500 handle_command_reply: tid=0 2023-11-06T13:27:49.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 client.4500 shutdown 2023-11-06T13:27:49.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 msgr2=0x559813695550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x559813695550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa5ac0b0fd0 tx=0x7fa5ac056040).stop 2023-11-06T13:27:49.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 shutdown_connections 2023-11-06T13:27:49.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5598136ad8a0 0x559813695550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55981369da30 0x55981369de10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559813426e40 0x559813742420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5917fa700 0 client.4500 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:27:49.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 --2- 172.21.15.38:0/3351556897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55981366a0c0 0x5598136a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 >> 172.21.15.38:0/3351556897 conn(0x5598134d44a0 msgr2=0x559813671a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 shutdown_connections 2023-11-06T13:27:49.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 1 -- 172.21.15.38:0/3351556897 wait complete. 2023-11-06T13:27:49.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.402+0000 7fa5cb2e6b80 20 client.4500 trim_cache size 0 max 16384 2023-11-06T13:27:49.436 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:27:49.436 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "678c2a34-c65e-414a-9c54-b10698be691f", 2023-11-06T13:27:49.436 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-11-06T13:27:49.437 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4361, 2023-11-06T13:27:49.437 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-11-06T13:27:49.437 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-11-06T13:27:49.437 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-11-06T13:27:49.437 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 7.510933885, 2023-11-06T13:27:49.438 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 6, 2023-11-06T13:27:49.438 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-11-06T13:27:49.438 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 30, 2023-11-06T13:27:49.438 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 11.915771652 2023-11-06T13:27:49.438 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:27:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa59408cb10 msgr2=0x7fa59408efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa59408cb10 0x7fa59408efd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa5a4000c00 tx=0x7fa5a4009040).stop 2023-11-06T13:27:49.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 msgr2=0x7fa5b4168e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 0x7fa5b4168e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa5b4087390 tx=0x7fa5ac015000).stop 2023-11-06T13:27:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 shutdown_connections 2023-11-06T13:27:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa5b416de20 0x7fa5b4168e30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa59408cb10 0x7fa59408efd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5a0005000 0x7fa5b41663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 --2- 172.21.15.38:0/1271192550 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa5b41668b0 0x7fa5b416d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 >> 172.21.15.38:0/1271192550 conn(0x7fa5b40f3cf0 msgr2=0x7fa5b4183eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 shutdown_connections 2023-11-06T13:27:49.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.403+0000 7fa5b994e700 1 -- 172.21.15.38:0/1271192550 wait complete. 2023-11-06T13:27:49.443 DEBUG:teuthology.orchestra.run.smithi038:> ceph fs ls 2023-11-06T13:27:49.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.548+0000 7f5d2fbe9700 1 Processor -- start 2023-11-06T13:27:49.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.548+0000 7f5d2fbe9700 1 -- start start 2023-11-06T13:27:49.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2fbe9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d28178db0 0x7f5d28062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2fbe9700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5d28064250 0x7f5d280efd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2fbe9700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d28063dc0 con 0x7f5d281789d0 2023-11-06T13:27:49.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2fbe9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d28179230 con 0x7f5d28178db0 2023-11-06T13:27:49.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2fbe9700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d28062c60 con 0x7f5d28064250 2023-11-06T13:27:49.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2d184700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d28178db0 0x7f5d28062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2d184700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d28178db0 0x7f5d28062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:33388/0 (socket says 172.21.15.38:33388) 2023-11-06T13:27:49.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.549+0000 7f5d2d184700 1 -- 172.21.15.38:0/2827696645 learned_addr learned my addr 172.21.15.38:0/2827696645 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2d184700 1 -- 172.21.15.38:0/2827696645 >> v2:172.21.15.163:3300/0 conn(0x7f5d28064250 msgr2=0x7f5d280efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2d184700 1 --2- 172.21.15.38:0/2827696645 >> v2:172.21.15.163:3300/0 conn(0x7f5d28064250 0x7f5d280efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:49.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2d184700 1 -- 172.21.15.38:0/2827696645 >> v1:172.21.15.163:6789/0 conn(0x7f5d281789d0 legacy=0x7f5d2817c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:49.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2d184700 1 -- 172.21.15.38:0/2827696645 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28062ed0 con 0x7f5d28178db0 2023-11-06T13:27:49.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2d184700 1 --2- 172.21.15.38:0/2827696645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28178db0 0x7f5d28062770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5d280caad0 tx=0x7f5d1c0090f0).ready entity=mon.1 client_cookie=84b8e0597840fa0e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2c983700 1 -- 172.21.15.38:0/2827696645 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00b5a0 con 0x7f5d28178db0 2023-11-06T13:27:49.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2c983700 1 -- 172.21.15.38:0/2827696645 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00b700 con 0x7f5d28178db0 2023-11-06T13:27:49.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2c983700 1 -- 172.21.15.38:0/2827696645 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00ba80 con 0x7f5d28178db0 2023-11-06T13:27:49.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2827696645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28178db0 msgr2=0x7f5d28062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2827696645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28178db0 0x7f5d28062770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5d280caad0 tx=0x7f5d1c0090f0).stop 2023-11-06T13:27:49.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2827696645 shutdown_connections 2023-11-06T13:27:49.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2827696645 >> v2:172.21.15.163:3300/0 conn(0x7f5d28064250 0x7f5d280efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:27:49.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.550+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2827696645 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28178db0 0x7f5d28062770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.551+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2827696645 >> 172.21.15.38:0/2827696645 conn(0x7f5d2806a940 msgr2=0x7f5d280f5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.551+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2827696645 shutdown_connections 2023-11-06T13:27:49.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.551+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2827696645 wait complete. 2023-11-06T13:27:49.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.552+0000 7f5d2fbe9700 1 Processor -- start 2023-11-06T13:27:49.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.552+0000 7f5d2fbe9700 1 -- start start 2023-11-06T13:27:49.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2fbe9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28064250 0x7f5d28169460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2fbe9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d281789d0 0x7f5d28169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2fbe9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 0x7f5d2816b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2fbe9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2816a5d0 con 0x7f5d28178db0 2023-11-06T13:27:49.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2fbe9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2816b150 con 0x7f5d28064250 2023-11-06T13:27:49.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2fbe9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28181490 con 0x7f5d281789d0 2023-11-06T13:27:49.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 0x7f5d2816b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 0x7f5d2816b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35322/0 (socket says 172.21.15.38:35322) 2023-11-06T13:27:49.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 -- 172.21.15.38:0/2632390261 learned_addr learned my addr 172.21.15.38:0/2632390261 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:49.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2d184700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d281789d0 0x7f5d28169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2d985700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28064250 0x7f5d28169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 -- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d281789d0 msgr2=0x7f5d28169950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d281789d0 0x7f5d28169950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 -- 172.21.15.38:0/2632390261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28064250 msgr2=0x7f5d28169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28064250 0x7f5d28169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.553+0000 7f5d2e186700 1 -- 172.21.15.38:0/2632390261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009370 con 0x7f5d28178db0 2023-11-06T13:27:49.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.554+0000 7f5d2e186700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 0x7f5d2816b5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f5d1800b7c0 tx=0x7f5d18009330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.554+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800d4a0 con 0x7f5d28178db0 2023-11-06T13:27:49.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.554+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800d620 con 0x7f5d28178db0 2023-11-06T13:27:49.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.554+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2816a820 con 0x7f5d28178db0 2023-11-06T13:27:49.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.554+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800d9e0 con 0x7f5d28178db0 2023-11-06T13:27:49.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.554+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2816ade0 con 0x7f5d28178db0 2023-11-06T13:27:49.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.555+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2816c2a0 con 0x7f5d28178db0 2023-11-06T13:27:49.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.556+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f5d18011400 con 0x7f5d28178db0 2023-11-06T13:27:49.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.556+0000 7f5d25ffb700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d1408cb10 0x7f5d1408efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:49.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.556+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f5d180b1820 con 0x7f5d28178db0 2023-11-06T13:27:49.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.556+0000 7f5d2d985700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d1408cb10 0x7f5d1408efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:49.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.557+0000 7f5d2d985700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d1408cb10 0x7f5d1408efd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5d2000b940 tx=0x7f5d20006ee0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:49.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.560+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5d2816c2a0 con 0x7f5d28178db0 2023-11-06T13:27:49.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.780+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5d2816c2a0 con 0x7f5d28178db0 2023-11-06T13:27:49.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.780+0000 7f5d25ffb700 1 -- 172.21.15.38:0/2632390261 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5d2816c2a0 con 0x7f5d28178db0 2023-11-06T13:27:49.784 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-06T13:27:49.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d1408cb10 msgr2=0x7f5d1408efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d1408cb10 0x7f5d1408efd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f5d2000b940 tx=0x7f5d20006ee0).stop 2023-11-06T13:27:49.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 msgr2=0x7f5d2816b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:49.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 0x7f5d2816b5e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f5d1800b7c0 tx=0x7f5d18009330).stop 2023-11-06T13:27:49.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 shutdown_connections 2023-11-06T13:27:49.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d28178db0 0x7f5d2816b5e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d1408cb10 0x7f5d1408efd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d28064250 0x7f5d28169460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 --2- 172.21.15.38:0/2632390261 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d281789d0 0x7f5d28169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:49.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 >> 172.21.15.38:0/2632390261 conn(0x7f5d2806a940 msgr2=0x7f5d2817d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:49.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 shutdown_connections 2023-11-06T13:27:49.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:49.782+0000 7f5d2fbe9700 1 -- 172.21.15.38:0/2632390261 wait complete. 2023-11-06T13:27:49.796 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-06T13:27:49.796 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-06T13:27:49.797 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-11-06T13:27:49.797 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-06T13:27:49.797 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:49.797 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-06T13:27:49.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-06T13:27:49.798 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-06T13:27:49.798 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-06T13:27:49.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:49.799 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-11-06T13:27:49.815 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-06T13:27:49.815 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-06T13:27:49.815 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-11-06T13:27:49.815 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-11-06T13:27:49.816 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-11-06T13:27:49.816 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-11-06T13:27:49.816 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-06T13:27:49.816 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-11-06T13:27:49.817 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-11-06T13:27:49.817 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-06T13:27:49.817 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-11-06T13:27:49.817 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-11-06T13:27:49.817 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-06T13:27:49.818 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-11-06T13:27:49.818 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-11-06T13:27:49.818 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-06T13:27:49.818 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42423sec preferred_lft 42423sec 2023-11-06T13:27:49.818 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2023-11-06T13:27:49.819 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-11-06T13:27:49.819 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-06T13:27:49.819 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-11-06T13:27:49.819 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-11-06T13:27:49.821 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-06T13:27:49.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:49.822 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:27:49.822 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:27:49.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2023-11-06T13:27:49.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2023-11-06T13:27:49.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2023-11-06T13:27:49.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-06T13:27:49.824 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:27:49.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:49.984 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-06T13:27:50.028 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-11-06T13:27:50.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.029 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-11-06T13:27:50.067 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-11-06T13:27:50.067 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-06T13:27:50.068 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-06T13:27:50.068 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-06T13:27:50.068 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-06T13:27:50.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.069 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:27:50.069 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:27:50.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-06T13:27:50.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-06T13:27:50.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-06T13:27:50.071 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:27:50.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.329 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-11-06T13:27:50.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.345 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2023-11-06T13:27:50.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.399 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:27:50.400 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:27:50.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-06T13:27:50.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-06T13:27:50.401 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:27:50.489 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-06T13:27:50.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.490 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:27:50.491 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:27:50.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-06T13:27:50.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-06T13:27:50.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-06T13:27:50.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-06T13:27:50.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-06T13:27:50.493 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:27:50.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:50.688 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:27:50.688 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:27:50.689 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-11-06T13:27:50.689 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2023-11-06T13:27:50.689 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:27:50.783 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-06T13:27:50.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:50.785 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:50.801 INFO:teuthology.orchestra.run.smithi038.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-06T13:27:50.801 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2023-11-06T13:27:50.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-06T13:27:50.867 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-06T13:27:50.930 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-06T13:27:50.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-06T13:27:50.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:50.932 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2023-11-06T13:27:50.987 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-06T13:27:50.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id admin --client_fs=cephfs /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:51.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo modprobe fuse 2023-11-06T13:27:51.053 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-11-06T13:27:51.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-11-06T13:27:51.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:2023-11-06T13:27:51.116+0000 7f91c3241380 -1 init, newargv = 0x55ea4026a5f0 newargc=15 2023-11-06T13:27:51.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:ceph-fuse[96200]: starting ceph client 2023-11-06T13:27:51.120 INFO:teuthology.orchestra.run.smithi038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-11-06T13:27:51.122 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-11-06T13:27:51.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:51.123 DEBUG:teuthology.orchestra.run.smithi038:> ls /sys/fs/fuse/connections 2023-11-06T13:27:51.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:ceph-fuse[96200]: starting fuse 2023-11-06T13:27:51.141 INFO:teuthology.orchestra.run.smithi038.stdout:46 2023-11-06T13:27:51.141 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-11-06T13:27:51.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-11-06T13:27:51.142 DEBUG:teuthology.orchestra.run.smithi038:> import glob 2023-11-06T13:27:51.142 DEBUG:teuthology.orchestra.run.smithi038:> import re 2023-11-06T13:27:51.143 DEBUG:teuthology.orchestra.run.smithi038:> import os 2023-11-06T13:27:51.143 DEBUG:teuthology.orchestra.run.smithi038:> import subprocess 2023-11-06T13:27:51.143 DEBUG:teuthology.orchestra.run.smithi038:> 2023-11-06T13:27:51.144 DEBUG:teuthology.orchestra.run.smithi038:> def _find_admin_socket(client_name): 2023-11-06T13:27:51.144 DEBUG:teuthology.orchestra.run.smithi038:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-06T13:27:51.144 DEBUG:teuthology.orchestra.run.smithi038:> files = glob.glob(asok_path) 2023-11-06T13:27:51.145 DEBUG:teuthology.orchestra.run.smithi038:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-06T13:27:51.145 DEBUG:teuthology.orchestra.run.smithi038:> 2023-11-06T13:27:51.145 DEBUG:teuthology.orchestra.run.smithi038:> # Given a non-glob path, it better be there 2023-11-06T13:27:51.146 DEBUG:teuthology.orchestra.run.smithi038:> if "*" not in asok_path: 2023-11-06T13:27:51.146 DEBUG:teuthology.orchestra.run.smithi038:> assert(len(files) == 1) 2023-11-06T13:27:51.147 DEBUG:teuthology.orchestra.run.smithi038:> return files[0] 2023-11-06T13:27:51.147 DEBUG:teuthology.orchestra.run.smithi038:> 2023-11-06T13:27:51.147 DEBUG:teuthology.orchestra.run.smithi038:> for f in files: 2023-11-06T13:27:51.148 DEBUG:teuthology.orchestra.run.smithi038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-06T13:27:51.148 DEBUG:teuthology.orchestra.run.smithi038:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-06T13:27:51.148 DEBUG:teuthology.orchestra.run.smithi038:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-06T13:27:51.149 DEBUG:teuthology.orchestra.run.smithi038:> contents = proc_f.read() 2023-11-06T13:27:51.149 DEBUG:teuthology.orchestra.run.smithi038:> if mountpoint in contents: 2023-11-06T13:27:51.149 DEBUG:teuthology.orchestra.run.smithi038:> return f 2023-11-06T13:27:51.150 DEBUG:teuthology.orchestra.run.smithi038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-06T13:27:51.150 DEBUG:teuthology.orchestra.run.smithi038:> 2023-11-06T13:27:51.150 DEBUG:teuthology.orchestra.run.smithi038:> print(_find_admin_socket("client.admin")) 2023-11-06T13:27:51.151 DEBUG:teuthology.orchestra.run.smithi038:> ' 2023-11-06T13:27:51.264 INFO:teuthology.orchestra.run.smithi038.stdout:/var/run/ceph/ceph-client.admin.96200.asok 2023-11-06T13:27:51.446 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.96200.asok 2023-11-06T13:27:51.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:51.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.96200.asok status 2023-11-06T13:27:51.599 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:27:51.599 INFO:teuthology.orchestra.run.smithi038.stdout: "metadata": { 2023-11-06T13:27:51.600 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_sha1": "4e03306bd00b0abb2be37dbc132f82d281f8973d", 2023-11-06T13:27:51.600 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_version": "ceph version 16.2.14-132-g4e03306b (4e03306bd00b0abb2be37dbc132f82d281f8973d) pacific (stable)", 2023-11-06T13:27:51.600 INFO:teuthology.orchestra.run.smithi038.stdout: "entity_id": "admin", 2023-11-06T13:27:51.601 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": "smithi038", 2023-11-06T13:27:51.601 INFO:teuthology.orchestra.run.smithi038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-06T13:27:51.602 INFO:teuthology.orchestra.run.smithi038.stdout: "pid": "96200", 2023-11-06T13:27:51.602 INFO:teuthology.orchestra.run.smithi038.stdout: "root": "/" 2023-11-06T13:27:51.602 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:27:51.603 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_count": 0, 2023-11-06T13:27:51.603 INFO:teuthology.orchestra.run.smithi038.stdout: "dentry_pinned_count": 0, 2023-11-06T13:27:51.603 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4509, 2023-11-06T13:27:51.604 INFO:teuthology.orchestra.run.smithi038.stdout: "inst": { 2023-11-06T13:27:51.604 INFO:teuthology.orchestra.run.smithi038.stdout: "name": { 2023-11-06T13:27:51.604 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "client", 2023-11-06T13:27:51.605 INFO:teuthology.orchestra.run.smithi038.stdout: "num": 4509 2023-11-06T13:27:51.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:27:51.605 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2023-11-06T13:27:51.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-11-06T13:27:51.606 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "192.168.0.1:0", 2023-11-06T13:27:51.606 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1577463894 2023-11-06T13:27:51.607 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:27:51.607 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:27:51.607 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": { 2023-11-06T13:27:51.608 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-11-06T13:27:51.608 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "192.168.0.1:0", 2023-11-06T13:27:51.608 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1577463894 2023-11-06T13:27:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:27:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: "inst_str": "client.4509 192.168.0.1:0/1577463894", 2023-11-06T13:27:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: "addr_str": "192.168.0.1:0/1577463894", 2023-11-06T13:27:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: "inode_count": 1, 2023-11-06T13:27:51.609 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_epoch": 6, 2023-11-06T13:27:51.610 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch": 31, 2023-11-06T13:27:51.610 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_epoch_barrier": 0, 2023-11-06T13:27:51.610 INFO:teuthology.orchestra.run.smithi038.stdout: "blocklisted": false, 2023-11-06T13:27:51.610 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs" 2023-11-06T13:27:51.611 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:27:51.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:51.612 DEBUG:teuthology.orchestra.run.smithi038:> stat --file-system '--printf=%T 2023-11-06T13:27:51.612 DEBUG:teuthology.orchestra.run.smithi038:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:51.628 INFO:teuthology.orchestra.run.smithi038.stdout:fuseblk 2023-11-06T13:27:51.629 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:51.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:51.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:51.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:27:51.696 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-06T13:27:51.806 INFO:teuthology.orchestra.run.smithi038.stdout:# file: . 2023-11-06T13:27:51.807 INFO:teuthology.orchestra.run.smithi038.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-06T13:27:51.807 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:51.807 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi038.front.sepia.ceph.com... 2023-11-06T13:27:51.808 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-06T13:27:51.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-06T13:27:51.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi038.stderr:ceph-fuse[96200]: fuse finished with error 0 and tester_r 0 2023-11-06T13:27:51.842 INFO:teuthology.orchestra.run:waiting for 900 2023-11-06T13:27:51.910 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi038.front.sepia.ceph.com 2023-11-06T13:27:51.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:27:51.911 DEBUG:teuthology.orchestra.run.smithi038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-06T13:27:51.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:52.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.082+0000 7f6c67521700 1 Processor -- start 2023-11-06T13:27:52.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.082+0000 7f6c67521700 1 -- start start 2023-11-06T13:27:52.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.083+0000 7f6c67521700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6c60175510 0x7f6c601758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.083+0000 7f6c67521700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6c600cada0 0x7f6c600cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.083+0000 7f6c67521700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6c6017c950 0x7f6c6017cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.083+0000 7f6c67521700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6017e680 con 0x7f6c600cada0 2023-11-06T13:27:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.083+0000 7f6c67521700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6017d790 con 0x7f6c6017c950 2023-11-06T13:27:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.083+0000 7f6c67521700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6017da70 con 0x7f6c60175510 2023-11-06T13:27:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6c600cada0 0x7f6c600cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6c600cada0 0x7f6c600cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35326/0 (socket says 172.21.15.38:35326) 2023-11-06T13:27:52.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 -- 172.21.15.38:0/2572879904 learned_addr learned my addr 172.21.15.38:0/2572879904 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:52.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c652bd700 1 --2- 172.21.15.38:0/2572879904 >> v2:172.21.15.163:3300/0 conn(0x7f6c60175510 0x7f6c601758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c65abe700 1 --2- 172.21.15.38:0/2572879904 >> v2:172.21.15.44:3300/0 conn(0x7f6c6017c950 0x7f6c6017cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 -- 172.21.15.38:0/2572879904 >> v2:172.21.15.163:3300/0 conn(0x7f6c60175510 msgr2=0x7f6c601758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:52.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 --2- 172.21.15.38:0/2572879904 >> v2:172.21.15.163:3300/0 conn(0x7f6c60175510 0x7f6c601758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 -- 172.21.15.38:0/2572879904 >> v2:172.21.15.44:3300/0 conn(0x7f6c6017c950 msgr2=0x7f6c6017cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:52.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 --2- 172.21.15.38:0/2572879904 >> v2:172.21.15.44:3300/0 conn(0x7f6c6017c950 0x7f6c6017cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 -- 172.21.15.38:0/2572879904 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6017dd50 con 0x7f6c600cada0 2023-11-06T13:27:52.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c64abc700 1 --2- 172.21.15.38:0/2572879904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c600cada0 0x7f6c600cb200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6c60083930 tx=0x7f6c540090f0).ready entity=mon.0 client_cookie=29961fd3d7af1b97 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c5ffff700 1 -- 172.21.15.38:0/2572879904 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400f510 con 0x7f6c600cada0 2023-11-06T13:27:52.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c5ffff700 1 -- 172.21.15.38:0/2572879904 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5400f670 con 0x7f6c600cada0 2023-11-06T13:27:52.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.084+0000 7f6c5ffff700 1 -- 172.21.15.38:0/2572879904 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400f9f0 con 0x7f6c600cada0 2023-11-06T13:27:52.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 -- 172.21.15.38:0/2572879904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c600cada0 msgr2=0x7f6c600cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 --2- 172.21.15.38:0/2572879904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c600cada0 0x7f6c600cb200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6c60083930 tx=0x7f6c540090f0).stop 2023-11-06T13:27:52.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 -- 172.21.15.38:0/2572879904 shutdown_connections 2023-11-06T13:27:52.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 --2- 172.21.15.38:0/2572879904 >> v2:172.21.15.163:3300/0 conn(0x7f6c60175510 0x7f6c601758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 --2- 172.21.15.38:0/2572879904 >> v2:172.21.15.44:3300/0 conn(0x7f6c6017c950 0x7f6c6017cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 --2- 172.21.15.38:0/2572879904 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c600cada0 0x7f6c600cb200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 -- 172.21.15.38:0/2572879904 >> 172.21.15.38:0/2572879904 conn(0x7f6c600f28b0 msgr2=0x7f6c60069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:52.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 -- 172.21.15.38:0/2572879904 shutdown_connections 2023-11-06T13:27:52.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.085+0000 7f6c67521700 1 -- 172.21.15.38:0/2572879904 wait complete. 2023-11-06T13:27:52.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.086+0000 7f6c67521700 1 Processor -- start 2023-11-06T13:27:52.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.086+0000 7f6c67521700 1 -- start start 2023-11-06T13:27:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.087+0000 7f6c67521700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c600cada0 0x7f6c600f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.087+0000 7f6c67521700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 0x7f6c60063f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.087+0000 7f6c67521700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c6017c950 0x7f6c60165f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.087+0000 7f6c67521700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60064450 con 0x7f6c60175510 2023-11-06T13:27:52.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.087+0000 7f6c67521700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600646c0 con 0x7f6c600cada0 2023-11-06T13:27:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.087+0000 7f6c67521700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600649a0 con 0x7f6c6017c950 2023-11-06T13:27:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 0x7f6c60063f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 0x7f6c60063f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35332/0 (socket says 172.21.15.38:35332) 2023-11-06T13:27:52.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 -- 172.21.15.38:0/3835842988 learned_addr learned my addr 172.21.15.38:0/3835842988 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c652bd700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c600cada0 0x7f6c600f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 -- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c6017c950 msgr2=0x7f6c60165f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c65abe700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c6017c950 0x7f6c60165f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c6017c950 0x7f6c60165f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 -- 172.21.15.38:0/3835842988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c600cada0 msgr2=0x7f6c600f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c600cada0 0x7f6c600f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 -- 172.21.15.38:0/3835842988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54009370 con 0x7f6c60175510 2023-11-06T13:27:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c652bd700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c600cada0 0x7f6c600f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c64abc700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 0x7f6c60063f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6c60089720 tx=0x7f6c54017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54006a40 con 0x7f6c60175510 2023-11-06T13:27:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5400f7e0 con 0x7f6c60175510 2023-11-06T13:27:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c60064c80 con 0x7f6c60175510 2023-11-06T13:27:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5401c670 con 0x7f6c60175510 2023-11-06T13:27:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.088+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c60065240 con 0x7f6c60175510 2023-11-06T13:27:52.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.089+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c601668e0 con 0x7f6c60175510 2023-11-06T13:27:52.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.090+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f6c5401ca20 con 0x7f6c60175510 2023-11-06T13:27:52.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.090+0000 7f6c5d7fa700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6c4c08cb40 0x7f6c4c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.091+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6c540b3cb0 con 0x7f6c60175510 2023-11-06T13:27:52.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.091+0000 7f6c652bd700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6c4c08cb40 0x7f6c4c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.091+0000 7f6c652bd700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6c4c08cb40 0x7f6c4c08f000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6c58009c00 tx=0x7f6c58008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.095+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6c601668e0 con 0x7f6c60175510 2023-11-06T13:27:52.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.269+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c601668e0 con 0x7f6c60175510 2023-11-06T13:27:52.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.270+0000 7f6c5d7fa700 1 -- 172.21.15.38:0/3835842988 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f6c601668e0 con 0x7f6c60175510 2023-11-06T13:27:52.274 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:52.274 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:52.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6c4c08cb40 msgr2=0x7f6c4c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6c4c08cb40 0x7f6c4c08f000 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6c58009c00 tx=0x7f6c58008040).stop 2023-11-06T13:27:52.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 msgr2=0x7f6c60063f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 0x7f6c60063f60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6c60089720 tx=0x7f6c54017000).stop 2023-11-06T13:27:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 shutdown_connections 2023-11-06T13:27:52.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c6017c950 0x7f6c60165f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6c4c08cb40 0x7f6c4c08f000 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c600cada0 0x7f6c600f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 --2- 172.21.15.38:0/3835842988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6c60175510 0x7f6c60063f60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 >> 172.21.15.38:0/3835842988 conn(0x7f6c600f28b0 msgr2=0x7f6c600cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:52.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 shutdown_connections 2023-11-06T13:27:52.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.272+0000 7f6c67521700 1 -- 172.21.15.38:0/3835842988 wait complete. 2023-11-06T13:27:52.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.403+0000 7f9e4722b700 1 Processor -- start 2023-11-06T13:27:52.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.404+0000 7f9e4722b700 1 -- start start 2023-11-06T13:27:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e4722b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9e400647f0 0x7f9e4017de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e4722b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4017d9d0 con 0x7f9e401756e0 2023-11-06T13:27:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e4722b700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4017c800 con 0x7f9e4017e350 2023-11-06T13:27:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e4722b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e400c8560 con 0x7f9e400647f0 2023-11-06T13:27:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e44fc7700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9e401756e0 0x7f9e400640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42642/0 (socket says 172.21.15.38:42642) 2023-11-06T13:27:52.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e44fc7700 1 -- 172.21.15.38:0/3050106918 learned_addr learned my addr 172.21.15.38:0/3050106918 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3ffff700 1 --2- 172.21.15.38:0/3050106918 >> v2:172.21.15.38:3300/0 conn(0x7f9e400647f0 0x7f9e4017de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3f7fe700 1 -- 172.21.15.38:0/3050106918 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966492871 0 0) 0x7f9e4017d9d0 con 0x7f9e401756e0 2023-11-06T13:27:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3f7fe700 1 -- 172.21.15.38:0/3050106918 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e2c0033f0 con 0x7f9e401756e0 2023-11-06T13:27:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3ffff700 1 -- 172.21.15.38:0/3050106918 >> v1:172.21.15.44:6789/0 conn(0x7f9e4017e350 legacy=0x7f9e40185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3ffff700 1 -- 172.21.15.38:0/3050106918 >> v1:172.21.15.38:6789/0 conn(0x7f9e401756e0 legacy=0x7f9e400640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3ffff700 1 -- 172.21.15.38:0/3050106918 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4017cae0 con 0x7f9e400647f0 2023-11-06T13:27:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3ffff700 1 --2- 172.21.15.38:0/3050106918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e400647f0 0x7f9e4017de60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9e30009e60 tx=0x7f9e30009780).ready entity=mon.0 client_cookie=6975af4734b7b3f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.405+0000 7f9e3f7fe700 1 -- 172.21.15.38:0/3050106918 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000e070 con 0x7f9e400647f0 2023-11-06T13:27:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e3f7fe700 1 -- 172.21.15.38:0/3050106918 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000bb60 con 0x7f9e400647f0 2023-11-06T13:27:52.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e3f7fe700 1 -- 172.21.15.38:0/3050106918 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30012410 con 0x7f9e400647f0 2023-11-06T13:27:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 -- 172.21.15.38:0/3050106918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e400647f0 msgr2=0x7f9e4017de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 --2- 172.21.15.38:0/3050106918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e400647f0 0x7f9e4017de60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9e30009e60 tx=0x7f9e30009780).stop 2023-11-06T13:27:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 -- 172.21.15.38:0/3050106918 shutdown_connections 2023-11-06T13:27:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 --2- 172.21.15.38:0/3050106918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e400647f0 0x7f9e4017de60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 -- 172.21.15.38:0/3050106918 >> 172.21.15.38:0/3050106918 conn(0x7f9e40069ea0 msgr2=0x7f9e4006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:52.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 -- 172.21.15.38:0/3050106918 shutdown_connections 2023-11-06T13:27:52.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.406+0000 7f9e4722b700 1 -- 172.21.15.38:0/3050106918 wait complete. 2023-11-06T13:27:52.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.408+0000 7f9e4722b700 1 Processor -- start 2023-11-06T13:27:52.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.408+0000 7f9e4722b700 1 -- start start 2023-11-06T13:27:52.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e4722b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e400647f0 0x7f9e4016e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e4722b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e401756e0 0x7f9e400c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e4722b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 0x7f9e400c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e4722b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e400c4f30 con 0x7f9e4017e350 2023-11-06T13:27:52.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e4722b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e401924a0 con 0x7f9e401756e0 2023-11-06T13:27:52.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e4722b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e40191920 con 0x7f9e400647f0 2023-11-06T13:27:52.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 0x7f9e400c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 0x7f9e400c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35352/0 (socket says 172.21.15.38:35352) 2023-11-06T13:27:52.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 -- 172.21.15.38:0/462680808 learned_addr learned my addr 172.21.15.38:0/462680808 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:52.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e44fc7700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e400647f0 0x7f9e4016e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e3ffff700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e401756e0 0x7f9e400c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 -- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e400647f0 msgr2=0x7f9e4016e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e400647f0 0x7f9e4016e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 -- 172.21.15.38:0/462680808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e401756e0 msgr2=0x7f9e400c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e401756e0 0x7f9e400c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.409+0000 7f9e457c8700 1 -- 172.21.15.38:0/462680808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30009a20 con 0x7f9e4017e350 2023-11-06T13:27:52.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.410+0000 7f9e457c8700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 0x7f9e400c58b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9e2800c470 tx=0x7f9e28007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.410+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280123f0 con 0x7f9e4017e350 2023-11-06T13:27:52.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.410+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28001e90 con 0x7f9e4017e350 2023-11-06T13:27:52.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.410+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e40191c00 con 0x7f9e4017e350 2023-11-06T13:27:52.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.410+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28012760 con 0x7f9e4017e350 2023-11-06T13:27:52.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.410+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e401921c0 con 0x7f9e4017e350 2023-11-06T13:27:52.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.411+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e400c50e0 con 0x7f9e4017e350 2023-11-06T13:27:52.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.412+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f9e280113a0 con 0x7f9e4017e350 2023-11-06T13:27:52.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.412+0000 7f9e3cff9700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9e2008cb40 0x7f9e2008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.413+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f9e280b1440 con 0x7f9e4017e350 2023-11-06T13:27:52.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.413+0000 7f9e44fc7700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9e2008cb40 0x7f9e2008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.413+0000 7f9e44fc7700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9e2008cb40 0x7f9e2008f000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9e38005750 tx=0x7f9e38009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.417+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9e400c50e0 con 0x7f9e4017e350 2023-11-06T13:27:52.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.592+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e400c50e0 con 0x7f9e4017e350 2023-11-06T13:27:52.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.593+0000 7f9e3cff9700 1 -- 172.21.15.38:0/462680808 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f9e400c50e0 con 0x7f9e4017e350 2023-11-06T13:27:52.597 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:52.597 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9e2008cb40 msgr2=0x7f9e2008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9e2008cb40 0x7f9e2008f000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f9e38005750 tx=0x7f9e38009040).stop 2023-11-06T13:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 msgr2=0x7f9e400c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 0x7f9e400c58b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9e2800c470 tx=0x7f9e28007d70).stop 2023-11-06T13:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 shutdown_connections 2023-11-06T13:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9e4017e350 0x7f9e400c58b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e400647f0 0x7f9e4016e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9e2008cb40 0x7f9e2008f000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 --2- 172.21.15.38:0/462680808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e401756e0 0x7f9e400c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.595+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 >> 172.21.15.38:0/462680808 conn(0x7f9e40069ea0 msgr2=0x7f9e4016f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.596+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 shutdown_connections 2023-11-06T13:27:52.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.596+0000 7f9e4722b700 1 -- 172.21.15.38:0/462680808 wait complete. 2023-11-06T13:27:52.611 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-06T13:27:52.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.729+0000 7f76d1378700 1 Processor -- start 2023-11-06T13:27:52.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.729+0000 7f76d1378700 1 -- start start 2023-11-06T13:27:52.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76d1378700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f76cc175840 0x7f76cc0ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76d1378700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76cc0ed560 0x7f76cc0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76d1378700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0ec760 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76d1378700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0cd0e0 con 0x7f76cc0ed560 2023-11-06T13:27:52.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76d1378700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0cd3c0 con 0x7f76cc175840 2023-11-06T13:27:52.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76cb7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76cc0ed560 0x7f76cc0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76cb7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f76cc0ed560 0x7f76cc0cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35360/0 (socket says 172.21.15.38:35360) 2023-11-06T13:27:52.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76cb7fe700 1 -- 172.21.15.38:0/2471887594 learned_addr learned my addr 172.21.15.38:0/2471887594 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:52.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.730+0000 7f76caffd700 1 --2- 172.21.15.38:0/2471887594 >> v2:172.21.15.44:3300/0 conn(0x7f76cc175840 0x7f76cc0ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76cb7fe700 1 -- 172.21.15.38:0/2471887594 >> v2:172.21.15.44:3300/0 conn(0x7f76cc175840 msgr2=0x7f76cc0ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:52.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76cb7fe700 1 --2- 172.21.15.38:0/2471887594 >> v2:172.21.15.44:3300/0 conn(0x7f76cc175840 0x7f76cc0ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76cb7fe700 1 -- 172.21.15.38:0/2471887594 >> v1:172.21.15.44:6789/0 conn(0x7f76cc0ed0e0 legacy=0x7f76cc182350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:52.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76cb7fe700 1 -- 172.21.15.38:0/2471887594 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0cd6a0 con 0x7f76cc0ed560 2023-11-06T13:27:52.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76caffd700 1 --2- 172.21.15.38:0/2471887594 >> v2:172.21.15.44:3300/0 conn(0x7f76cc175840 0x7f76cc0ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:52.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76cb7fe700 1 --2- 172.21.15.38:0/2471887594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed560 0x7f76cc0cc8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f76cc089d90 tx=0x7f76c4009840).ready entity=mon.0 client_cookie=2ffe80489b36e2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76c9ffb700 1 -- 172.21.15.38:0/2471887594 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400e070 con 0x7f76cc0ed560 2023-11-06T13:27:52.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76c9ffb700 1 -- 172.21.15.38:0/2471887594 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400ba10 con 0x7f76cc0ed560 2023-11-06T13:27:52.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76c9ffb700 1 -- 172.21.15.38:0/2471887594 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400bd90 con 0x7f76cc0ed560 2023-11-06T13:27:52.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 -- 172.21.15.38:0/2471887594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed560 msgr2=0x7f76cc0cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 --2- 172.21.15.38:0/2471887594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed560 0x7f76cc0cc8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f76cc089d90 tx=0x7f76c4009840).stop 2023-11-06T13:27:52.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 -- 172.21.15.38:0/2471887594 shutdown_connections 2023-11-06T13:27:52.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 --2- 172.21.15.38:0/2471887594 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed560 0x7f76cc0cc8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 --2- 172.21.15.38:0/2471887594 >> v2:172.21.15.44:3300/0 conn(0x7f76cc175840 0x7f76cc0ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 -- 172.21.15.38:0/2471887594 >> 172.21.15.38:0/2471887594 conn(0x7f76cc0f2760 msgr2=0x7f76cc069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:52.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 -- 172.21.15.38:0/2471887594 shutdown_connections 2023-11-06T13:27:52.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.731+0000 7f76d1378700 1 -- 172.21.15.38:0/2471887594 wait complete. 2023-11-06T13:27:52.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.733+0000 7f76d1378700 1 Processor -- start 2023-11-06T13:27:52.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.733+0000 7f76d1378700 1 -- start start 2023-11-06T13:27:52.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76d1378700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 0x7f76cc165230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76d1378700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ed560 0x7f76cc165720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76d1378700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76cc175840 0x7f76cc190530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76d1378700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc179fc0 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76d1378700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc17a2a0 con 0x7f76cc175840 2023-11-06T13:27:52.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76d1378700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc17a580 con 0x7f76cc0ed560 2023-11-06T13:27:52.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 0x7f76cc165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 0x7f76cc165230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35376/0 (socket says 172.21.15.38:35376) 2023-11-06T13:27:52.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 -- 172.21.15.38:0/108430859 learned_addr learned my addr 172.21.15.38:0/108430859 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:52.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76cb7fe700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76cc175840 0x7f76cc190530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76ca7fc700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ed560 0x7f76cc165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 -- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ed560 msgr2=0x7f76cc165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ed560 0x7f76cc165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 -- 172.21.15.38:0/108430859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76cc175840 msgr2=0x7f76cc190530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:52.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76cc175840 0x7f76cc190530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:52.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76caffd700 1 -- 172.21.15.38:0/108430859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009ae0 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76ca7fc700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ed560 0x7f76cc165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:52.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.734+0000 7f76cb7fe700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76cc175840 0x7f76cc190530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:52.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.735+0000 7f76caffd700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 0x7f76cc165230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f76bc00c880 tx=0x7f76bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.735+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc010580 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.735+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc0106e0 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.735+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc17a860 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.735+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc010a60 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.735+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc17ae20 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.736+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc1787f0 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.737+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f76bc01b460 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.737+0000 7f76c2ffd700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f76ac08cb40 0x7f76ac08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:52.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.737+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f76bc0b1fc0 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.737+0000 7f76ca7fc700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f76ac08cb40 0x7f76ac08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:52.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.738+0000 7f76ca7fc700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f76ac08cb40 0x7f76ac08f000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f76cc0f1190 tx=0x7f76b4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:52.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.741+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f76cc1787f0 con 0x7f76cc0ed0e0 2023-11-06T13:27:52.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:52.958+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f76cc1787f0 con 0x7f76cc0ed0e0 2023-11-06T13:27:53.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.320+0000 7f76c2ffd700 1 -- 172.21.15.38:0/108430859 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f76cc1787f0 con 0x7f76cc0ed0e0 2023-11-06T13:27:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f76ac08cb40 msgr2=0x7f76ac08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:53.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f76ac08cb40 0x7f76ac08f000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f76cc0f1190 tx=0x7f76b4009040).stop 2023-11-06T13:27:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 msgr2=0x7f76cc165230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 0x7f76cc165230 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f76bc00c880 tx=0x7f76bc008040).stop 2023-11-06T13:27:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 shutdown_connections 2023-11-06T13:27:53.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f76ac08cb40 0x7f76ac08f000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76cc175840 0x7f76cc190530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f76cc0ed0e0 0x7f76cc165230 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 --2- 172.21.15.38:0/108430859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76cc0ed560 0x7f76cc165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 >> 172.21.15.38:0/108430859 conn(0x7f76cc0f2760 msgr2=0x7f76cc16f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:53.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 shutdown_connections 2023-11-06T13:27:53.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.322+0000 7f76d1378700 1 -- 172.21.15.38:0/108430859 wait complete. 2023-11-06T13:27:53.337 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-11-06T13:27:53.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-11-06T13:27:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.457+0000 7fef16ecd700 1 Processor -- start 2023-11-06T13:27:53.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.457+0000 7fef16ecd700 1 -- start start 2023-11-06T13:27:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef16ecd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef1017dae0 0x7fef100ed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:53.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef16ecd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef100844c0 con 0x7fef1017b2c0 2023-11-06T13:27:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef16ecd700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef100847a0 con 0x7fef1017b6a0 2023-11-06T13:27:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef16ecd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef100842d0 con 0x7fef1017dae0 2023-11-06T13:27:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef1546a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fef1017dae0 0x7fef100ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef14c69700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fef1017b2c0 0x7fef10083bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42646/0 (socket says 172.21.15.38:42646) 2023-11-06T13:27:53.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef14c69700 1 -- 172.21.15.38:0/3581471366 learned_addr learned my addr 172.21.15.38:0/3581471366 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:53.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef1546a700 1 -- 172.21.15.38:0/3581471366 >> v1:172.21.15.163:6789/0 conn(0x7fef1017b6a0 legacy=0x7fef1017d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:53.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef1546a700 1 -- 172.21.15.38:0/3581471366 >> v1:172.21.15.38:6789/0 conn(0x7fef1017b2c0 legacy=0x7fef10083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:53.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef1546a700 1 -- 172.21.15.38:0/3581471366 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10084a80 con 0x7fef1017dae0 2023-11-06T13:27:53.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef0f7fe700 1 -- 172.21.15.38:0/3581471366 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738584372 0 0) 0x7fef100844c0 con 0x7fef1017b2c0 2023-11-06T13:27:53.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef1546a700 1 --2- 172.21.15.38:0/3581471366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017dae0 0x7fef100ed310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7feef8009760 tx=0x7feef8009060).ready entity=mon.0 client_cookie=8d531970e00c8a2c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:53.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.458+0000 7fef0f7fe700 1 -- 172.21.15.38:0/3581471366 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80090d0 con 0x7fef1017dae0 2023-11-06T13:27:53.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef0f7fe700 1 -- 172.21.15.38:0/3581471366 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800b520 con 0x7fef1017dae0 2023-11-06T13:27:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef0f7fe700 1 -- 172.21.15.38:0/3581471366 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800b8a0 con 0x7fef1017dae0 2023-11-06T13:27:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 -- 172.21.15.38:0/3581471366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017dae0 msgr2=0x7fef100ed310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 --2- 172.21.15.38:0/3581471366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017dae0 0x7fef100ed310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7feef8009760 tx=0x7feef8009060).stop 2023-11-06T13:27:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 -- 172.21.15.38:0/3581471366 shutdown_connections 2023-11-06T13:27:53.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 --2- 172.21.15.38:0/3581471366 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017dae0 0x7fef100ed310 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 -- 172.21.15.38:0/3581471366 >> 172.21.15.38:0/3581471366 conn(0x7fef100ef600 msgr2=0x7fef1005e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:53.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 -- 172.21.15.38:0/3581471366 shutdown_connections 2023-11-06T13:27:53.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.459+0000 7fef16ecd700 1 -- 172.21.15.38:0/3581471366 wait complete. 2023-11-06T13:27:53.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.460+0000 7fef16ecd700 1 Processor -- start 2023-11-06T13:27:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.461+0000 7fef16ecd700 1 -- start start 2023-11-06T13:27:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1017b2c0 0x7fef10155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 0x7fef10153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:53.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1017dae0 0x7fef10066d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10155070 con 0x7fef1017b6a0 2023-11-06T13:27:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10192b80 con 0x7fef1017dae0 2023-11-06T13:27:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10192e60 con 0x7fef1017b2c0 2023-11-06T13:27:53.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 0x7fef10153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:53.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 0x7fef10153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35394/0 (socket says 172.21.15.38:35394) 2023-11-06T13:27:53.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 -- 172.21.15.38:0/1729234033 learned_addr learned my addr 172.21.15.38:0/1729234033 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:53.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef1546a700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1017dae0 0x7fef10066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:53.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef14c69700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1017b2c0 0x7fef10155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:53.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 -- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1017b2c0 msgr2=0x7fef10155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:53.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1017b2c0 0x7fef10155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 -- 172.21.15.38:0/1729234033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1017dae0 msgr2=0x7fef10066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:53.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1017dae0 0x7fef10066d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:53.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 -- 172.21.15.38:0/1729234033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80092a0 con 0x7fef1017b6a0 2023-11-06T13:27:53.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef1546a700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1017dae0 0x7fef10066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:53.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0ffff700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 0x7fef10153d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fef0000b7e0 tx=0x7fef00009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000d620 con 0x7fef1017b6a0 2023-11-06T13:27:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0000d7c0 con 0x7fef1017b6a0 2023-11-06T13:27:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10193140 con 0x7fef1017b6a0 2023-11-06T13:27:53.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0000db80 con 0x7fef1017b6a0 2023-11-06T13:27:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.462+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef10154a20 con 0x7fef1017b6a0 2023-11-06T13:27:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.464+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1006c580 con 0x7fef1017b6a0 2023-11-06T13:27:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.464+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fef0000f480 con 0x7fef1017b6a0 2023-11-06T13:27:53.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.465+0000 7fef0cff9700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7feef008cb40 0x7feef008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:53.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.465+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fef000b2b00 con 0x7fef1017b6a0 2023-11-06T13:27:53.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.465+0000 7fef14c69700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7feef008cb40 0x7feef008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:53.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.466+0000 7fef14c69700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7feef008cb40 0x7feef008f000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fef10154960 tx=0x7fef08009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:53.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.468+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fef00083150 con 0x7fef1017b6a0 2023-11-06T13:27:53.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:53.687+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fef10085010 con 0x7fef1017b6a0 2023-11-06T13:27:54.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.330+0000 7fef0cff9700 1 -- 172.21.15.38:0/1729234033 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fef00086770 con 0x7fef1017b6a0 2023-11-06T13:27:54.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7feef008cb40 msgr2=0x7feef008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:54.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7feef008cb40 0x7feef008f000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fef10154960 tx=0x7fef08009040).stop 2023-11-06T13:27:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 msgr2=0x7fef10153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 0x7fef10153d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fef0000b7e0 tx=0x7fef00009310).stop 2023-11-06T13:27:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 shutdown_connections 2023-11-06T13:27:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7feef008cb40 0x7feef008f000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1017dae0 0x7fef10066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fef1017b2c0 0x7fef10155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 --2- 172.21.15.38:0/1729234033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fef1017b6a0 0x7fef10153d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 >> 172.21.15.38:0/1729234033 conn(0x7fef100ef600 msgr2=0x7fef1017d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 shutdown_connections 2023-11-06T13:27:54.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.332+0000 7fef16ecd700 1 -- 172.21.15.38:0/1729234033 wait complete. 2023-11-06T13:27:54.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-11-06T13:27:54.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.470+0000 7f1c3933f700 1 Processor -- start 2023-11-06T13:27:54.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.470+0000 7f1c3933f700 1 -- start start 2023-11-06T13:27:54.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.471+0000 7f1c3933f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1c34175a40 0x7f1c3417f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:54.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.471+0000 7f1c3933f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1c3417e970 0x7f1c34185840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:54.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.471+0000 7f1c3933f700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3417ddd0 con 0x7f1c3417fb80 2023-11-06T13:27:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.471+0000 7f1c3933f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c34064780 con 0x7f1c34175a40 2023-11-06T13:27:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.471+0000 7f1c3933f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c340c4c20 con 0x7f1c3417e970 2023-11-06T13:27:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c32ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1c34175a40 0x7f1c3417f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c327fc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1c3417fb80 0x7f1c3417e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:42652/0 (socket says 172.21.15.38:42652) 2023-11-06T13:27:54.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c327fc700 1 -- 172.21.15.38:0/3886623106 learned_addr learned my addr 172.21.15.38:0/3886623106 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c337fe700 1 --2- 172.21.15.38:0/3886623106 >> v2:172.21.15.44:3300/0 conn(0x7f1c3417e970 0x7f1c34185840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c32ffd700 1 -- 172.21.15.38:0/3886623106 >> v2:172.21.15.44:3300/0 conn(0x7f1c3417e970 msgr2=0x7f1c34185840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c32ffd700 1 --2- 172.21.15.38:0/3886623106 >> v2:172.21.15.44:3300/0 conn(0x7f1c3417e970 0x7f1c34185840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c32ffd700 1 -- 172.21.15.38:0/3886623106 >> v1:172.21.15.38:6789/0 conn(0x7f1c3417fb80 legacy=0x7f1c3417e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:54.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c31ffb700 1 -- 172.21.15.38:0/3886623106 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818032588 0 0) 0x7f1c3417ddd0 con 0x7f1c3417fb80 2023-11-06T13:27:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c32ffd700 1 -- 172.21.15.38:0/3886623106 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3417cee0 con 0x7f1c34175a40 2023-11-06T13:27:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c32ffd700 1 --2- 172.21.15.38:0/3886623106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3417f690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1c34157d50 tx=0x7f1c24009060).ready entity=mon.0 client_cookie=505c8869148e8261 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c31ffb700 1 -- 172.21.15.38:0/3886623106 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400f510 con 0x7f1c34175a40 2023-11-06T13:27:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c31ffb700 1 -- 172.21.15.38:0/3886623106 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400f670 con 0x7f1c34175a40 2023-11-06T13:27:54.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.472+0000 7f1c31ffb700 1 -- 172.21.15.38:0/3886623106 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400f9f0 con 0x7f1c34175a40 2023-11-06T13:27:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 -- 172.21.15.38:0/3886623106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 msgr2=0x7f1c3417f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 --2- 172.21.15.38:0/3886623106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3417f690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1c34157d50 tx=0x7f1c24009060).stop 2023-11-06T13:27:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 -- 172.21.15.38:0/3886623106 shutdown_connections 2023-11-06T13:27:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 --2- 172.21.15.38:0/3886623106 >> v2:172.21.15.44:3300/0 conn(0x7f1c3417e970 0x7f1c34185840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 --2- 172.21.15.38:0/3886623106 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3417f690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 -- 172.21.15.38:0/3886623106 >> 172.21.15.38:0/3886623106 conn(0x7f1c3406a970 msgr2=0x7f1c340f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 -- 172.21.15.38:0/3886623106 shutdown_connections 2023-11-06T13:27:54.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.473+0000 7f1c3933f700 1 -- 172.21.15.38:0/3886623106 wait complete. 2023-11-06T13:27:54.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.474+0000 7f1c3933f700 1 Processor -- start 2023-11-06T13:27:54.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.474+0000 7f1c3933f700 1 -- start start 2023-11-06T13:27:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.475+0000 7f1c3933f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3416f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.475+0000 7f1c3933f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3417e970 0x7f1c3416fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.475+0000 7f1c3933f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c3417fb80 0x7f1c34180020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.475+0000 7f1c3933f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340ca490 con 0x7f1c34175a40 2023-11-06T13:27:54.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.475+0000 7f1c3933f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34182030 con 0x7f1c3417e970 2023-11-06T13:27:54.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.475+0000 7f1c3933f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34181ba0 con 0x7f1c3417fb80 2023-11-06T13:27:54.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3416f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:54.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3416f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35412/0 (socket says 172.21.15.38:35412) 2023-11-06T13:27:54.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 -- 172.21.15.38:0/2084247835 learned_addr learned my addr 172.21.15.38:0/2084247835 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:54.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c327fc700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3417e970 0x7f1c3416fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c337fe700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c3417fb80 0x7f1c34180020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 -- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c3417fb80 msgr2=0x7f1c34180020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c3417fb80 0x7f1c34180020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 -- 172.21.15.38:0/2084247835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3417e970 msgr2=0x7f1c3416fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:54.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3417e970 0x7f1c3416fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 -- 172.21.15.38:0/2084247835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240092a0 con 0x7f1c34175a40 2023-11-06T13:27:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c32ffd700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3416f850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1c24009dd0 tx=0x7f1c24017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2400fe80 con 0x7f1c34175a40 2023-11-06T13:27:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2400f7e0 con 0x7f1c34175a40 2023-11-06T13:27:54.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c34180cb0 con 0x7f1c34175a40 2023-11-06T13:27:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24022630 con 0x7f1c34175a40 2023-11-06T13:27:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.476+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c34181270 con 0x7f1c34175a40 2023-11-06T13:27:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.477+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c34181e80 con 0x7f1c34175a40 2023-11-06T13:27:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.478+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f1c240229e0 con 0x7f1c34175a40 2023-11-06T13:27:54.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.478+0000 7f1c1affd700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1c2008cb40 0x7f1c2008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:54.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.479+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1c240b3420 con 0x7f1c34175a40 2023-11-06T13:27:54.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.479+0000 7f1c327fc700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1c2008cb40 0x7f1c2008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:54.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.479+0000 7f1c327fc700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1c2008cb40 0x7f1c2008f000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1c34157c90 tx=0x7f1c28007dd0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:54.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.483+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1c24083a70 con 0x7f1c34175a40 2023-11-06T13:27:54.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:54.697+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f1c3406c580 con 0x7f1c34175a40 2023-11-06T13:27:55.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.340+0000 7f1c1affd700 1 -- 172.21.15.38:0/2084247835 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1c24087090 con 0x7f1c34175a40 2023-11-06T13:27:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1c2008cb40 msgr2=0x7f1c2008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:55.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1c2008cb40 0x7f1c2008f000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1c34157c90 tx=0x7f1c28007dd0).stop 2023-11-06T13:27:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 msgr2=0x7f1c3416f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3416f850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f1c24009dd0 tx=0x7f1c24017000).stop 2023-11-06T13:27:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 shutdown_connections 2023-11-06T13:27:55.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1c3417fb80 0x7f1c34180020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1c34175a40 0x7f1c3416f850 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1c2008cb40 0x7f1c2008f000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 --2- 172.21.15.38:0/2084247835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c3417e970 0x7f1c3416fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 >> 172.21.15.38:0/2084247835 conn(0x7f1c3406a970 msgr2=0x7f1c3417e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 shutdown_connections 2023-11-06T13:27:55.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.343+0000 7f1c3933f700 1 -- 172.21.15.38:0/2084247835 wait complete. 2023-11-06T13:27:55.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-11-06T13:27:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.488+0000 7f7d91925700 1 Processor -- start 2023-11-06T13:27:55.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.488+0000 7f7d91925700 1 -- start start 2023-11-06T13:27:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.489+0000 7f7d91925700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7d8c178c90 0x7f7d8c0eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.489+0000 7f7d91925700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7d8c180310 0x7f7d8c1807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.489+0000 7f7d91925700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c063ed0 con 0x7f7d8c179070 2023-11-06T13:27:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.489+0000 7f7d91925700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0641b0 con 0x7f7d8c180310 2023-11-06T13:27:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.489+0000 7f7d91925700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c064490 con 0x7f7d8c178c90 2023-11-06T13:27:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7d8c180310 0x7f7d8c1807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7d8c180310 0x7f7d8c1807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35414/0 (socket says 172.21.15.38:35414) 2023-11-06T13:27:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 -- 172.21.15.38:0/805585468 learned_addr learned my addr 172.21.15.38:0/805585468 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8affd700 1 --2- 172.21.15.38:0/805585468 >> v2:172.21.15.44:3300/0 conn(0x7f7d8c178c90 0x7f7d8c0eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 -- 172.21.15.38:0/805585468 >> v2:172.21.15.44:3300/0 conn(0x7f7d8c178c90 msgr2=0x7f7d8c0eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 --2- 172.21.15.38:0/805585468 >> v2:172.21.15.44:3300/0 conn(0x7f7d8c178c90 0x7f7d8c0eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 -- 172.21.15.38:0/805585468 >> v1:172.21.15.163:6789/0 conn(0x7f7d8c179070 legacy=0x7f7d8c0ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 -- 172.21.15.38:0/805585468 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c064770 con 0x7f7d8c180310 2023-11-06T13:27:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d8b7fe700 1 --2- 172.21.15.38:0/805585468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c180310 0x7f7d8c1807c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7d8c062c50 tx=0x7f7d7c0090f0).ready entity=mon.0 client_cookie=399a5cb2a411306 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d89ffb700 1 -- 172.21.15.38:0/805585468 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00b520 con 0x7f7d8c180310 2023-11-06T13:27:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d89ffb700 1 -- 172.21.15.38:0/805585468 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00b680 con 0x7f7d8c180310 2023-11-06T13:27:55.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.490+0000 7f7d89ffb700 1 -- 172.21.15.38:0/805585468 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ba20 con 0x7f7d8c180310 2023-11-06T13:27:55.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 -- 172.21.15.38:0/805585468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c180310 msgr2=0x7f7d8c1807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:55.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 --2- 172.21.15.38:0/805585468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c180310 0x7f7d8c1807c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7d8c062c50 tx=0x7f7d7c0090f0).stop 2023-11-06T13:27:55.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 -- 172.21.15.38:0/805585468 shutdown_connections 2023-11-06T13:27:55.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 --2- 172.21.15.38:0/805585468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c180310 0x7f7d8c1807c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 --2- 172.21.15.38:0/805585468 >> v2:172.21.15.44:3300/0 conn(0x7f7d8c178c90 0x7f7d8c0eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 -- 172.21.15.38:0/805585468 >> 172.21.15.38:0/805585468 conn(0x7f7d8c0f5df0 msgr2=0x7f7d8c0f1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:55.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 -- 172.21.15.38:0/805585468 shutdown_connections 2023-11-06T13:27:55.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.491+0000 7f7d91925700 1 -- 172.21.15.38:0/805585468 wait complete. 2023-11-06T13:27:55.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.492+0000 7f7d91925700 1 Processor -- start 2023-11-06T13:27:55.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.492+0000 7f7d91925700 1 -- start start 2023-11-06T13:27:55.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.493+0000 7f7d91925700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 0x7f7d8c177110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:55.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.493+0000 7f7d91925700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d8c179070 0x7f7d8c17b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:55.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.493+0000 7f7d91925700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d8c180310 0x7f7d8c17d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:55.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.493+0000 7f7d91925700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c17cf00 con 0x7f7d8c178c90 2023-11-06T13:27:55.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.493+0000 7f7d91925700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c17b980 con 0x7f7d8c179070 2023-11-06T13:27:55.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.493+0000 7f7d91925700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c17bc60 con 0x7f7d8c180310 2023-11-06T13:27:55.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 0x7f7d8c177110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:55.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 0x7f7d8c177110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35420/0 (socket says 172.21.15.38:35420) 2023-11-06T13:27:55.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 -- 172.21.15.38:0/1272525765 learned_addr learned my addr 172.21.15.38:0/1272525765 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8a7fc700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d8c179070 0x7f7d8c17b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8b7fe700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d8c180310 0x7f7d8c17d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 -- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d8c180310 msgr2=0x7f7d8c17d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d8c180310 0x7f7d8c17d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 -- 172.21.15.38:0/1272525765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d8c179070 msgr2=0x7f7d8c17b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d8c179070 0x7f7d8c17b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 -- 172.21.15.38:0/1272525765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c009370 con 0x7f7d8c178c90 2023-11-06T13:27:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d8affd700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 0x7f7d8c177110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7d84009e50 tx=0x7f7d8400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400cb50 con 0x7f7d8c178c90 2023-11-06T13:27:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8400f040 con 0x7f7d8c178c90 2023-11-06T13:27:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c17bf40 con 0x7f7d8c178c90 2023-11-06T13:27:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84013400 con 0x7f7d8c178c90 2023-11-06T13:27:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.494+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c17b5d0 con 0x7f7d8c178c90 2023-11-06T13:27:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.495+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c065250 con 0x7f7d8c178c90 2023-11-06T13:27:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.496+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f7d84013770 con 0x7f7d8c178c90 2023-11-06T13:27:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.497+0000 7f7d82ffd700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7d6c08cb40 0x7f7d6c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.497+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7d840b27c0 con 0x7f7d8c178c90 2023-11-06T13:27:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.497+0000 7f7d8a7fc700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7d6c08cb40 0x7f7d6c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.497+0000 7f7d8a7fc700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7d6c08cb40 0x7f7d6c08f000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7d8c088a00 tx=0x7f7d74007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.501+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7d84082d90 con 0x7f7d8c178c90 2023-11-06T13:27:55.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:55.720+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f7d8c17ccd0 con 0x7f7d8c178c90 2023-11-06T13:27:56.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.347+0000 7f7d82ffd700 1 -- 172.21.15.38:0/1272525765 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7d8c17ccd0 con 0x7f7d8c178c90 2023-11-06T13:27:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.349+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7d6c08cb40 msgr2=0x7f7d6c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.349+0000 7f7d91925700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7d6c08cb40 0x7f7d6c08f000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7d8c088a00 tx=0x7f7d74007d40).stop 2023-11-06T13:27:56.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.349+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 msgr2=0x7f7d8c177110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.349+0000 7f7d91925700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 0x7f7d8c177110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7d84009e50 tx=0x7f7d8400b040).stop 2023-11-06T13:27:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 shutdown_connections 2023-11-06T13:27:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d8c180310 0x7f7d8c17d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7d8c178c90 0x7f7d8c177110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7d6c08cb40 0x7f7d6c08f000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 --2- 172.21.15.38:0/1272525765 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7d8c179070 0x7f7d8c17b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 >> 172.21.15.38:0/1272525765 conn(0x7f7d8c0f5df0 msgr2=0x7f7d8c177fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 shutdown_connections 2023-11-06T13:27:56.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.350+0000 7f7d91925700 1 -- 172.21.15.38:0/1272525765 wait complete. 2023-11-06T13:27:56.370 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2023-11-06T13:27:56.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-11-06T13:27:56.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.496+0000 7f176ce34700 1 Processor -- start 2023-11-06T13:27:56.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.496+0000 7f176ce34700 1 -- start start 2023-11-06T13:27:56.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176ce34700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17680f03e0 0x7f17680f0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:56.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176ce34700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680c8600 con 0x7f17680c98d0 2023-11-06T13:27:56.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176ce34700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680c8830 con 0x7f176817e450 2023-11-06T13:27:56.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176ce34700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1768064730 con 0x7f17680f03e0 2023-11-06T13:27:56.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1766d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f17680f03e0 0x7f17680f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:56.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1765d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f17680c98d0 0x7f17680c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51714/0 (socket says 172.21.15.38:51714) 2023-11-06T13:27:56.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1765d9b700 1 -- 172.21.15.38:0/3511317673 learned_addr learned my addr 172.21.15.38:0/3511317673 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:56.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1766d9d700 1 -- 172.21.15.38:0/3511317673 >> v1:172.21.15.44:6789/0 conn(0x7f176817e450 legacy=0x7f176817e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:56.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1766d9d700 1 -- 172.21.15.38:0/3511317673 >> v1:172.21.15.38:6789/0 conn(0x7f17680c98d0 legacy=0x7f17680c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:56.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176559a700 1 -- 172.21.15.38:0/3511317673 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659471681 0 0) 0x7f17680c8600 con 0x7f17680c98d0 2023-11-06T13:27:56.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1766d9d700 1 -- 172.21.15.38:0/3511317673 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680c8b10 con 0x7f17680f03e0 2023-11-06T13:27:56.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f1766d9d700 1 --2- 172.21.15.38:0/3511317673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17680f03e0 0x7f17680f0830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1758009e60 tx=0x7f1758009780).ready entity=mon.0 client_cookie=6ab8e401f620a44b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:56.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176559a700 1 -- 172.21.15.38:0/3511317673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f17680f03e0 2023-11-06T13:27:56.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.498+0000 7f176559a700 1 -- 172.21.15.38:0/3511317673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175800bc30 con 0x7f17680f03e0 2023-11-06T13:27:56.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176559a700 1 -- 172.21.15.38:0/3511317673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758012410 con 0x7f17680f03e0 2023-11-06T13:27:56.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 -- 172.21.15.38:0/3511317673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17680f03e0 msgr2=0x7f17680f0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:56.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 --2- 172.21.15.38:0/3511317673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17680f03e0 0x7f17680f0830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f1758009e60 tx=0x7f1758009780).stop 2023-11-06T13:27:56.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 -- 172.21.15.38:0/3511317673 shutdown_connections 2023-11-06T13:27:56.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 --2- 172.21.15.38:0/3511317673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f17680f03e0 0x7f17680f0830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 -- 172.21.15.38:0/3511317673 >> 172.21.15.38:0/3511317673 conn(0x7f17680f53e0 msgr2=0x7f17680f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:56.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 -- 172.21.15.38:0/3511317673 shutdown_connections 2023-11-06T13:27:56.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.499+0000 7f176ce34700 1 -- 172.21.15.38:0/3511317673 wait complete. 2023-11-06T13:27:56.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.501+0000 7f176ce34700 1 Processor -- start 2023-11-06T13:27:56.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.501+0000 7f176ce34700 1 -- start start 2023-11-06T13:27:56.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17680c98d0 0x7f176817cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:56.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17680f03e0 0x7f1768179e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:56.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 0x7f1768172280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:56.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1768171df0 con 0x7f176817e450 2023-11-06T13:27:56.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176818f5f0 con 0x7f17680f03e0 2023-11-06T13:27:56.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176818f8d0 con 0x7f17680c98d0 2023-11-06T13:27:56.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 0x7f1768172280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:56.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 0x7f1768172280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43446/0 (socket says 172.21.15.38:43446) 2023-11-06T13:27:56.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 -- 172.21.15.38:0/407308121 learned_addr learned my addr 172.21.15.38:0/407308121 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:56.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1765d9b700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17680f03e0 0x7f1768179e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:56.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176659c700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17680c98d0 0x7f176817cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:56.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 -- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17680c98d0 msgr2=0x7f176817cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:56.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17680c98d0 0x7f176817cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 -- 172.21.15.38:0/407308121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17680f03e0 msgr2=0x7f1768179e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:56.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17680f03e0 0x7f1768179e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:56.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 -- 172.21.15.38:0/407308121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009a20 con 0x7f176817e450 2023-11-06T13:27:56.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176659c700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17680c98d0 0x7f176817cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:56.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1765d9b700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17680f03e0 0x7f1768179e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:56.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f1766d9d700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 0x7f1768172280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f175800b6c0 tx=0x7f1758009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:56.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758009440 con 0x7f176817e450 2023-11-06T13:27:56.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17580117d0 con 0x7f176817e450 2023-11-06T13:27:56.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176818fbb0 con 0x7f176817e450 2023-11-06T13:27:56.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758011b90 con 0x7f176817e450 2023-11-06T13:27:56.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.502+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176818f2d0 con 0x7f176817e450 2023-11-06T13:27:56.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.503+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176817ed40 con 0x7f176817e450 2023-11-06T13:27:56.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.504+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f175801d420 con 0x7f176817e450 2023-11-06T13:27:56.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.505+0000 7f175e7fc700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f174808cb40 0x7f174808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:56.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.505+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f17580b3f90 con 0x7f176817e450 2023-11-06T13:27:56.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.505+0000 7f176659c700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f174808cb40 0x7f174808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:56.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.505+0000 7f176659c700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f174808cb40 0x7f174808f000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f17600026f0 tx=0x7f1760009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:56.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.509+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f17580845e0 con 0x7f176817e450 2023-11-06T13:27:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:56.710+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f176806c580 con 0x7f174808cb40 2023-11-06T13:27:56.719 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:56.716+0000 7f3934b72700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-06T13:27:56.719 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:56.716+0000 7f3934b72700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-06T13:27:56.719 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:56.716+0000 7f3934b72700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-06T13:27:56.719 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:56.716+0000 7f3934b72700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-06T13:27:56.720 INFO:tasks.ceph.mgr.z.smithi163.stderr:2023-11-06T13:27:56.716+0000 7f3934b72700 -1 client.0 error registering admin socket command: (17) File exists 2023-11-06T13:27:56.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:27:56.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:27:56.758 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:27:57.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.289+0000 7f175e7fc700 1 -- 172.21.15.38:0/407308121 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f176806c580 con 0x7f174808cb40 2023-11-06T13:27:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f174808cb40 msgr2=0x7f174808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f174808cb40 0x7f174808f000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f17600026f0 tx=0x7f1760009040).stop 2023-11-06T13:27:57.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 msgr2=0x7f1768172280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 0x7f1768172280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f175800b6c0 tx=0x7f1758009780).stop 2023-11-06T13:27:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 shutdown_connections 2023-11-06T13:27:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f176817e450 0x7f1768172280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17680c98d0 0x7f176817cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.291+0000 7f176ce34700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f174808cb40 0x7f174808f000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.292+0000 7f176ce34700 1 --2- 172.21.15.38:0/407308121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17680f03e0 0x7f1768179e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.292+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 >> 172.21.15.38:0/407308121 conn(0x7f17680f53e0 msgr2=0x7f176817efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.292+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 shutdown_connections 2023-11-06T13:27:57.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.292+0000 7f176ce34700 1 -- 172.21.15.38:0/407308121 wait complete. 2023-11-06T13:27:57.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-11-06T13:27:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.430+0000 7f7146e45700 1 Processor -- start 2023-11-06T13:27:57.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.430+0000 7f7146e45700 1 -- start start 2023-11-06T13:27:57.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f7146e45700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7140175a40 0x7f714017f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f7146e45700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f714017fb80 0x7f714017e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f7146e45700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714017ddd0 con 0x7f714017e750 2023-11-06T13:27:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f7146e45700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7140064780 con 0x7f714017fb80 2023-11-06T13:27:57.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f7146e45700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71400c4c20 con 0x7f7140175a40 2023-11-06T13:27:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f714017fb80 0x7f714017e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f714017fb80 0x7f714017e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43460/0 (socket says 172.21.15.38:43460) 2023-11-06T13:27:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 -- 172.21.15.38:0/4200275337 learned_addr learned my addr 172.21.15.38:0/4200275337 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:57.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f7144be1700 1 --2- 172.21.15.38:0/4200275337 >> v2:172.21.15.44:3300/0 conn(0x7f7140175a40 0x7f714017f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 -- 172.21.15.38:0/4200275337 >> v2:172.21.15.44:3300/0 conn(0x7f7140175a40 msgr2=0x7f714017f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 --2- 172.21.15.38:0/4200275337 >> v2:172.21.15.44:3300/0 conn(0x7f7140175a40 0x7f714017f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 -- 172.21.15.38:0/4200275337 >> v1:172.21.15.163:6789/0 conn(0x7f714017e750 legacy=0x7f71400efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 -- 172.21.15.38:0/4200275337 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714017cee0 con 0x7f714017fb80 2023-11-06T13:27:57.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713ffff700 1 --2- 172.21.15.38:0/4200275337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f714017fb80 0x7f714017e260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f71400898b0 tx=0x7f71340090f0).ready entity=mon.0 client_cookie=3596315ed8ae9cba server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.431+0000 7f713f7fe700 1 -- 172.21.15.38:0/4200275337 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400b600 con 0x7f714017fb80 2023-11-06T13:27:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f713f7fe700 1 -- 172.21.15.38:0/4200275337 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400b760 con 0x7f714017fb80 2023-11-06T13:27:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f713f7fe700 1 -- 172.21.15.38:0/4200275337 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400bae0 con 0x7f714017fb80 2023-11-06T13:27:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 -- 172.21.15.38:0/4200275337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f714017fb80 msgr2=0x7f714017e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 --2- 172.21.15.38:0/4200275337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f714017fb80 0x7f714017e260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f71400898b0 tx=0x7f71340090f0).stop 2023-11-06T13:27:57.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 -- 172.21.15.38:0/4200275337 shutdown_connections 2023-11-06T13:27:57.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 --2- 172.21.15.38:0/4200275337 >> v2:172.21.15.44:3300/0 conn(0x7f7140175a40 0x7f714017f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 --2- 172.21.15.38:0/4200275337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f714017fb80 0x7f714017e260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 -- 172.21.15.38:0/4200275337 >> 172.21.15.38:0/4200275337 conn(0x7f714006a970 msgr2=0x7f71400f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:57.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 -- 172.21.15.38:0/4200275337 shutdown_connections 2023-11-06T13:27:57.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.432+0000 7f7146e45700 1 -- 172.21.15.38:0/4200275337 wait complete. 2023-11-06T13:27:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.433+0000 7f7146e45700 1 Processor -- start 2023-11-06T13:27:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.434+0000 7f7146e45700 1 -- start start 2023-11-06T13:27:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 0x7f7140174fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f714017e750 0x7f714016fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714017fb80 0x7f7140181a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71401815b0 con 0x7f7140175a40 2023-11-06T13:27:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7140182760 con 0x7f714017fb80 2023-11-06T13:27:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71401806c0 con 0x7f714017e750 2023-11-06T13:27:57.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 0x7f7140174fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 0x7f7140174fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43476/0 (socket says 172.21.15.38:43476) 2023-11-06T13:27:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 -- 172.21.15.38:0/642775107 learned_addr learned my addr 172.21.15.38:0/642775107 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f713ffff700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f714017e750 0x7f714016fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f71453e2700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714017fb80 0x7f7140181a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 -- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f714017e750 msgr2=0x7f714016fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f714017e750 0x7f714016fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 -- 172.21.15.38:0/642775107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714017fb80 msgr2=0x7f7140181a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714017fb80 0x7f7140181a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 -- 172.21.15.38:0/642775107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009370 con 0x7f7140175a40 2023-11-06T13:27:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f713ffff700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f714017e750 0x7f714016fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f71453e2700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714017fb80 0x7f7140181a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7144be1700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 0x7f7140174fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f713000d890 tx=0x7f7130008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300125f0 con 0x7f7140175a40 2023-11-06T13:27:57.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130012750 con 0x7f7140175a40 2023-11-06T13:27:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130012ad0 con 0x7f7140175a40 2023-11-06T13:27:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.435+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71401809a0 con 0x7f7140175a40 2023-11-06T13:27:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.436+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7140180f60 con 0x7f7140175a40 2023-11-06T13:27:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.437+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7140181890 con 0x7f7140175a40 2023-11-06T13:27:57.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.437+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f7130013480 con 0x7f7140175a40 2023-11-06T13:27:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.438+0000 7f713cff9700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f712c08cb40 0x7f712c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.438+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f71300b2070 con 0x7f7140175a40 2023-11-06T13:27:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.438+0000 7f713ffff700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f712c08cb40 0x7f712c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.439+0000 7f713ffff700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f712c08cb40 0x7f712c08f000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f714017ffa0 tx=0x7f7134017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:57.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.442+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f71300826c0 con 0x7f7140175a40 2023-11-06T13:27:57.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.652+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f71401816f0 con 0x7f712c08cb40 2023-11-06T13:27:57.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.657+0000 7f713cff9700 1 -- 172.21.15.38:0/642775107 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f713400bea0 con 0x7f712c08cb40 2023-11-06T13:27:57.660 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/sv_0/125965f2-fa23-4d73-a602-42fc9c60b6b4 2023-11-06T13:27:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f712c08cb40 msgr2=0x7f712c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f712c08cb40 0x7f712c08f000 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f714017ffa0 tx=0x7f7134017000).stop 2023-11-06T13:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 msgr2=0x7f7140174fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 0x7f7140174fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f713000d890 tx=0x7f7130008040).stop 2023-11-06T13:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 shutdown_connections 2023-11-06T13:27:57.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f712c08cb40 0x7f712c08f000 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714017fb80 0x7f7140181a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7140175a40 0x7f7140174fb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 --2- 172.21.15.38:0/642775107 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f714017e750 0x7f714016fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 >> 172.21.15.38:0/642775107 conn(0x7f714006a970 msgr2=0x7f7140182a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:57.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 shutdown_connections 2023-11-06T13:27:57.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.658+0000 7f7146e45700 1 -- 172.21.15.38:0/642775107 wait complete. 2023-11-06T13:27:57.674 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-11-06T13:27:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.792+0000 7fa67b048700 1 Processor -- start 2023-11-06T13:27:57.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.792+0000 7fa67b048700 1 -- start start 2023-11-06T13:27:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67b048700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa674175420 0x7fa674181a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67b048700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6740c82d0 0x7fa6740c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67b048700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6740c9a40 con 0x7fa6740ca3c0 2023-11-06T13:27:57.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67b048700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740c8b50 con 0x7fa674175420 2023-11-06T13:27:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67b048700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6740c8e30 con 0x7fa6740c82d0 2023-11-06T13:27:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67a046700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa674175420 0x7fa674181a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67a046700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa674175420 0x7fa674181a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43488/0 (socket says 172.21.15.38:43488) 2023-11-06T13:27:57.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.793+0000 7fa67a046700 1 -- 172.21.15.38:0/2828458527 learned_addr learned my addr 172.21.15.38:0/2828458527 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa679845700 1 --2- 172.21.15.38:0/2828458527 >> v2:172.21.15.44:3300/0 conn(0x7fa6740c82d0 0x7fa6740c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67a046700 1 -- 172.21.15.38:0/2828458527 >> v2:172.21.15.44:3300/0 conn(0x7fa6740c82d0 msgr2=0x7fa6740c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67a046700 1 --2- 172.21.15.38:0/2828458527 >> v2:172.21.15.44:3300/0 conn(0x7fa6740c82d0 0x7fa6740c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67a046700 1 -- 172.21.15.38:0/2828458527 >> v1:172.21.15.44:6789/0 conn(0x7fa6740ca3c0 legacy=0x7fa67417ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:57.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67a046700 1 -- 172.21.15.38:0/2828458527 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740c9110 con 0x7fa674175420 2023-11-06T13:27:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67a046700 1 --2- 172.21.15.38:0/2828458527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa674175420 0x7fa674181a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa6740f1110 tx=0x7fa6700090f0).ready entity=mon.0 client_cookie=ed47508994d769c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa679044700 1 -- 172.21.15.38:0/2828458527 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000b5a0 con 0x7fa674175420 2023-11-06T13:27:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa679044700 1 -- 172.21.15.38:0/2828458527 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67000b700 con 0x7fa674175420 2023-11-06T13:27:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa679044700 1 -- 172.21.15.38:0/2828458527 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000ba80 con 0x7fa674175420 2023-11-06T13:27:57.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67b048700 1 -- 172.21.15.38:0/2828458527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa674175420 msgr2=0x7fa674181a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.794+0000 7fa67b048700 1 --2- 172.21.15.38:0/2828458527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa674175420 0x7fa674181a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fa6740f1110 tx=0x7fa6700090f0).stop 2023-11-06T13:27:57.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.795+0000 7fa67b048700 1 -- 172.21.15.38:0/2828458527 shutdown_connections 2023-11-06T13:27:57.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.795+0000 7fa67b048700 1 --2- 172.21.15.38:0/2828458527 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa674175420 0x7fa674181a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.795+0000 7fa67b048700 1 --2- 172.21.15.38:0/2828458527 >> v2:172.21.15.44:3300/0 conn(0x7fa6740c82d0 0x7fa6740c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.795+0000 7fa67b048700 1 -- 172.21.15.38:0/2828458527 >> 172.21.15.38:0/2828458527 conn(0x7fa6740f2720 msgr2=0x7fa674069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:57.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.795+0000 7fa67b048700 1 -- 172.21.15.38:0/2828458527 shutdown_connections 2023-11-06T13:27:57.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.795+0000 7fa67b048700 1 -- 172.21.15.38:0/2828458527 wait complete. 2023-11-06T13:27:57.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.796+0000 7fa67b048700 1 Processor -- start 2023-11-06T13:27:57.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.796+0000 7fa67b048700 1 -- start start 2023-11-06T13:27:57.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67b048700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6740c82d0 0x7fa6741782e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67b048700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 0x7fa674062770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67b048700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa674175420 0x7fa674164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67b048700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741787d0 con 0x7fa6740ca3c0 2023-11-06T13:27:57.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67b048700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741772d0 con 0x7fa6740c82d0 2023-11-06T13:27:57.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67b048700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa674177e50 con 0x7fa674175420 2023-11-06T13:27:57.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 0x7fa674062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 0x7fa674062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43490/0 (socket says 172.21.15.38:43490) 2023-11-06T13:27:57.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 -- 172.21.15.38:0/2738136703 learned_addr learned my addr 172.21.15.38:0/2738136703 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:57.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67a046700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6740c82d0 0x7fa6741782e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67a847700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa674175420 0x7fa674164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 -- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa674175420 msgr2=0x7fa674164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa674175420 0x7fa674164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 -- 172.21.15.38:0/2738136703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6740c82d0 msgr2=0x7fa6741782e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6740c82d0 0x7fa6741782e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:57.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa679845700 1 -- 172.21.15.38:0/2738136703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009370 con 0x7fa6740ca3c0 2023-11-06T13:27:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.797+0000 7fa67a046700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6740c82d0 0x7fa6741782e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.798+0000 7fa679845700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 0x7fa674062770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa66400d860 tx=0x7fa664008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.798+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664011590 con 0x7fa6740ca3c0 2023-11-06T13:27:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.798+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640116f0 con 0x7fa6740ca3c0 2023-11-06T13:27:57.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.798+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740cc760 con 0x7fa6740ca3c0 2023-11-06T13:27:57.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.798+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664011a70 con 0x7fa6740ca3c0 2023-11-06T13:27:57.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.798+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674177800 con 0x7fa6740ca3c0 2023-11-06T13:27:57.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.799+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674177fc0 con 0x7fa6740ca3c0 2023-11-06T13:27:57.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.800+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fa664012420 con 0x7fa6740ca3c0 2023-11-06T13:27:57.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.800+0000 7fa66a7fc700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa65808cb40 0x7fa65808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:57.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.801+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa6640b1990 con 0x7fa6740ca3c0 2023-11-06T13:27:57.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.801+0000 7fa67a046700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa65808cb40 0x7fa65808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:57.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.801+0000 7fa67a046700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa65808cb40 0x7fa65808f000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa670009130 tx=0x7fa670015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:57.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:57.805+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa664081fe0 con 0x7fa6740ca3c0 2023-11-06T13:27:58.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.009+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6740cd3c0 con 0x7fa65808cb40 2023-11-06T13:27:58.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.033+0000 7fa66a7fc700 1 -- 172.21.15.38:0/2738136703 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa6740cd3c0 con 0x7fa65808cb40 2023-11-06T13:27:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa65808cb40 msgr2=0x7fa65808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa65808cb40 0x7fa65808f000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa670009130 tx=0x7fa670015000).stop 2023-11-06T13:27:58.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 msgr2=0x7fa674062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 0x7fa674062770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa66400d860 tx=0x7fa664008040).stop 2023-11-06T13:27:58.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 shutdown_connections 2023-11-06T13:27:58.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa674175420 0x7fa674164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa65808cb40 0x7fa65808f000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6740c82d0 0x7fa6741782e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 --2- 172.21.15.38:0/2738136703 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa6740ca3c0 0x7fa674062770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 >> 172.21.15.38:0/2738136703 conn(0x7fa6740f2720 msgr2=0x7fa674182820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:58.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 shutdown_connections 2023-11-06T13:27:58.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.035+0000 7fa67b048700 1 -- 172.21.15.38:0/2738136703 wait complete. 2023-11-06T13:27:58.050 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-11-06T13:27:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.169+0000 7f7c7f2a0700 1 Processor -- start 2023-11-06T13:27:58.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.170+0000 7f7c7f2a0700 1 -- start start 2023-11-06T13:27:58.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7f2a0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7c780ed170 0x7f7c78180a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7f2a0700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c78180f10 con 0x7f7c78178c90 2023-11-06T13:27:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7f2a0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7817fe20 con 0x7f7c78179070 2023-11-06T13:27:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7f2a0700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c78063ed0 con 0x7f7c780ed170 2023-11-06T13:27:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d03c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7c78178c90 0x7f7c780eca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51722/0 (socket says 172.21.15.38:51722) 2023-11-06T13:27:58.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d03c700 1 -- 172.21.15.38:0/2900268807 learned_addr learned my addr 172.21.15.38:0/2900268807 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d83d700 1 --2- 172.21.15.38:0/2900268807 >> v2:172.21.15.38:3300/0 conn(0x7f7c780ed170 0x7f7c78180a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c77fff700 1 -- 172.21.15.38:0/2900268807 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836064420 0 0) 0x7f7c78180f10 con 0x7f7c78178c90 2023-11-06T13:27:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c77fff700 1 -- 172.21.15.38:0/2900268807 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c600033f0 con 0x7f7c78178c90 2023-11-06T13:27:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c77fff700 1 -- 172.21.15.38:0/2900268807 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848783357 0 0) 0x7f7c6c001110 con 0x7f7c78179070 2023-11-06T13:27:58.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d83d700 1 -- 172.21.15.38:0/2900268807 >> v1:172.21.15.44:6789/0 conn(0x7f7c78179070 legacy=0x7f7c78180310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d83d700 1 -- 172.21.15.38:0/2900268807 >> v1:172.21.15.38:6789/0 conn(0x7f7c78178c90 legacy=0x7f7c780eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d83d700 1 -- 172.21.15.38:0/2900268807 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780641b0 con 0x7f7c780ed170 2023-11-06T13:27:58.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.171+0000 7f7c7d83d700 1 --2- 172.21.15.38:0/2900268807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c780ed170 0x7f7c78180a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f7c68009e60 tx=0x7f7c68009780).ready entity=mon.0 client_cookie=ddfae4f78db615d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c77fff700 1 -- 172.21.15.38:0/2900268807 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800e070 con 0x7f7c780ed170 2023-11-06T13:27:58.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c77fff700 1 -- 172.21.15.38:0/2900268807 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800bb60 con 0x7f7c780ed170 2023-11-06T13:27:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c77fff700 1 -- 172.21.15.38:0/2900268807 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800bee0 con 0x7f7c780ed170 2023-11-06T13:27:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/2900268807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c780ed170 msgr2=0x7f7c78180a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/2900268807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c780ed170 0x7f7c78180a20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f7c68009e60 tx=0x7f7c68009780).stop 2023-11-06T13:27:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/2900268807 shutdown_connections 2023-11-06T13:27:58.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/2900268807 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c780ed170 0x7f7c78180a20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/2900268807 >> 172.21.15.38:0/2900268807 conn(0x7f7c780f5df0 msgr2=0x7f7c780f1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/2900268807 shutdown_connections 2023-11-06T13:27:58.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.172+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/2900268807 wait complete. 2023-11-06T13:27:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.174+0000 7f7c7f2a0700 1 Processor -- start 2023-11-06T13:27:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.174+0000 7f7c7f2a0700 1 -- start start 2023-11-06T13:27:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7f2a0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c780ed170 0x7f7c7816ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7f2a0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c78178c90 0x7f7c78179550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7f2a0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 0x7f7c78179a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7f2a0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7816b120 con 0x7f7c78179070 2023-11-06T13:27:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7f2a0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78176c20 con 0x7f7c78178c90 2023-11-06T13:27:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7f2a0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78176f00 con 0x7f7c780ed170 2023-11-06T13:27:58.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 0x7f7c78179a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 0x7f7c78179a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43504/0 (socket says 172.21.15.38:43504) 2023-11-06T13:27:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 -- 172.21.15.38:0/3063749979 learned_addr learned my addr 172.21.15.38:0/3063749979 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d03c700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c780ed170 0x7f7c7816ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 -- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c780ed170 msgr2=0x7f7c7816ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c780ed170 0x7f7c7816ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 -- 172.21.15.38:0/3063749979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c78178c90 msgr2=0x7f7c78179550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7c83b700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c78178c90 0x7f7c78179550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c78178c90 0x7f7c78179550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 -- 172.21.15.38:0/3063749979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68009a20 con 0x7f7c78179070 2023-11-06T13:27:58.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d03c700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c780ed170 0x7f7c7816ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:27:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.175+0000 7f7c7d83d700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 0x7f7c78179a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f7c6800b6c0 tx=0x7f7c68009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.176+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680070e0 con 0x7f7c78179070 2023-11-06T13:27:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.176+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6801d630 con 0x7f7c78179070 2023-11-06T13:27:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.176+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6801d9f0 con 0x7f7c78179070 2023-11-06T13:27:58.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.176+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7817a0b0 con 0x7f7c78179070 2023-11-06T13:27:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.176+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7817a670 con 0x7f7c78179070 2023-11-06T13:27:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.177+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c78065250 con 0x7f7c78179070 2023-11-06T13:27:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.177+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 4) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f7c68003040 con 0x7f7c78179070 2023-11-06T13:27:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.178+0000 7f7c757fa700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7c6408cb40 0x7f7c6408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.178+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7c680b3e40 con 0x7f7c78179070 2023-11-06T13:27:58.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.178+0000 7f7c7d03c700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7c6408cb40 0x7f7c6408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.179+0000 7f7c7d03c700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7c6408cb40 0x7f7c6408f000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7c70005750 tx=0x7f7c70009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.182+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7c68084490 con 0x7f7c78179070 2023-11-06T13:27:58.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.358+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f7c680b8070 con 0x7f7c78179070 2023-11-06T13:27:58.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.395+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c78176d60 con 0x7f7c6408cb40 2023-11-06T13:27:58.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.399+0000 7f7c757fa700 1 -- 172.21.15.38:0/3063749979 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f7c700013f0 con 0x7f7c6408cb40 2023-11-06T13:27:58.403 INFO:teuthology.orchestra.run.smithi038.stdout:/volumes/_nogroup/sv_1/cd209e5b-9b2b-405c-b266-b1d5b88ae6b2 2023-11-06T13:27:58.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.401+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7c6408cb40 msgr2=0x7f7c6408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.401+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7c6408cb40 0x7f7c6408f000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7c70005750 tx=0x7f7c70009040).stop 2023-11-06T13:27:58.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.401+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 msgr2=0x7f7c78179a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.401+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 0x7f7c78179a40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f7c6800b6c0 tx=0x7f7c68009780).stop 2023-11-06T13:27:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 shutdown_connections 2023-11-06T13:27:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7c78179070 0x7f7c78179a40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7c780ed170 0x7f7c7816ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7c6408cb40 0x7f7c6408f000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 --2- 172.21.15.38:0/3063749979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c78178c90 0x7f7c78179550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 >> 172.21.15.38:0/3063749979 conn(0x7f7c780f5df0 msgr2=0x7f7c7816c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 shutdown_connections 2023-11-06T13:27:58.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.402+0000 7f7c7f2a0700 1 -- 172.21.15.38:0/3063749979 wait complete. 2023-11-06T13:27:58.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:27:58.489 INFO:tasks.ceph.mds.l.smithi163.stderr:2023-11-06T13:27:58.487+0000 7f2da7b5b700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-11-06T13:27:58.490 INFO:tasks.ceph.mds.l.smithi163.stderr:2023-11-06T13:27:58.487+0000 7f2da7b5b700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-11-06T13:27:58.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.532+0000 7f0094554700 1 Processor -- start 2023-11-06T13:27:58.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.532+0000 7f0094554700 1 -- start start 2023-11-06T13:27:58.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.533+0000 7f0094554700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f008c0647f0 0x7f008c17de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.533+0000 7f0094554700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c17d9d0 con 0x7f008c1756e0 2023-11-06T13:27:58.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.533+0000 7f0094554700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c17c800 con 0x7f008c17e350 2023-11-06T13:27:58.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.533+0000 7f0094554700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c0c8560 con 0x7f008c0647f0 2023-11-06T13:27:58.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.533+0000 7f00922f0700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f008c1756e0 0x7f008c0640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51728/0 (socket says 172.21.15.38:51728) 2023-11-06T13:27:58.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00922f0700 1 -- 172.21.15.38:0/526784598 learned_addr learned my addr 172.21.15.38:0/526784598 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:58.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f0091aef700 1 --2- 172.21.15.38:0/526784598 >> v2:172.21.15.163:3300/0 conn(0x7f008c0647f0 0x7f008c17de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495548514 0 0) 0x7f008c17d9d0 con 0x7f008c1756e0 2023-11-06T13:27:58.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00740033f0 con 0x7f008c1756e0 2023-11-06T13:27:58.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919122191 0 0) 0x7f008c17c800 con 0x7f008c17e350 2023-11-06T13:27:58.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f008c17d9d0 con 0x7f008c17e350 2023-11-06T13:27:58.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332947718 0 0) 0x7f00740033f0 con 0x7f008c1756e0 2023-11-06T13:27:58.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 >> v2:172.21.15.163:3300/0 conn(0x7f008c0647f0 msgr2=0x7f008c17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:58.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 --2- 172.21.15.38:0/526784598 >> v2:172.21.15.163:3300/0 conn(0x7f008c0647f0 0x7f008c17de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 >> v1:172.21.15.163:6789/0 conn(0x7f008c17e350 legacy=0x7f008c185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c17cae0 con 0x7f008c1756e0 2023-11-06T13:27:58.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f00840017f0 con 0x7f008c1756e0 2023-11-06T13:27:58.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 >> v1:172.21.15.38:6789/0 conn(0x7f008c1756e0 legacy=0x7f008c0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0074003ac0 0x7f0074003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074004690 0x7f0074004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0074005000 0x7f007400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007400be80 con 0x7f0074005000 2023-11-06T13:27:58.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007400bff0 con 0x7f0074003ac0 2023-11-06T13:27:58.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007400c1b0 con 0x7f0074004690 2023-11-06T13:27:58.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f0092af1700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0074005000 0x7f007400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.534+0000 7f0091aef700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074004690 0x7f0074004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 -- 172.21.15.38:0/526784598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074004690 msgr2=0x7f0074004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074004690 0x7f0074004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 -- 172.21.15.38:0/526784598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0074003ac0 msgr2=0x7f0074003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f00922f0700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0074003ac0 0x7f0074003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0074003ac0 0x7f0074003ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 -- 172.21.15.38:0/526784598 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740033f0 con 0x7f0074005000 2023-11-06T13:27:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 -- 172.21.15.38:0/526784598 reap_dead start 2023-11-06T13:27:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0092af1700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0074005000 0x7f007400b8e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f007c001890 tx=0x7f007c007bb0).ready entity=mon.0 client_cookie=9605ccb6d5713754 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c007020 con 0x7f0074005000 2023-11-06T13:27:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c007180 con 0x7f0074005000 2023-11-06T13:27:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f00912ee700 1 -- 172.21.15.38:0/526784598 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c007500 con 0x7f0074005000 2023-11-06T13:27:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0094554700 1 -- 172.21.15.38:0/526784598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0074005000 msgr2=0x7f007400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0094554700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0074005000 0x7f007400b8e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f007c001890 tx=0x7f007c007bb0).stop 2023-11-06T13:27:58.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0094554700 1 -- 172.21.15.38:0/526784598 shutdown_connections 2023-11-06T13:27:58.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0094554700 1 --2- 172.21.15.38:0/526784598 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0074005000 0x7f007400b8e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.535+0000 7f0094554700 1 -- 172.21.15.38:0/526784598 >> 172.21.15.38:0/526784598 conn(0x7f008c069ea0 msgr2=0x7f008c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:58.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.536+0000 7f0094554700 1 -- 172.21.15.38:0/526784598 shutdown_connections 2023-11-06T13:27:58.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.536+0000 7f0094554700 1 -- 172.21.15.38:0/526784598 wait complete. 2023-11-06T13:27:58.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.537+0000 7f0094554700 1 Processor -- start 2023-11-06T13:27:58.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.537+0000 7f0094554700 1 -- start start 2023-11-06T13:27:58.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0094554700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074005000 0x7f008c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0094554700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f008c0f2840 0x7f008c16be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0094554700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 0x7f008c193140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0094554700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0f23b0 con 0x7f008c192cc0 2023-11-06T13:27:58.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0094554700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0cb2d0 con 0x7f008c0f2840 2023-11-06T13:27:58.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0094554700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0eec70 con 0x7f0074005000 2023-11-06T13:27:58.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 0x7f008c193140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 0x7f008c193140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43524/0 (socket says 172.21.15.38:43524) 2023-11-06T13:27:58.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 -- 172.21.15.38:0/163857022 learned_addr learned my addr 172.21.15.38:0/163857022 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:58.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f00922f0700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074005000 0x7f008c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 -- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074005000 msgr2=0x7f008c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074005000 0x7f008c0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 -- 172.21.15.38:0/163857022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f008c0f2840 msgr2=0x7f008c16be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0091aef700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f008c0f2840 0x7f008c16be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.538+0000 7f0092af1700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f008c0f2840 0x7f008c16be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f0092af1700 1 -- 172.21.15.38:0/163857022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0f17a0 con 0x7f008c192cc0 2023-11-06T13:27:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f0092af1700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 0x7f008c193140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f007c001e80 tx=0x7f007c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c012610 con 0x7f008c192cc0 2023-11-06T13:27:58.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c012770 con 0x7f008c192cc0 2023-11-06T13:27:58.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c0f1a80 con 0x7f008c192cc0 2023-11-06T13:27:58.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c012af0 con 0x7f008c192cc0 2023-11-06T13:27:58.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.539+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c0f2040 con 0x7f008c192cc0 2023-11-06T13:27:58.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.540+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c0f2560 con 0x7f008c192cc0 2023-11-06T13:27:58.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.541+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f007c01d430 con 0x7f008c192cc0 2023-11-06T13:27:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.541+0000 7f008a7fc700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f007808cbd0 0x7f007808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.541+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f007c0b2de0 con 0x7f008c192cc0 2023-11-06T13:27:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.542+0000 7f00922f0700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f007808cbd0 0x7f007808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.542+0000 7f00922f0700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f007808cbd0 0x7f007808f090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0084001580 tx=0x7f0084009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.545+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f008c0f2560 con 0x7f008c192cc0 2023-11-06T13:27:58.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.762+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f008c0f2560 con 0x7f008c192cc0 2023-11-06T13:27:58.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.763+0000 7f008a7fc700 1 -- 172.21.15.38:0/163857022 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10635 (secure 0 0 0) 0x7f008c0f2560 con 0x7f008c192cc0 2023-11-06T13:27:58.766 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:58.767 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:58.254004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4361,"mds_1":4355,"mds_2":4352,"mds_3":4349,"mds_4":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4315":{"gid":4315,"name":"e","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4321":{"gid":4321,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4323":{"gid":4323,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4326":{"gid":4326,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4349":{"gid":4349,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4352":{"gid":4352,"name":"c","rank":2,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4355":{"gid":4355,"name":"i","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-06T13:27:58.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f007808cbd0 msgr2=0x7f007808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f007808cbd0 0x7f007808f090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0084001580 tx=0x7f0084009040).stop 2023-11-06T13:27:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 msgr2=0x7f008c193140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 0x7f008c193140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f007c001e80 tx=0x7f007c016000).stop 2023-11-06T13:27:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 shutdown_connections 2023-11-06T13:27:58.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f008c192cc0 0x7f008c193140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0074005000 0x7f008c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f007808cbd0 0x7f007808f090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 --2- 172.21.15.38:0/163857022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f008c0f2840 0x7f008c16be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 >> 172.21.15.38:0/163857022 conn(0x7f008c069ea0 msgr2=0x7f008c0c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:58.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 shutdown_connections 2023-11-06T13:27:58.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.765+0000 7f0094554700 1 -- 172.21.15.38:0/163857022 wait complete. 2023-11-06T13:27:58.771 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2023-11-06T13:27:58.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:27:58.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.895+0000 7f29b99f3700 1 Processor -- start 2023-11-06T13:27:58.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.895+0000 7f29b99f3700 1 -- start start 2023-11-06T13:27:58.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.896+0000 7f29b99f3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f29b4175510 0x7f29b41758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b99f3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b40cada0 0x7f29b40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b99f3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b417e680 con 0x7f29b417c950 2023-11-06T13:27:58.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b99f3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b417d4f0 con 0x7f29b40cada0 2023-11-06T13:27:58.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b99f3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b417d790 con 0x7f29b4175510 2023-11-06T13:27:58.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b40cada0 0x7f29b40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b40cada0 0x7f29b40cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43530/0 (socket says 172.21.15.38:43530) 2023-11-06T13:27:58.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 -- 172.21.15.38:0/1793317963 learned_addr learned my addr 172.21.15.38:0/1793317963 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:58.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b2ffd700 1 --2- 172.21.15.38:0/1793317963 >> v2:172.21.15.163:3300/0 conn(0x7f29b4175510 0x7f29b41758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 -- 172.21.15.38:0/1793317963 >> v2:172.21.15.163:3300/0 conn(0x7f29b4175510 msgr2=0x7f29b41758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 --2- 172.21.15.38:0/1793317963 >> v2:172.21.15.163:3300/0 conn(0x7f29b4175510 0x7f29b41758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 -- 172.21.15.38:0/1793317963 >> v1:172.21.15.44:6789/0 conn(0x7f29b417c950 legacy=0x7f29b417cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 -- 172.21.15.38:0/1793317963 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b417da70 con 0x7f29b40cada0 2023-11-06T13:27:58.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b27fc700 1 --2- 172.21.15.38:0/1793317963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b40cb200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f299c006fd0 tx=0x7f299c0090f0).ready entity=mon.0 client_cookie=d89a7005a3fae268 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b1ffb700 1 -- 172.21.15.38:0/1793317963 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00b520 con 0x7f29b40cada0 2023-11-06T13:27:58.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b1ffb700 1 -- 172.21.15.38:0/1793317963 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c00b680 con 0x7f29b40cada0 2023-11-06T13:27:58.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.897+0000 7f29b1ffb700 1 -- 172.21.15.38:0/1793317963 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00ba00 con 0x7f29b40cada0 2023-11-06T13:27:58.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 -- 172.21.15.38:0/1793317963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 msgr2=0x7f29b40cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 --2- 172.21.15.38:0/1793317963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b40cb200 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f299c006fd0 tx=0x7f299c0090f0).stop 2023-11-06T13:27:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 -- 172.21.15.38:0/1793317963 shutdown_connections 2023-11-06T13:27:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 --2- 172.21.15.38:0/1793317963 >> v2:172.21.15.163:3300/0 conn(0x7f29b4175510 0x7f29b41758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 --2- 172.21.15.38:0/1793317963 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b40cb200 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 -- 172.21.15.38:0/1793317963 >> 172.21.15.38:0/1793317963 conn(0x7f29b40f28b0 msgr2=0x7f29b4069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 -- 172.21.15.38:0/1793317963 shutdown_connections 2023-11-06T13:27:58.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.898+0000 7f29b99f3700 1 -- 172.21.15.38:0/1793317963 wait complete. 2023-11-06T13:27:58.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.899+0000 7f29b99f3700 1 Processor -- start 2023-11-06T13:27:58.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 -- start start 2023-11-06T13:27:58.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b4064d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b4175510 0x7f29b416e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417c950 0x7f29b4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ef4b0 con 0x7f29b40cada0 2023-11-06T13:27:58.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ed5e0 con 0x7f29b417c950 2023-11-06T13:27:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.900+0000 7f29b99f3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ec410 con 0x7f29b4175510 2023-11-06T13:27:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b4064d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b4064d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43542/0 (socket says 172.21.15.38:43542) 2023-11-06T13:27:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 -- 172.21.15.38:0/4169379074 learned_addr learned my addr 172.21.15.38:0/4169379074 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:58.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b27fc700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b4175510 0x7f29b416e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b37fe700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417c950 0x7f29b4062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 -- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b4175510 msgr2=0x7f29b416e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b4175510 0x7f29b416e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 -- 172.21.15.38:0/4169379074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417c950 msgr2=0x7f29b4062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:58.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417c950 0x7f29b4062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:58.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 -- 172.21.15.38:0/4169379074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c009370 con 0x7f29b40cada0 2023-11-06T13:27:58.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b27fc700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b4175510 0x7f29b416e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:27:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b2ffd700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b4064d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f29ac00e930 tx=0x7f29ac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00eed0 con 0x7f29b40cada0 2023-11-06T13:27:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac009510 con 0x7f29b40cada0 2023-11-06T13:27:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40ec6f0 con 0x7f29b40cada0 2023-11-06T13:27:58.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00ca60 con 0x7f29b40cada0 2023-11-06T13:27:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.901+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40eccb0 con 0x7f29b40cada0 2023-11-06T13:27:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.902+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40ed8c0 con 0x7f29b40cada0 2023-11-06T13:27:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.903+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f29ac01b400 con 0x7f29b40cada0 2023-11-06T13:27:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.903+0000 7f29aaffd700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cbd0 0x7f299408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:58.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.904+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f29ac0b2590 con 0x7f29b40cada0 2023-11-06T13:27:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.904+0000 7f29b27fc700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cbd0 0x7f299408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.904+0000 7f29b27fc700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cbd0 0x7f299408f090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f299c009130 tx=0x7f299c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:58.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:58.907+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f29ac082ad0 con 0x7f29b40cada0 2023-11-06T13:27:59.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.080+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29b406c580 con 0x7f29b40cada0 2023-11-06T13:27:59.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.081+0000 7f29aaffd700 1 -- 172.21.15.38:0/4169379074 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f29ac0860f0 con 0x7f29b40cada0 2023-11-06T13:27:59.085 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:59.085 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:27:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cbd0 msgr2=0x7f299408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cbd0 0x7f299408f090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f299c009130 tx=0x7f299c015000).stop 2023-11-06T13:27:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 msgr2=0x7f29b4064d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b4064d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f29ac00e930 tx=0x7f29ac009060).stop 2023-11-06T13:27:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 shutdown_connections 2023-11-06T13:27:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cbd0 0x7f299408f090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417c950 0x7f29b4062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.083+0000 7f29b99f3700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b40cada0 0x7f29b4064d50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.084+0000 7f29b99f3700 1 --2- 172.21.15.38:0/4169379074 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b4175510 0x7f29b416e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.084+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 >> 172.21.15.38:0/4169379074 conn(0x7f29b40f28b0 msgr2=0x7f29b40c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.084+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 shutdown_connections 2023-11-06T13:27:59.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.084+0000 7f29b99f3700 1 -- 172.21.15.38:0/4169379074 wait complete. 2023-11-06T13:27:59.099 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-06T13:27:59.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:27:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.214+0000 7fd8d46c7700 1 Processor -- start 2023-11-06T13:27:59.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.214+0000 7fd8d46c7700 1 -- start start 2023-11-06T13:27:59.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d46c7700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd8cc1756e0 0x7fd8cc0640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d46c7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc17d9d0 con 0x7fd8cc0645d0 2023-11-06T13:27:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d46c7700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc064a50 con 0x7fd8cc17e570 2023-11-06T13:27:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d46c7700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc0c8560 con 0x7fd8cc1756e0 2023-11-06T13:27:59.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1c62700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd8cc0645d0 0x7fd8cc17de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51744/0 (socket says 172.21.15.38:51744) 2023-11-06T13:27:59.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1c62700 1 -- 172.21.15.38:0/2218075018 learned_addr learned my addr 172.21.15.38:0/2218075018 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:59.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d2463700 1 --2- 172.21.15.38:0/2218075018 >> v2:172.21.15.163:3300/0 conn(0x7fd8cc1756e0 0x7fd8cc0640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166836074 0 0) 0x7fd8cc17d9d0 con 0x7fd8cc0645d0 2023-11-06T13:27:59.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b40033f0 con 0x7fd8cc0645d0 2023-11-06T13:27:59.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 136054512 0 0) 0x7fd8b40033f0 con 0x7fd8cc0645d0 2023-11-06T13:27:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 >> v2:172.21.15.163:3300/0 conn(0x7fd8cc1756e0 msgr2=0x7fd8cc0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 --2- 172.21.15.38:0/2218075018 >> v2:172.21.15.163:3300/0 conn(0x7fd8cc1756e0 0x7fd8cc0640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 >> v1:172.21.15.44:6789/0 conn(0x7fd8cc17e570 legacy=0x7fd8cc185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc17c800 con 0x7fd8cc0645d0 2023-11-06T13:27:59.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.216+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7fd8c0001470 con 0x7fd8cc0645d0 2023-11-06T13:27:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 >> v1:172.21.15.38:6789/0 conn(0x7fd8cc0645d0 legacy=0x7fd8cc17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8b40038e0 0x7fd8b4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4004690 0x7fd8b4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b4005000 0x7fd8b400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400be20 con 0x7fd8b4005000 2023-11-06T13:27:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400bf90 con 0x7fd8b4004690 2023-11-06T13:27:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b400c150 con 0x7fd8b40038e0 2023-11-06T13:27:59.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b4005000 0x7fd8b400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1c62700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4004690 0x7fd8b4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2463700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8b40038e0 0x7fd8b4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 -- 172.21.15.38:0/2218075018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8b40038e0 msgr2=0x7fd8b4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8b40038e0 0x7fd8b4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 -- 172.21.15.38:0/2218075018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4004690 msgr2=0x7fd8b4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:27:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4004690 0x7fd8b4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 -- 172.21.15.38:0/2218075018 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40033f0 con 0x7fd8b4005000 2023-11-06T13:27:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 -- 172.21.15.38:0/2218075018 reap_dead start 2023-11-06T13:27:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d2c64700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b4005000 0x7fd8b400b8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd8bc0017e0 tx=0x7fd8bc007b90).ready entity=mon.0 client_cookie=5828b8c55253da9e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc007ea0 con 0x7fd8b4005000 2023-11-06T13:27:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc012400 con 0x7fd8b4005000 2023-11-06T13:27:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.217+0000 7fd8d1461700 1 -- 172.21.15.38:0/2218075018 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc012780 con 0x7fd8b4005000 2023-11-06T13:27:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2218075018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b4005000 msgr2=0x7fd8b400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b4005000 0x7fd8b400b8e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd8bc0017e0 tx=0x7fd8bc007b90).stop 2023-11-06T13:27:59.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2218075018 shutdown_connections 2023-11-06T13:27:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2218075018 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8b4005000 0x7fd8b400b8e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2218075018 >> 172.21.15.38:0/2218075018 conn(0x7fd8cc069ea0 msgr2=0x7fd8cc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2218075018 shutdown_connections 2023-11-06T13:27:59.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.218+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2218075018 wait complete. 2023-11-06T13:27:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.219+0000 7fd8d46c7700 1 Processor -- start 2023-11-06T13:27:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.219+0000 7fd8d46c7700 1 -- start start 2023-11-06T13:27:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d46c7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005000 0x7fd8cc16ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d46c7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 0x7fd8cc183740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d46c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8cc16d700 0x7fd8cc16db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d46c7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1511f0 con 0x7fd8cc1832c0 2023-11-06T13:27:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d46c7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc183db0 con 0x7fd8b4005000 2023-11-06T13:27:59.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d46c7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc184090 con 0x7fd8cc16d700 2023-11-06T13:27:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d1c62700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 0x7fd8cc183740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d1c62700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 0x7fd8cc183740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43554/0 (socket says 172.21.15.38:43554) 2023-11-06T13:27:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.220+0000 7fd8d1c62700 1 -- 172.21.15.38:0/2111914576 learned_addr learned my addr 172.21.15.38:0/2111914576 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d2463700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005000 0x7fd8cc16ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d2c64700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8cc16d700 0x7fd8cc16db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d1c62700 1 -- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8cc16d700 msgr2=0x7fd8cc16db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d1c62700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8cc16d700 0x7fd8cc16db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d1c62700 1 -- 172.21.15.38:0/2111914576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005000 msgr2=0x7fd8cc16ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d1c62700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005000 0x7fd8cc16ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d1c62700 1 -- 172.21.15.38:0/2111914576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc184370 con 0x7fd8cc1832c0 2023-11-06T13:27:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d1c62700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 0x7fd8cc183740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd8c00077c0 tx=0x7fd8c0001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00114c0 con 0x7fd8cc1832c0 2023-11-06T13:27:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c0011620 con 0x7fd8cc1832c0 2023-11-06T13:27:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8cc184650 con 0x7fd8cc1832c0 2023-11-06T13:27:59.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00119a0 con 0x7fd8cc1832c0 2023-11-06T13:27:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.221+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc184c10 con 0x7fd8cc1832c0 2023-11-06T13:27:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.222+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc06c580 con 0x7fd8cc1832c0 2023-11-06T13:27:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.223+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fd8c0011d50 con 0x7fd8cc1832c0 2023-11-06T13:27:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.223+0000 7fd8ca7fc700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd8b808cbd0 0x7fd8b808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.224+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd8c00b17d0 con 0x7fd8cc1832c0 2023-11-06T13:27:59.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.224+0000 7fd8d2463700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd8b808cbd0 0x7fd8b808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.224+0000 7fd8d2463700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd8b808cbd0 0x7fd8b808f090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd8c4009fd0 tx=0x7fd8c400b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.228+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd8c0081d10 con 0x7fd8cc1832c0 2023-11-06T13:27:59.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.398+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8cc17cae0 con 0x7fd8b808cbd0 2023-11-06T13:27:59.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.412+0000 7fd8ca7fc700 1 -- 172.21.15.38:0/2111914576 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434838 (secure 0 0 0) 0x7fd8cc17cae0 con 0x7fd8b808cbd0 2023-11-06T13:27:59.420 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:59.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd8b808cbd0 msgr2=0x7fd8b808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd8b808cbd0 0x7fd8b808f090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd8c4009fd0 tx=0x7fd8c400b040).stop 2023-11-06T13:27:59.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 msgr2=0x7fd8cc183740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 0x7fd8cc183740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd8c00077c0 tx=0x7fd8c0001e70).stop 2023-11-06T13:27:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 shutdown_connections 2023-11-06T13:27:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8cc16d700 0x7fd8cc16db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd8b808cbd0 0x7fd8b808f090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8b4005000 0x7fd8cc16ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 --2- 172.21.15.38:0/2111914576 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd8cc1832c0 0x7fd8cc183740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 >> 172.21.15.38:0/2111914576 conn(0x7fd8cc069ea0 msgr2=0x7fd8cc171270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 shutdown_connections 2023-11-06T13:27:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.416+0000 7fd8d46c7700 1 -- 172.21.15.38:0/2111914576 wait complete. 2023-11-06T13:27:59.426 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:27:59.431 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-06T13:27:59.255534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45410,"num_objects":99,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":53,"num_read_kb":79,"num_write":226,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569532,"kb_used_data":4380,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892548,"statfs":{"total":1159641169920,"available":1155985969152,"internally_reserved":0,"allocated":4485120,"data_stored":2047680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43104,"num_objects":77,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":53,"num_read_kb":79,"num_write":181,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'22","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.263056+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:27:58.263056+0000","last_peered":"2023-11-06T13:27:58.263056+0000","last_clean":"2023-11-06T13:27:58.263056+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:27:58.263056+0000","last_undegraded":"2023-11-06T13:27:58.263056+0000","last_fullsized":"2023-11-06T13:27:58.263056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":37,"num_write":24,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.254724+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:27:58.254724+0000","last_peered":"2023-11-06T13:27:58.254724+0000","last_clean":"2023-11-06T13:27:58.254724+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:27:58.254724+0000","last_undegraded":"2023-11-06T13:27:58.254724+0000","last_fullsized":"2023-11-06T13:27:58.254724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.363654+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:27:56.363654+0000","last_peered":"2023-11-06T13:27:56.363654+0000","last_clean":"2023-11-06T13:27:56.363654+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:27:56.363654+0000","last_undegraded":"2023-11-06T13:27:56.363654+0000","last_fullsized":"2023-11-06T13:27:56.363654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.251204+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:27:57.251204+0000","last_peered":"2023-11-06T13:27:57.251204+0000","last_clean":"2023-11-06T13:27:57.251204+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:27:57.251204+0000","last_undegraded":"2023-11-06T13:27:57.251204+0000","last_fullsized":"2023-11-06T13:27:57.251204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261182+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:27:57.261182+0000","last_peered":"2023-11-06T13:27:57.261182+0000","last_clean":"2023-11-06T13:27:57.261182+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:27:57.261182+0000","last_undegraded":"2023-11-06T13:27:57.261182+0000","last_fullsized":"2023-11-06T13:27:57.261182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'7","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260630+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.260630+0000","last_peered":"2023-11-06T13:27:57.260630+0000","last_clean":"2023-11-06T13:27:57.260630+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.260630+0000","last_undegraded":"2023-11-06T13:27:57.260630+0000","last_fullsized":"2023-11-06T13:27:57.260630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.252086+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:27:58.252086+0000","last_peered":"2023-11-06T13:27:58.252086+0000","last_clean":"2023-11-06T13:27:58.252086+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:27:58.252086+0000","last_undegraded":"2023-11-06T13:27:58.252086+0000","last_fullsized":"2023-11-06T13:27:58.252086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.260594+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:27:58.260594+0000","last_peered":"2023-11-06T13:27:58.260594+0000","last_clean":"2023-11-06T13:27:58.260594+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:27:58.260594+0000","last_undegraded":"2023-11-06T13:27:58.260594+0000","last_fullsized":"2023-11-06T13:27:58.260594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.254609+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:27:57.254609+0000","last_peered":"2023-11-06T13:27:57.254609+0000","last_clean":"2023-11-06T13:27:57.254609+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:27:57.254609+0000","last_undegraded":"2023-11-06T13:27:57.254609+0000","last_fullsized":"2023-11-06T13:27:57.254609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.257139+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:27:57.257139+0000","last_peered":"2023-11-06T13:27:57.257139+0000","last_clean":"2023-11-06T13:27:57.257139+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:27:57.257139+0000","last_undegraded":"2023-11-06T13:27:57.257139+0000","last_fullsized":"2023-11-06T13:27:57.257139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.251717+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:27:58.251717+0000","last_peered":"2023-11-06T13:27:58.251717+0000","last_clean":"2023-11-06T13:27:58.251717+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:27:58.251717+0000","last_undegraded":"2023-11-06T13:27:58.251717+0000","last_fullsized":"2023-11-06T13:27:58.251717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":45164,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":53,"num_read_kb":79,"num_write":224,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":90328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":10,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":397312,"data_stored":203081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":0,"up_from":17,"seq":73014444039,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":161471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":3,"up_from":17,"seq":73014444040,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":162353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":442368,"data_stored":210323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":40964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:27:59.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:27:59.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.586+0000 7ffb1d3f9700 1 Processor -- start 2023-11-06T13:27:59.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.586+0000 7ffb1d3f9700 1 -- start start 2023-11-06T13:27:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb1d3f9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb18175510 0x7ffb181758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb1d3f9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1817e680 con 0x7ffb1817c950 2023-11-06T13:27:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb1d3f9700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1817d4f0 con 0x7ffb180cada0 2023-11-06T13:27:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb1d3f9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1817d790 con 0x7ffb18175510 2023-11-06T13:27:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb18175510 0x7ffb181758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb18175510 0x7ffb181758f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43568/0 (socket says 172.21.15.38:43568) 2023-11-06T13:27:59.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 -- 172.21.15.38:0/3651018635 learned_addr learned my addr 172.21.15.38:0/3651018635 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:59.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 -- 172.21.15.38:0/3651018635 >> v1:172.21.15.163:6789/0 conn(0x7ffb180cada0 legacy=0x7ffb180cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 -- 172.21.15.38:0/3651018635 >> v1:172.21.15.44:6789/0 conn(0x7ffb1817c950 legacy=0x7ffb1817cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 -- 172.21.15.38:0/3651018635 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1817da70 con 0x7ffb18175510 2023-11-06T13:27:59.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.587+0000 7ffb16ffd700 1 --2- 172.21.15.38:0/3651018635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb181758f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ffb08009f50 tx=0x7ffb08009840).ready entity=mon.0 client_cookie=e7393df2a142bee9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb15ffb700 1 -- 172.21.15.38:0/3651018635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800e070 con 0x7ffb18175510 2023-11-06T13:27:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb15ffb700 1 -- 172.21.15.38:0/3651018635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800ba70 con 0x7ffb18175510 2023-11-06T13:27:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb15ffb700 1 -- 172.21.15.38:0/3651018635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800bdf0 con 0x7ffb18175510 2023-11-06T13:27:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/3651018635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 msgr2=0x7ffb181758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/3651018635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb181758f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ffb08009f50 tx=0x7ffb08009840).stop 2023-11-06T13:27:59.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/3651018635 shutdown_connections 2023-11-06T13:27:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/3651018635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb181758f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/3651018635 >> 172.21.15.38:0/3651018635 conn(0x7ffb180f28b0 msgr2=0x7ffb18069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/3651018635 shutdown_connections 2023-11-06T13:27:59.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.588+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/3651018635 wait complete. 2023-11-06T13:27:59.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.590+0000 7ffb1d3f9700 1 Processor -- start 2023-11-06T13:27:59.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.590+0000 7ffb1d3f9700 1 -- start start 2023-11-06T13:27:59.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb180cada0 0x7ffb180f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb180f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb1817c950 0x7ffb1816fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18174a50 con 0x7ffb18175510 2023-11-06T13:27:59.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18176310 con 0x7ffb180cada0 2023-11-06T13:27:59.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb181741b0 con 0x7ffb1817c950 2023-11-06T13:27:59.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb180f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb180f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43576/0 (socket says 172.21.15.38:43576) 2023-11-06T13:27:59.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 -- 172.21.15.38:0/1610630276 learned_addr learned my addr 172.21.15.38:0/1610630276 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:59.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb16ffd700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb180cada0 0x7ffb180f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb177fe700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb1817c950 0x7ffb1816fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 -- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb1817c950 msgr2=0x7ffb1816fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb1817c950 0x7ffb1816fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 -- 172.21.15.38:0/1610630276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb180cada0 msgr2=0x7ffb180f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb180cada0 0x7ffb180f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 -- 172.21.15.38:0/1610630276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08009ae0 con 0x7ffb18175510 2023-11-06T13:27:59.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb167fc700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb180f13f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7ffb0000c440 tx=0x7ffb00007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00007020 con 0x7ffb18175510 2023-11-06T13:27:59.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00007180 con 0x7ffb18175510 2023-11-06T13:27:59.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb18174490 con 0x7ffb18175510 2023-11-06T13:27:59.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.591+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00007540 con 0x7ffb18175510 2023-11-06T13:27:59.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.592+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb18175fa0 con 0x7ffb18175510 2023-11-06T13:27:59.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.593+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb180832a0 con 0x7ffb18175510 2023-11-06T13:27:59.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.593+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ffb000068b0 con 0x7ffb18175510 2023-11-06T13:27:59.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.594+0000 7ffb0effd700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf808cbd0 0x7ffaf808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.594+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ffb000b12a0 con 0x7ffb18175510 2023-11-06T13:27:59.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.594+0000 7ffb16ffd700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf808cbd0 0x7ffaf808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.595+0000 7ffb16ffd700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf808cbd0 0x7ffaf808f090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ffb08009590 tx=0x7ffb1817d680).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.598+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ffb180832a0 con 0x7ffb18175510 2023-11-06T13:27:59.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.767+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb180832a0 con 0x7ffaf808cbd0 2023-11-06T13:27:59.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.780+0000 7ffb0effd700 1 -- 172.21.15.38:0/1610630276 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434838 (secure 0 0 0) 0x7ffb180832a0 con 0x7ffaf808cbd0 2023-11-06T13:27:59.788 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:27:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf808cbd0 msgr2=0x7ffaf808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf808cbd0 0x7ffaf808f090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ffb08009590 tx=0x7ffb1817d680).stop 2023-11-06T13:27:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 msgr2=0x7ffb180f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb180f13f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7ffb0000c440 tx=0x7ffb00007e00).stop 2023-11-06T13:27:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 shutdown_connections 2023-11-06T13:27:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb1817c950 0x7ffb1816fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf808cbd0 0x7ffaf808f090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb180cada0 0x7ffb180f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 --2- 172.21.15.38:0/1610630276 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb18175510 0x7ffb180f13f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 >> 172.21.15.38:0/1610630276 conn(0x7ffb180f28b0 msgr2=0x7ffb180cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:59.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 shutdown_connections 2023-11-06T13:27:59.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.784+0000 7ffb1d3f9700 1 -- 172.21.15.38:0/1610630276 wait complete. 2023-11-06T13:27:59.794 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:27:59.799 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-06T13:27:59.255534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45410,"num_objects":99,"num_object_clones":0,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":53,"num_read_kb":79,"num_write":226,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569532,"kb_used_data":4380,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892548,"statfs":{"total":1159641169920,"available":1155985969152,"internally_reserved":0,"allocated":4485120,"data_stored":2047680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43104,"num_objects":77,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":53,"num_read_kb":79,"num_write":181,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'22","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.263056+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:27:58.263056+0000","last_peered":"2023-11-06T13:27:58.263056+0000","last_clean":"2023-11-06T13:27:58.263056+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:27:58.263056+0000","last_undegraded":"2023-11-06T13:27:58.263056+0000","last_fullsized":"2023-11-06T13:27:58.263056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37230,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":37,"num_write":24,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.254724+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:27:58.254724+0000","last_peered":"2023-11-06T13:27:58.254724+0000","last_clean":"2023-11-06T13:27:58.254724+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:27:58.254724+0000","last_undegraded":"2023-11-06T13:27:58.254724+0000","last_fullsized":"2023-11-06T13:27:58.254724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.363654+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:27:56.363654+0000","last_peered":"2023-11-06T13:27:56.363654+0000","last_clean":"2023-11-06T13:27:56.363654+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:27:56.363654+0000","last_undegraded":"2023-11-06T13:27:56.363654+0000","last_fullsized":"2023-11-06T13:27:56.363654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.251204+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:27:57.251204+0000","last_peered":"2023-11-06T13:27:57.251204+0000","last_clean":"2023-11-06T13:27:57.251204+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:27:57.251204+0000","last_undegraded":"2023-11-06T13:27:57.251204+0000","last_fullsized":"2023-11-06T13:27:57.251204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261182+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:27:57.261182+0000","last_peered":"2023-11-06T13:27:57.261182+0000","last_clean":"2023-11-06T13:27:57.261182+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:27:57.261182+0000","last_undegraded":"2023-11-06T13:27:57.261182+0000","last_fullsized":"2023-11-06T13:27:57.261182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'7","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260630+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.260630+0000","last_peered":"2023-11-06T13:27:57.260630+0000","last_clean":"2023-11-06T13:27:57.260630+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.260630+0000","last_undegraded":"2023-11-06T13:27:57.260630+0000","last_fullsized":"2023-11-06T13:27:57.260630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.252086+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:27:58.252086+0000","last_peered":"2023-11-06T13:27:58.252086+0000","last_clean":"2023-11-06T13:27:58.252086+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:27:58.252086+0000","last_undegraded":"2023-11-06T13:27:58.252086+0000","last_fullsized":"2023-11-06T13:27:58.252086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.260594+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:27:58.260594+0000","last_peered":"2023-11-06T13:27:58.260594+0000","last_clean":"2023-11-06T13:27:58.260594+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:27:58.260594+0000","last_undegraded":"2023-11-06T13:27:58.260594+0000","last_fullsized":"2023-11-06T13:27:58.260594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.254609+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:27:57.254609+0000","last_peered":"2023-11-06T13:27:57.254609+0000","last_clean":"2023-11-06T13:27:57.254609+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:27:57.254609+0000","last_undegraded":"2023-11-06T13:27:57.254609+0000","last_fullsized":"2023-11-06T13:27:57.254609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.257139+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:27:57.257139+0000","last_peered":"2023-11-06T13:27:57.257139+0000","last_clean":"2023-11-06T13:27:57.257139+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:27:57.257139+0000","last_undegraded":"2023-11-06T13:27:57.257139+0000","last_fullsized":"2023-11-06T13:27:57.257139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:58.251717+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:27:58.251717+0000","last_peered":"2023-11-06T13:27:58.251717+0000","last_clean":"2023-11-06T13:27:58.251717+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:27:58.251717+0000","last_undegraded":"2023-11-06T13:27:58.251717+0000","last_fullsized":"2023-11-06T13:27:58.251717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":45164,"num_objects":97,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":53,"num_read_kb":79,"num_write":224,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":90328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]}]},{"osd":10,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":397312,"data_stored":203081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":8,"up_from":17,"seq":73014444038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":0,"up_from":17,"seq":73014444039,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":161471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":3,"up_from":17,"seq":73014444040,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":162353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297528,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074312,"statfs":{"total":96636764160,"available":96332095488,"internally_reserved":0,"allocated":442368,"data_stored":210323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":40964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:27:59.809 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-06T13:27:59.809 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-06T13:27:59.809 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-06T13:27:59.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-06T13:27:59.810 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-06T13:27:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.956+0000 7fc826056700 1 Processor -- start 2023-11-06T13:27:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.956+0000 7fc826056700 1 -- start start 2023-11-06T13:27:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc826056700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8201756e0 0x7fc8200640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc826056700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82017d9d0 con 0x7fc82017e570 2023-11-06T13:27:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc826056700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc820064a50 con 0x7fc8200645d0 2023-11-06T13:27:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc826056700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200c8560 con 0x7fc8201756e0 2023-11-06T13:27:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc81effd700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fc8200645d0 0x7fc82017de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:35002/0 (socket says 172.21.15.38:35002) 2023-11-06T13:27:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc81effd700 1 -- 172.21.15.38:0/3017016630 learned_addr learned my addr 172.21.15.38:0/3017016630 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:27:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.957+0000 7fc81f7fe700 1 --2- 172.21.15.38:0/3017016630 >> v2:172.21.15.44:3300/0 conn(0x7fc8201756e0 0x7fc8200640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618364683 0 0) 0x7fc820064a50 con 0x7fc8200645d0 2023-11-06T13:27:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8080033f0 con 0x7fc8200645d0 2023-11-06T13:27:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036707713 0 0) 0x7fc82017d9d0 con 0x7fc82017e570 2023-11-06T13:27:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc820064a50 con 0x7fc82017e570 2023-11-06T13:27:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81f7fe700 1 -- 172.21.15.38:0/3017016630 >> v1:172.21.15.163:6789/0 conn(0x7fc8200645d0 legacy=0x7fc82017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81f7fe700 1 -- 172.21.15.38:0/3017016630 >> v1:172.21.15.44:6789/0 conn(0x7fc82017e570 legacy=0x7fc820185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81f7fe700 1 -- 172.21.15.38:0/3017016630 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82017c800 con 0x7fc8201756e0 2023-11-06T13:27:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81f7fe700 1 --2- 172.21.15.38:0/3017016630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8201756e0 0x7fc8200640e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc810009760 tx=0x7fc810009060).ready entity=mon.1 client_cookie=e1858c7e0782cfe3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000d4a0 con 0x7fc8201756e0 2023-11-06T13:27:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81000d600 con 0x7fc8201756e0 2023-11-06T13:27:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.958+0000 7fc81e7fc700 1 -- 172.21.15.38:0/3017016630 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000d980 con 0x7fc8201756e0 2023-11-06T13:27:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 -- 172.21.15.38:0/3017016630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8201756e0 msgr2=0x7fc8200640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 --2- 172.21.15.38:0/3017016630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8201756e0 0x7fc8200640e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc810009760 tx=0x7fc810009060).stop 2023-11-06T13:27:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 -- 172.21.15.38:0/3017016630 shutdown_connections 2023-11-06T13:27:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 --2- 172.21.15.38:0/3017016630 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8201756e0 0x7fc8200640e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 -- 172.21.15.38:0/3017016630 >> 172.21.15.38:0/3017016630 conn(0x7fc820069ea0 msgr2=0x7fc82006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:27:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 -- 172.21.15.38:0/3017016630 shutdown_connections 2023-11-06T13:27:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.959+0000 7fc826056700 1 -- 172.21.15.38:0/3017016630 wait complete. 2023-11-06T13:27:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.960+0000 7fc826056700 1 Processor -- start 2023-11-06T13:27:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.960+0000 7fc826056700 1 -- start start 2023-11-06T13:27:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc826056700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200645d0 0x7fc8200efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc826056700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8201756e0 0x7fc8200c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc826056700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 0x7fc82016e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc826056700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200f0190 con 0x7fc82017e570 2023-11-06T13:27:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc826056700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc820174030 con 0x7fc8200645d0 2023-11-06T13:27:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc826056700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200c8b40 con 0x7fc8201756e0 2023-11-06T13:27:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc81ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 0x7fc82016e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.961+0000 7fc81ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 0x7fc82016e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43582/0 (socket says 172.21.15.38:43582) 2023-11-06T13:27:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 -- 172.21.15.38:0/3247225885 learned_addr learned my addr 172.21.15.38:0/3247225885 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:27:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81effd700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8201756e0 0x7fc8200c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81f7fe700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200645d0 0x7fc8200efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 -- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8201756e0 msgr2=0x7fc8200c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8201756e0 0x7fc8200c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 -- 172.21.15.38:0/3247225885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200645d0 msgr2=0x7fc8200efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:27:59.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200645d0 0x7fc8200efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:27:59.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 -- 172.21.15.38:0/3247225885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100092a0 con 0x7fc82017e570 2023-11-06T13:27:59.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc81ffff700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 0x7fc82016e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc81800c7c0 tx=0x7fc81800cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818002240 con 0x7fc82017e570 2023-11-06T13:27:59.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8180023a0 con 0x7fc82017e570 2023-11-06T13:27:59.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8200c8e20 con 0x7fc82017e570 2023-11-06T13:27:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8180017e0 con 0x7fc82017e570 2023-11-06T13:27:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.962+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8200c93e0 con 0x7fc82017e570 2023-11-06T13:27:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.963+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82006c580 con 0x7fc82017e570 2023-11-06T13:27:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.964+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fc818001bd0 con 0x7fc82017e570 2023-11-06T13:27:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.964+0000 7fc8077fe700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc80c08cbd0 0x7fc80c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:27:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.965+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc8180b1670 con 0x7fc82017e570 2023-11-06T13:27:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.965+0000 7fc81f7fe700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc80c08cbd0 0x7fc80c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:27:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.965+0000 7fc81f7fe700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc80c08cbd0 0x7fc80c08f090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc810006d60 tx=0x7fc810016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:27:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:27:59.968+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc818081bb0 con 0x7fc82017e570 2023-11-06T13:28:00.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.189+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc82017cae0 con 0x7fc82017e570 2023-11-06T13:28:00.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.194+0000 7fc8077fe700 1 -- 172.21.15.38:0/3247225885 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+223037 (secure 0 0 0) 0x7fc818017030 con 0x7fc82017e570 2023-11-06T13:28:00.199 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:00.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc80c08cbd0 msgr2=0x7fc80c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc80c08cbd0 0x7fc80c08f090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc810006d60 tx=0x7fc810016000).stop 2023-11-06T13:28:00.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 msgr2=0x7fc82016e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 0x7fc82016e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fc81800c7c0 tx=0x7fc81800cad0).stop 2023-11-06T13:28:00.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 shutdown_connections 2023-11-06T13:28:00.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc82017e570 0x7fc82016e840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc80c08cbd0 0x7fc80c08f090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8200645d0 0x7fc8200efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 --2- 172.21.15.38:0/3247225885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8201756e0 0x7fc8200c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.196+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 >> 172.21.15.38:0/3247225885 conn(0x7fc820069ea0 msgr2=0x7fc82017f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:00.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.197+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 shutdown_connections 2023-11-06T13:28:00.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.197+0000 7fc826056700 1 -- 172.21.15.38:0/3247225885 wait complete. 2023-11-06T13:28:00.211 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":5,"active_gid":4103,"active_name":"z","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":91073},{"type":"v1","addr":"172.21.15.163:6833","nonce":91073}]},"active_addr":"172.21.15.163:6833/91073","active_change":"2023-11-06T13:27:27.241694+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4111,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":1605217629}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":3979379500}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":1263918925}]}]} 2023-11-06T13:28:00.217 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-06T13:28:00.217 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-06T13:28:00.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:00.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.368+0000 7f5fd60a0700 1 Processor -- start 2023-11-06T13:28:00.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.368+0000 7f5fd60a0700 1 -- start start 2023-11-06T13:28:00.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.369+0000 7f5fd60a0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5fd0063780 0x7f5fd00c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.369+0000 7f5fd60a0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00e9b90 con 0x7f5fd017b090 2023-11-06T13:28:00.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.369+0000 7f5fd60a0700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00ca260 con 0x7f5fd0064270 2023-11-06T13:28:00.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.369+0000 7f5fd60a0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00c9ca0 con 0x7f5fd0063780 2023-11-06T13:28:00.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.369+0000 7f5fceffd700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f5fd0064270 0x7f5fd00c8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:35016/0 (socket says 172.21.15.38:35016) 2023-11-06T13:28:00.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.369+0000 7f5fceffd700 1 -- 172.21.15.38:0/3092916773 learned_addr learned my addr 172.21.15.38:0/3092916773 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:00.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fcffff700 1 --2- 172.21.15.38:0/3092916773 >> v2:172.21.15.44:3300/0 conn(0x7f5fd0063780 0x7f5fd00c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577528887 0 0) 0x7f5fd00ca260 con 0x7f5fd0064270 2023-11-06T13:28:00.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb80033f0 con 0x7f5fd0064270 2023-11-06T13:28:00.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563076280 0 0) 0x7f5fd00e9b90 con 0x7f5fd017b090 2023-11-06T13:28:00.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd00ca260 con 0x7f5fd017b090 2023-11-06T13:28:00.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fcffff700 1 -- 172.21.15.38:0/3092916773 >> v1:172.21.15.163:6789/0 conn(0x7f5fd0064270 legacy=0x7f5fd00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 <== mon.2 v1:172.21.15.163:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4003063712 0 0) 0x7f5fb80033f0 con 0x7f5fd0064270 2023-11-06T13:28:00.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fcffff700 1 -- 172.21.15.38:0/3092916773 >> v1:172.21.15.44:6789/0 conn(0x7f5fd017b090 legacy=0x7f5fd00c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fcffff700 1 -- 172.21.15.38:0/3092916773 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00c9f80 con 0x7f5fd0063780 2023-11-06T13:28:00.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fcffff700 1 --2- 172.21.15.38:0/3092916773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd0063780 0x7f5fd00c9620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5fc8009de0 tx=0x7f5fc8009780).ready entity=mon.1 client_cookie=4cb3892c8b18c1a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:00.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc800e070 con 0x7f5fd0063780 2023-11-06T13:28:00.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc800b820 con 0x7f5fd0063780 2023-11-06T13:28:00.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.370+0000 7f5fce7fc700 1 -- 172.21.15.38:0/3092916773 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4001470 con 0x7f5fd0063780 2023-11-06T13:28:00.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3092916773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd0063780 msgr2=0x7f5fd00c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3092916773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd0063780 0x7f5fd00c9620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5fc8009de0 tx=0x7f5fc8009780).stop 2023-11-06T13:28:00.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3092916773 shutdown_connections 2023-11-06T13:28:00.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3092916773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd0063780 0x7f5fd00c9620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3092916773 >> 172.21.15.38:0/3092916773 conn(0x7f5fd005e1b0 msgr2=0x7f5fd005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:00.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3092916773 shutdown_connections 2023-11-06T13:28:00.379 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.371+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3092916773 wait complete. 2023-11-06T13:28:00.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.372+0000 7f5fd60a0700 1 Processor -- start 2023-11-06T13:28:00.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.372+0000 7f5fd60a0700 1 -- start start 2023-11-06T13:28:00.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fd60a0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fd0063780 0x7f5fd00ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fd60a0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 0x7f5fd01537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fd60a0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd017b090 0x7f5fd01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fd60a0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0154420 con 0x7f5fd0064270 2023-11-06T13:28:00.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fd60a0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00eaf20 con 0x7f5fd017b090 2023-11-06T13:28:00.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fd60a0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd00eb200 con 0x7f5fd0063780 2023-11-06T13:28:00.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fceffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 0x7f5fd01537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fceffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 0x7f5fd01537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43586/0 (socket says 172.21.15.38:43586) 2023-11-06T13:28:00.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.373+0000 7f5fceffd700 1 -- 172.21.15.38:0/3260463180 learned_addr learned my addr 172.21.15.38:0/3260463180 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:00.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fcffff700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd017b090 0x7f5fd01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fcf7fe700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fd0063780 0x7f5fd00ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fceffd700 1 -- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fd0063780 msgr2=0x7f5fd00ea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fceffd700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fd0063780 0x7f5fd00ea5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fceffd700 1 -- 172.21.15.38:0/3260463180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd017b090 msgr2=0x7f5fd01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fceffd700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd017b090 0x7f5fd01548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fceffd700 1 -- 172.21.15.38:0/3260463180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8009a20 con 0x7f5fd0064270 2023-11-06T13:28:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fcffff700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd017b090 0x7f5fd01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fceffd700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 0x7f5fd01537c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f5fc400c800 tx=0x7f5fc4001b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4007170 con 0x7f5fd0064270 2023-11-06T13:28:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40072d0 con 0x7f5fd0064270 2023-11-06T13:28:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd00eb4e0 con 0x7f5fd0064270 2023-11-06T13:28:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40048c0 con 0x7f5fd0064270 2023-11-06T13:28:00.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.374+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd00ebaa0 con 0x7f5fd0064270 2023-11-06T13:28:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.375+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd0154590 con 0x7f5fd0064270 2023-11-06T13:28:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.376+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f5fc4004cb0 con 0x7f5fd0064270 2023-11-06T13:28:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.376+0000 7f5fb77fe700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5fbc08cbd0 0x7f5fbc08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.376+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f5fc40b1dc0 con 0x7f5fd0064270 2023-11-06T13:28:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.377+0000 7f5fcf7fe700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5fbc08cbd0 0x7f5fbc08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.377+0000 7f5fcf7fe700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5fbc08cbd0 0x7f5fbc08f090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5fc0000c00 tx=0x7f5fc0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.380+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5fc4082300 con 0x7f5fd0064270 2023-11-06T13:28:00.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.558+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fd00e9540 con 0x7f5fd0064270 2023-11-06T13:28:00.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.559+0000 7f5fb77fe700 1 -- 172.21.15.38:0/3260463180 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f5fc4019020 con 0x7f5fd0064270 2023-11-06T13:28:00.563 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:00.563 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:00.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5fbc08cbd0 msgr2=0x7f5fbc08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5fbc08cbd0 0x7f5fbc08f090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5fc0000c00 tx=0x7f5fc0009040).stop 2023-11-06T13:28:00.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 msgr2=0x7f5fd01537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 0x7f5fd01537c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f5fc400c800 tx=0x7f5fc4001b00).stop 2023-11-06T13:28:00.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 shutdown_connections 2023-11-06T13:28:00.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5fbc08cbd0 0x7f5fbc08f090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fd017b090 0x7f5fd01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fd0063780 0x7f5fd00ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 --2- 172.21.15.38:0/3260463180 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5fd0064270 0x7f5fd01537c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 >> 172.21.15.38:0/3260463180 conn(0x7f5fd005e1b0 msgr2=0x7f5fd01746f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 shutdown_connections 2023-11-06T13:28:00.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.561+0000 7f5fd60a0700 1 -- 172.21.15.38:0/3260463180 wait complete. 2023-11-06T13:28:00.577 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-06T13:28:00.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:00.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.692+0000 7f44d9751700 1 Processor -- start 2023-11-06T13:28:00.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.692+0000 7f44d9751700 1 -- start start 2023-11-06T13:28:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d9751700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f44d41756e0 0x7f44d40640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d9751700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44d417e570 0x7f44d4185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d9751700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d417d9d0 con 0x7f44d40645d0 2023-11-06T13:28:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d9751700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d40c8560 con 0x7f44d417e570 2023-11-06T13:28:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d9751700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d4064a50 con 0x7f44d41756e0 2023-11-06T13:28:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d2ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f44d41756e0 0x7f44d40640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.693+0000 7f44d37fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f44d417e570 0x7f44d4185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f44d41756e0 0x7f44d40640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36702/0 (socket says 172.21.15.38:36702) 2023-11-06T13:28:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 -- 172.21.15.38:0/2264891911 learned_addr learned my addr 172.21.15.38:0/2264891911 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 -- 172.21.15.38:0/2264891911 >> v2:172.21.15.44:3300/0 conn(0x7f44d417e570 msgr2=0x7f44d4185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 --2- 172.21.15.38:0/2264891911 >> v2:172.21.15.44:3300/0 conn(0x7f44d417e570 0x7f44d4185580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 -- 172.21.15.38:0/2264891911 >> v1:172.21.15.163:6789/0 conn(0x7f44d40645d0 legacy=0x7f44d417de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d1ffb700 1 -- 172.21.15.38:0/2264891911 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477920934 0 0) 0x7f44d417d9d0 con 0x7f44d40645d0 2023-11-06T13:28:00.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 -- 172.21.15.38:0/2264891911 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d417c800 con 0x7f44d41756e0 2023-11-06T13:28:00.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d37fe700 1 --2- 172.21.15.38:0/2264891911 >> v2:172.21.15.44:3300/0 conn(0x7f44d417e570 0x7f44d4185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:00.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d2ffd700 1 --2- 172.21.15.38:0/2264891911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d40640e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f44d40ce060 tx=0x7f44cc0090f0).ready entity=mon.2 client_cookie=be67cb5ea71536f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:00.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d1ffb700 1 -- 172.21.15.38:0/2264891911 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00b520 con 0x7f44d41756e0 2023-11-06T13:28:00.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d1ffb700 1 -- 172.21.15.38:0/2264891911 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc00b680 con 0x7f44d41756e0 2023-11-06T13:28:00.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.694+0000 7f44d1ffb700 1 -- 172.21.15.38:0/2264891911 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00ba00 con 0x7f44d41756e0 2023-11-06T13:28:00.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 -- 172.21.15.38:0/2264891911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 msgr2=0x7f44d40640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 --2- 172.21.15.38:0/2264891911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d40640e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f44d40ce060 tx=0x7f44cc0090f0).stop 2023-11-06T13:28:00.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 -- 172.21.15.38:0/2264891911 shutdown_connections 2023-11-06T13:28:00.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 --2- 172.21.15.38:0/2264891911 >> v2:172.21.15.44:3300/0 conn(0x7f44d417e570 0x7f44d4185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 --2- 172.21.15.38:0/2264891911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d40640e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 -- 172.21.15.38:0/2264891911 >> 172.21.15.38:0/2264891911 conn(0x7f44d4069ea0 msgr2=0x7f44d406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 -- 172.21.15.38:0/2264891911 shutdown_connections 2023-11-06T13:28:00.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.695+0000 7f44d9751700 1 -- 172.21.15.38:0/2264891911 wait complete. 2023-11-06T13:28:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.696+0000 7f44d9751700 1 Processor -- start 2023-11-06T13:28:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.696+0000 7f44d9751700 1 -- start start 2023-11-06T13:28:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d9751700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44d40645d0 0x7f44d40c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d9751700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d41777e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d9751700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 0x7f44d4165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d9751700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d4177350 con 0x7f44d417e570 2023-11-06T13:28:00.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d9751700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40c4f30 con 0x7f44d40645d0 2023-11-06T13:28:00.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d9751700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d4176460 con 0x7f44d41756e0 2023-11-06T13:28:00.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 0x7f44d4165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 0x7f44d4165ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43588/0 (socket says 172.21.15.38:43588) 2023-11-06T13:28:00.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.697+0000 7f44d37fe700 1 -- 172.21.15.38:0/1367665507 learned_addr learned my addr 172.21.15.38:0/1367665507 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:00.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d2ffd700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44d40645d0 0x7f44d40c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d27fc700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d41777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d37fe700 1 -- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 msgr2=0x7f44d41777e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d37fe700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d41777e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d37fe700 1 -- 172.21.15.38:0/1367665507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44d40645d0 msgr2=0x7f44d40c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d37fe700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44d40645d0 0x7f44d40c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d37fe700 1 -- 172.21.15.38:0/1367665507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4009a20 con 0x7f44d417e570 2023-11-06T13:28:00.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d2ffd700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44d40645d0 0x7f44d40c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:00.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d37fe700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 0x7f44d4165ed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f44c4009f20 tx=0x7f44c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:00.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c400cb70 con 0x7f44d417e570 2023-11-06T13:28:00.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c400f040 con 0x7f44d417e570 2023-11-06T13:28:00.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44cc009370 con 0x7f44d417e570 2023-11-06T13:28:00.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4013400 con 0x7f44d417e570 2023-11-06T13:28:00.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.698+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d4176a20 con 0x7f44d417e570 2023-11-06T13:28:00.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.699+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d41774c0 con 0x7f44d417e570 2023-11-06T13:28:00.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.700+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f44c40137f0 con 0x7f44d417e570 2023-11-06T13:28:00.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.701+0000 7f44caffd700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f44b408cbd0 0x7f44b408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:00.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.701+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f44c40b3390 con 0x7f44d417e570 2023-11-06T13:28:00.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.701+0000 7f44d2ffd700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f44b408cbd0 0x7f44b408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:00.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.701+0000 7f44d2ffd700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f44b408cbd0 0x7f44b408f090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f44cc009130 tx=0x7f44cc017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:00.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.704+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f44c40838d0 con 0x7f44d417e570 2023-11-06T13:28:00.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.874+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44d406c580 con 0x7f44d417e570 2023-11-06T13:28:00.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.875+0000 7f44caffd700 1 -- 172.21.15.38:0/1367665507 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f44c4086ef0 con 0x7f44d417e570 2023-11-06T13:28:00.879 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:00.879 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:00.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f44b408cbd0 msgr2=0x7f44b408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f44b408cbd0 0x7f44b408f090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f44cc009130 tx=0x7f44cc017000).stop 2023-11-06T13:28:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 msgr2=0x7f44d4165ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 0x7f44d4165ed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f44c4009f20 tx=0x7f44c400b040).stop 2023-11-06T13:28:00.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 shutdown_connections 2023-11-06T13:28:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f44d417e570 0x7f44d4165ed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f44b408cbd0 0x7f44b408f090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44d40645d0 0x7f44d40c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 --2- 172.21.15.38:0/1367665507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44d41756e0 0x7f44d41777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 >> 172.21.15.38:0/1367665507 conn(0x7f44d4069ea0 msgr2=0x7f44d40cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 shutdown_connections 2023-11-06T13:28:00.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:00.877+0000 7f44d9751700 1 -- 172.21.15.38:0/1367665507 wait complete. 2023-11-06T13:28:00.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-06T13:28:01.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.010+0000 7f08f999a700 1 Processor -- start 2023-11-06T13:28:01.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.010+0000 7f08f999a700 1 -- start start 2023-11-06T13:28:01.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.011+0000 7f08f999a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f08f40c2a40 0x7f08f40c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.011+0000 7f08f999a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f417fe80 con 0x7f08f417e320 2023-11-06T13:28:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.011+0000 7f08f999a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f40c6540 con 0x7f08f40c2590 2023-11-06T13:28:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.011+0000 7f08f999a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f40c4c40 con 0x7f08f40c2a40 2023-11-06T13:28:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f2ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f08f417e320 0x7f08f40c4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51752/0 (socket says 172.21.15.38:51752) 2023-11-06T13:28:01.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f2ffd700 1 -- 172.21.15.38:0/2400092503 learned_addr learned my addr 172.21.15.38:0/2400092503 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f37fe700 1 --2- 172.21.15.38:0/2400092503 >> v2:172.21.15.44:3300/0 conn(0x7f08f40c2a40 0x7f08f40c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f1ffb700 1 -- 172.21.15.38:0/2400092503 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517771282 0 0) 0x7f08f417fe80 con 0x7f08f417e320 2023-11-06T13:28:01.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f1ffb700 1 -- 172.21.15.38:0/2400092503 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e00033f0 con 0x7f08f417e320 2023-11-06T13:28:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f37fe700 1 -- 172.21.15.38:0/2400092503 >> v1:172.21.15.44:6789/0 conn(0x7f08f40c2590 legacy=0x7f08f406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f37fe700 1 -- 172.21.15.38:0/2400092503 >> v1:172.21.15.38:6789/0 conn(0x7f08f417e320 legacy=0x7f08f40c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f37fe700 1 -- 172.21.15.38:0/2400092503 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40c2fb0 con 0x7f08f40c2a40 2023-11-06T13:28:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f37fe700 1 --2- 172.21.15.38:0/2400092503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f40c2a40 0x7f08f40c69d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f08e4009760 tx=0x7f08e4009060).ready entity=mon.1 client_cookie=44b077922835a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f1ffb700 1 -- 172.21.15.38:0/2400092503 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400f510 con 0x7f08f40c2a40 2023-11-06T13:28:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f1ffb700 1 -- 172.21.15.38:0/2400092503 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400f670 con 0x7f08f40c2a40 2023-11-06T13:28:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.012+0000 7f08f1ffb700 1 -- 172.21.15.38:0/2400092503 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400f9f0 con 0x7f08f40c2a40 2023-11-06T13:28:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 -- 172.21.15.38:0/2400092503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f40c2a40 msgr2=0x7f08f40c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 --2- 172.21.15.38:0/2400092503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f40c2a40 0x7f08f40c69d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f08e4009760 tx=0x7f08e4009060).stop 2023-11-06T13:28:01.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 -- 172.21.15.38:0/2400092503 shutdown_connections 2023-11-06T13:28:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 --2- 172.21.15.38:0/2400092503 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f40c2a40 0x7f08f40c69d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 -- 172.21.15.38:0/2400092503 >> 172.21.15.38:0/2400092503 conn(0x7f08f405e1b0 msgr2=0x7f08f405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 -- 172.21.15.38:0/2400092503 shutdown_connections 2023-11-06T13:28:01.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.013+0000 7f08f999a700 1 -- 172.21.15.38:0/2400092503 wait complete. 2023-11-06T13:28:01.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.014+0000 7f08f999a700 1 Processor -- start 2023-11-06T13:28:01.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.014+0000 7f08f999a700 1 -- start start 2023-11-06T13:28:01.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f999a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08f40c2590 0x7f08f40e6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f999a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f40c2a40 0x7f08f40e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f999a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f417e320 0x7f08f40840d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f999a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40e8770 con 0x7f08f40c2590 2023-11-06T13:28:01.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f999a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40e62f0 con 0x7f08f417e320 2023-11-06T13:28:01.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f999a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40e6c70 con 0x7f08f40c2a40 2023-11-06T13:28:01.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.015+0000 7f08f2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08f40c2590 0x7f08f40e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08f40c2590 0x7f08f40e6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43600/0 (socket says 172.21.15.38:43600) 2023-11-06T13:28:01.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 -- 172.21.15.38:0/4076411760 learned_addr learned my addr 172.21.15.38:0/4076411760 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f37fe700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f417e320 0x7f08f40840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f27fc700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f40c2a40 0x7f08f40e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 -- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f40c2a40 msgr2=0x7f08f40e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f40c2a40 0x7f08f40e8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 -- 172.21.15.38:0/4076411760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f417e320 msgr2=0x7f08f40840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f417e320 0x7f08f40840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 -- 172.21.15.38:0/4076411760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40092a0 con 0x7f08f40c2590 2023-11-06T13:28:01.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f27fc700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f08f40c2a40 0x7f08f40e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:01.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f2ffd700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08f40c2590 0x7f08f40e6780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f08ec00c940 tx=0x7f08ec001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec005d30 con 0x7f08f40c2590 2023-11-06T13:28:01.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec005e90 con 0x7f08f40c2590 2023-11-06T13:28:01.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f40e8490 con 0x7f08f40c2590 2023-11-06T13:28:01.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec007320 con 0x7f08f40c2590 2023-11-06T13:28:01.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.016+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f40e5ca0 con 0x7f08f40c2590 2023-11-06T13:28:01.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.017+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08f40475a0 con 0x7f08f40c2590 2023-11-06T13:28:01.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.018+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f08ec0076d0 con 0x7f08f40c2590 2023-11-06T13:28:01.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.018+0000 7f08eaffd700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f08d408cbd0 0x7f08d408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.018+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f08ec0b2210 con 0x7f08f40c2590 2023-11-06T13:28:01.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08eaffd700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] conn(0x7f08d40985b0 0x7f08d409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 --> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08d409b0d0 con 0x7f08d40985b0 2023-11-06T13:28:01.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08ec0b4720 con 0x7f08f40c2590 2023-11-06T13:28:01.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08f27fc700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f08d408cbd0 0x7f08d408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08f37fe700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] conn(0x7f08d40985b0 0x7f08d409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08f37fe700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] conn(0x7f08d40985b0 0x7f08d409aa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.019+0000 7f08f27fc700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f08d408cbd0 0x7f08d408f090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f08dc000c00 tx=0x7f08dc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.020+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== osd.0 v2:172.21.15.38:6809/91141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f08d409b0d0 con 0x7f08d40985b0 2023-11-06T13:28:01.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.034+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 --> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f08f40e65d0 con 0x7f08d40985b0 2023-11-06T13:28:01.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.034+0000 7f08eaffd700 1 -- 172.21.15.38:0/4076411760 <== osd.0 v2:172.21.15.38:6809/91141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f08f40e65d0 con 0x7f08d40985b0 2023-11-06T13:28:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.034+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] conn(0x7f08d40985b0 msgr2=0x7f08d409aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.034+0000 7f08f999a700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:6809/91141,v1:172.21.15.38:6810/91141] conn(0x7f08d40985b0 0x7f08d409aa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f08d408cbd0 msgr2=0x7f08d408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f08d408cbd0 0x7f08d408f090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f08dc000c00 tx=0x7f08dc009040).stop 2023-11-06T13:28:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08f40c2590 msgr2=0x7f08f40e6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 --2- 172.21.15.38:0/4076411760 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f08f40c2590 0x7f08f40e6780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f08ec00c940 tx=0x7f08ec001650).stop 2023-11-06T13:28:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f37fe700 1 -- 172.21.15.38:0/4076411760 reap_dead start 2023-11-06T13:28:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 shutdown_connections 2023-11-06T13:28:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 >> 172.21.15.38:0/4076411760 conn(0x7f08f405e1b0 msgr2=0x7f08f405e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 shutdown_connections 2023-11-06T13:28:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.035+0000 7f08f999a700 1 -- 172.21.15.38:0/4076411760 wait complete. 2023-11-06T13:28:01.049 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:01.050 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-06T13:28:01.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.165+0000 7fd5f94a5700 1 Processor -- start 2023-11-06T13:28:01.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.165+0000 7fd5f94a5700 1 -- start start 2023-11-06T13:28:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.166+0000 7fd5f94a5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd5f417e8a0 0x7fd5f4180d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.166+0000 7fd5f94a5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd5f4181220 0x7fd5f40eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.166+0000 7fd5f94a5700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f41808a0 con 0x7fd5f417e4c0 2023-11-06T13:28:01.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.166+0000 7fd5f94a5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f40edcb0 con 0x7fd5f4181220 2023-11-06T13:28:01.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.166+0000 7fd5f94a5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f40edf90 con 0x7fd5f417e8a0 2023-11-06T13:28:01.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f2ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd5f417e4c0 0x7fd5f417f5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51764/0 (socket says 172.21.15.38:51764) 2023-11-06T13:28:01.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f2ffd700 1 -- 172.21.15.38:0/2437728983 learned_addr learned my addr 172.21.15.38:0/2437728983 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:01.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f37fe700 1 --2- 172.21.15.38:0/2437728983 >> v2:172.21.15.38:3300/0 conn(0x7fd5f4181220 0x7fd5f40eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f27fc700 1 --2- 172.21.15.38:0/2437728983 >> v2:172.21.15.163:3300/0 conn(0x7fd5f417e8a0 0x7fd5f4180d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f1ffb700 1 -- 172.21.15.38:0/2437728983 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198163695 0 0) 0x7fd5f41808a0 con 0x7fd5f417e4c0 2023-11-06T13:28:01.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f1ffb700 1 -- 172.21.15.38:0/2437728983 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e00033f0 con 0x7fd5f417e4c0 2023-11-06T13:28:01.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2437728983 >> v2:172.21.15.163:3300/0 conn(0x7fd5f417e8a0 msgr2=0x7fd5f4180d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f37fe700 1 --2- 172.21.15.38:0/2437728983 >> v2:172.21.15.163:3300/0 conn(0x7fd5f417e8a0 0x7fd5f4180d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2437728983 >> v1:172.21.15.38:6789/0 conn(0x7fd5f417e4c0 legacy=0x7fd5f417f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2437728983 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40ee270 con 0x7fd5f4181220 2023-11-06T13:28:01.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f37fe700 1 --2- 172.21.15.38:0/2437728983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f40eca50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd5f4182210 tx=0x7fd5e4009780).ready entity=mon.0 client_cookie=8caa0f512f013c3e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f1ffb700 1 -- 172.21.15.38:0/2437728983 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400e070 con 0x7fd5f4181220 2023-11-06T13:28:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f1ffb700 1 -- 172.21.15.38:0/2437728983 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e400bab0 con 0x7fd5f4181220 2023-11-06T13:28:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.167+0000 7fd5f1ffb700 1 -- 172.21.15.38:0/2437728983 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400be30 con 0x7fd5f4181220 2023-11-06T13:28:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2437728983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 msgr2=0x7fd5f40eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 --2- 172.21.15.38:0/2437728983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f40eca50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd5f4182210 tx=0x7fd5e4009780).stop 2023-11-06T13:28:01.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2437728983 shutdown_connections 2023-11-06T13:28:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 --2- 172.21.15.38:0/2437728983 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f40eca50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 --2- 172.21.15.38:0/2437728983 >> v2:172.21.15.163:3300/0 conn(0x7fd5f417e8a0 0x7fd5f4180d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2437728983 >> 172.21.15.38:0/2437728983 conn(0x7fd5f40eeb50 msgr2=0x7fd5f40eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2437728983 shutdown_connections 2023-11-06T13:28:01.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.168+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2437728983 wait complete. 2023-11-06T13:28:01.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.169+0000 7fd5f94a5700 1 Processor -- start 2023-11-06T13:28:01.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.169+0000 7fd5f94a5700 1 -- start start 2023-11-06T13:28:01.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.170+0000 7fd5f94a5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f417e4c0 0x7fd5f4185a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.170+0000 7fd5f94a5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5f417e8a0 0x7fd5f4177c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.170+0000 7fd5f94a5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f4178110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.170+0000 7fd5f94a5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40c8b80 con 0x7fd5f4181220 2023-11-06T13:28:01.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.170+0000 7fd5f94a5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4184630 con 0x7fd5f417e8a0 2023-11-06T13:28:01.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.170+0000 7fd5f94a5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4184910 con 0x7fd5f417e4c0 2023-11-06T13:28:01.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f4178110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f4178110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43620/0 (socket says 172.21.15.38:43620) 2023-11-06T13:28:01.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2769836968 learned_addr learned my addr 172.21.15.38:0/2769836968 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f27fc700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5f417e8a0 0x7fd5f4177c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f2ffd700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f417e4c0 0x7fd5f4185a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f417e4c0 msgr2=0x7fd5f4185a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5f417e4c0 0x7fd5f4185a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5f417e8a0 msgr2=0x7fd5f4177c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5f417e8a0 0x7fd5f4177c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2769836968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4009a20 con 0x7fd5f4181220 2023-11-06T13:28:01.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f37fe700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f4178110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd5e400b610 tx=0x7fd5e4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e401d630 con 0x7fd5f4181220 2023-11-06T13:28:01.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e401d790 con 0x7fd5f4181220 2023-11-06T13:28:01.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f4184bf0 con 0x7fd5f4181220 2023-11-06T13:28:01.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e401db50 con 0x7fd5f4181220 2023-11-06T13:28:01.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.171+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f41851b0 con 0x7fd5f4181220 2023-11-06T13:28:01.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.172+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5f406c580 con 0x7fd5f4181220 2023-11-06T13:28:01.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.173+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fd5e4030430 con 0x7fd5f4181220 2023-11-06T13:28:01.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.173+0000 7fd5eaffd700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5d408cbd0 0x7fd5d408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd5e40b4760 con 0x7fd5f4181220 2023-11-06T13:28:01.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5f2ffd700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5d408cbd0 0x7fd5d408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5eaffd700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] conn(0x7fd5d40985b0 0x7fd5d409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 --> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5d409b0d0 con 0x7fd5d40985b0 2023-11-06T13:28:01.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5e40b4ab0 con 0x7fd5f4181220 2023-11-06T13:28:01.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5f27fc700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] conn(0x7fd5d40985b0 0x7fd5d409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5f2ffd700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5d408cbd0 0x7fd5d408f090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd5ec005750 tx=0x7fd5ec009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.174+0000 7fd5f27fc700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] conn(0x7fd5d40985b0 0x7fd5d409aa50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.175+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== osd.1 v2:172.21.15.44:6800/121228 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd5d409b0d0 con 0x7fd5d40985b0 2023-11-06T13:28:01.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 --> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd5f4180250 con 0x7fd5d40985b0 2023-11-06T13:28:01.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5eaffd700 1 -- 172.21.15.38:0/2769836968 <== osd.1 v2:172.21.15.44:6800/121228 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd5f4180250 con 0x7fd5d40985b0 2023-11-06T13:28:01.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] conn(0x7fd5d40985b0 msgr2=0x7fd5d409aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.44:6800/121228,v1:172.21.15.44:6802/121228] conn(0x7fd5d40985b0 0x7fd5d409aa50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5d408cbd0 msgr2=0x7fd5d408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5d408cbd0 0x7fd5d408f090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd5ec005750 tx=0x7fd5ec009040).stop 2023-11-06T13:28:01.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 msgr2=0x7fd5f4178110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.190+0000 7fd5f94a5700 1 --2- 172.21.15.38:0/2769836968 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5f4181220 0x7fd5f4178110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd5e400b610 tx=0x7fd5e4009780).stop 2023-11-06T13:28:01.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.191+0000 7fd5f37fe700 1 -- 172.21.15.38:0/2769836968 reap_dead start 2023-11-06T13:28:01.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.191+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 shutdown_connections 2023-11-06T13:28:01.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.191+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 >> 172.21.15.38:0/2769836968 conn(0x7fd5f40eeb50 msgr2=0x7fd5f40f0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.191+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 shutdown_connections 2023-11-06T13:28:01.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.191+0000 7fd5f94a5700 1 -- 172.21.15.38:0/2769836968 wait complete. 2023-11-06T13:28:01.205 INFO:teuthology.orchestra.run.smithi038.stdout:73014444039 2023-11-06T13:28:01.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-06T13:28:01.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.322+0000 7f526b989700 1 Processor -- start 2023-11-06T13:28:01.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.323+0000 7f526b989700 1 -- start start 2023-11-06T13:28:01.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f526b989700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f52641720d0 0x7f526417ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f526b989700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f52641724b0 0x7f526417cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f526b989700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52640eca50 0x7f526417efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f526b989700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526417e5a0 con 0x7f52641720d0 2023-11-06T13:28:01.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f526b989700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526417d6b0 con 0x7f52640eca50 2023-11-06T13:28:01.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f526b989700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526417d990 con 0x7f52641724b0 2023-11-06T13:28:01.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f52641720d0 0x7f526417ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f52641720d0 0x7f526417ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43622/0 (socket says 172.21.15.38:43622) 2023-11-06T13:28:01.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 -- 172.21.15.38:0/2859634995 learned_addr learned my addr 172.21.15.38:0/2859634995 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269f26700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.44:3300/0 conn(0x7f52640eca50 0x7f526417efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5268f24700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.163:3300/0 conn(0x7f52641724b0 0x7f526417cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 -- 172.21.15.38:0/2859634995 >> v2:172.21.15.163:3300/0 conn(0x7f52641724b0 msgr2=0x7f526417cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.163:3300/0 conn(0x7f52641724b0 0x7f526417cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 -- 172.21.15.38:0/2859634995 >> v2:172.21.15.44:3300/0 conn(0x7f52640eca50 msgr2=0x7f526417efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.44:3300/0 conn(0x7f52640eca50 0x7f526417efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 -- 172.21.15.38:0/2859634995 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526417dc70 con 0x7f52641720d0 2023-11-06T13:28:01.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5268f24700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.163:3300/0 conn(0x7f52641724b0 0x7f526417cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:01.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f5269725700 1 --2- 172.21.15.38:0/2859634995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52641720d0 0x7f526417ea30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f52640efbc0 tx=0x7f52600090f0).ready entity=mon.0 client_cookie=35f433550edc1036 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f525bfff700 1 -- 172.21.15.38:0/2859634995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000b520 con 0x7f52641720d0 2023-11-06T13:28:01.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.324+0000 7f525bfff700 1 -- 172.21.15.38:0/2859634995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000b680 con 0x7f52641720d0 2023-11-06T13:28:01.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f525bfff700 1 -- 172.21.15.38:0/2859634995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000ba00 con 0x7f52641720d0 2023-11-06T13:28:01.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 -- 172.21.15.38:0/2859634995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52641720d0 msgr2=0x7f526417ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 --2- 172.21.15.38:0/2859634995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52641720d0 0x7f526417ea30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f52640efbc0 tx=0x7f52600090f0).stop 2023-11-06T13:28:01.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 -- 172.21.15.38:0/2859634995 shutdown_connections 2023-11-06T13:28:01.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.44:3300/0 conn(0x7f52640eca50 0x7f526417efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 --2- 172.21.15.38:0/2859634995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52641720d0 0x7f526417ea30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 --2- 172.21.15.38:0/2859634995 >> v2:172.21.15.163:3300/0 conn(0x7f52641724b0 0x7f526417cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 -- 172.21.15.38:0/2859634995 >> 172.21.15.38:0/2859634995 conn(0x7f52640eeb50 msgr2=0x7f52640eef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 -- 172.21.15.38:0/2859634995 shutdown_connections 2023-11-06T13:28:01.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.325+0000 7f526b989700 1 -- 172.21.15.38:0/2859634995 wait complete. 2023-11-06T13:28:01.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.326+0000 7f526b989700 1 Processor -- start 2023-11-06T13:28:01.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.327+0000 7f526b989700 1 -- start start 2023-11-06T13:28:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52640eca50 0x7f52640ee330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52641720d0 0x7f5264083dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52641724b0 0x7f52641607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640edea0 con 0x7f52640eca50 2023-11-06T13:28:01.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640ee820 con 0x7f52641720d0 2023-11-06T13:28:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640ecff0 con 0x7f52641724b0 2023-11-06T13:28:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52640eca50 0x7f52640ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52640eca50 0x7f52640ee330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43626/0 (socket says 172.21.15.38:43626) 2023-11-06T13:28:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 -- 172.21.15.38:0/1433406845 learned_addr learned my addr 172.21.15.38:0/1433406845 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5268f24700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52641720d0 0x7f5264083dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269f26700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52641724b0 0x7f52641607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 -- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52641724b0 msgr2=0x7f52641607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52641724b0 0x7f52641607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 -- 172.21.15.38:0/1433406845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52641720d0 msgr2=0x7f5264083dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52641720d0 0x7f5264083dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 -- 172.21.15.38:0/1433406845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009370 con 0x7f52640eca50 2023-11-06T13:28:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5268f24700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52641720d0 0x7f5264083dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f5269725700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52640eca50 0x7f52640ee330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5260009130 tx=0x7f5260017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000be90 con 0x7f52640eca50 2023-11-06T13:28:01.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000b7f0 con 0x7f52640eca50 2023-11-06T13:28:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52640ed290 con 0x7f52640eca50 2023-11-06T13:28:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526001c670 con 0x7f52640eca50 2023-11-06T13:28:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.328+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52640ed850 con 0x7f52640eca50 2023-11-06T13:28:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.329+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f526417c940 con 0x7f52640eca50 2023-11-06T13:28:01.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.330+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f526001ca60 con 0x7f52640eca50 2023-11-06T13:28:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f52597fa700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f524808cba0 0x7f524808f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f52600b4310 con 0x7f52640eca50 2023-11-06T13:28:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f52597fa700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] conn(0x7f5248098580 0x7f524809aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 --> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f524809b0a0 con 0x7f5248098580 2023-11-06T13:28:01.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52600b45b0 con 0x7f52640eca50 2023-11-06T13:28:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f5268f24700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f524808cba0 0x7f524808f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.331+0000 7f5269f26700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] conn(0x7f5248098580 0x7f524809aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.332+0000 7f5268f24700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f524808cba0 0x7f524808f060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5254006d80 tx=0x7f5254008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.332+0000 7f5269f26700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] conn(0x7f5248098580 0x7f524809aa20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.333+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== osd.2 v2:172.21.15.163:6808/91791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f524809b0a0 con 0x7f5248098580 2023-11-06T13:28:01.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.347+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 --> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52640edfe0 con 0x7f5248098580 2023-11-06T13:28:01.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.347+0000 7f52597fa700 1 -- 172.21.15.38:0/1433406845 <== osd.2 v2:172.21.15.163:6808/91791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f525c0075e0 con 0x7f5248098580 2023-11-06T13:28:01.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] conn(0x7f5248098580 msgr2=0x7f524809aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6808/91791,v1:172.21.15.163:6809/91791] conn(0x7f5248098580 0x7f524809aa20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f524808cba0 msgr2=0x7f524808f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f524808cba0 0x7f524808f060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5254006d80 tx=0x7f5254008040).stop 2023-11-06T13:28:01.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52640eca50 msgr2=0x7f52640ee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 --2- 172.21.15.38:0/1433406845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52640eca50 0x7f52640ee330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5260009130 tx=0x7f5260017000).stop 2023-11-06T13:28:01.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f5269f26700 1 -- 172.21.15.38:0/1433406845 reap_dead start 2023-11-06T13:28:01.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 shutdown_connections 2023-11-06T13:28:01.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 >> 172.21.15.38:0/1433406845 conn(0x7f52640eeb50 msgr2=0x7f52640eef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 shutdown_connections 2023-11-06T13:28:01.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.348+0000 7f526b989700 1 -- 172.21.15.38:0/1433406845 wait complete. 2023-11-06T13:28:01.363 INFO:teuthology.orchestra.run.smithi038.stdout:73014444041 2023-11-06T13:28:01.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-06T13:28:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.480+0000 7f0eaf0ed700 1 Processor -- start 2023-11-06T13:28:01.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.480+0000 7f0eaf0ed700 1 -- start start 2023-11-06T13:28:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0eaf0ed700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ea817c240 0x7f0ea817f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0eaf0ed700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea817f0f0 con 0x7f0ea817c620 2023-11-06T13:28:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0eaf0ed700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80ed370 con 0x7f0ea80e8c20 2023-11-06T13:28:01.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0eaf0ed700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea817df40 con 0x7f0ea817c240 2023-11-06T13:28:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ead68a700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0ea817c620 0x7f0ea8180750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51774/0 (socket says 172.21.15.38:51774) 2023-11-06T13:28:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ead68a700 1 -- 172.21.15.38:0/3622228349 learned_addr learned my addr 172.21.15.38:0/3622228349 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257254142 0 0) 0x7f0ea817f0f0 con 0x7f0ea817c620 2023-11-06T13:28:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e980033f0 con 0x7f0ea817c620 2023-11-06T13:28:01.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0eace89700 1 --2- 172.21.15.38:0/3622228349 >> v2:172.21.15.44:3300/0 conn(0x7f0ea817c240 0x7f0ea817f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040837249 0 0) 0x7f0e980033f0 con 0x7f0ea817c620 2023-11-06T13:28:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 >> v2:172.21.15.44:3300/0 conn(0x7f0ea817c240 msgr2=0x7f0ea817f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 --2- 172.21.15.38:0/3622228349 >> v2:172.21.15.44:3300/0 conn(0x7f0ea817c240 0x7f0ea817f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 >> v1:172.21.15.163:6789/0 conn(0x7f0ea80e8c20 legacy=0x7f0ea8180040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea817e200 con 0x7f0ea817c620 2023-11-06T13:28:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.481+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f0ea00017f0 con 0x7f0ea817c620 2023-11-06T13:28:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 >> v1:172.21.15.38:6789/0 conn(0x7f0ea817c620 legacy=0x7f0ea8180750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e980038e0 0x7f0e98003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98004690 0x7f0e98004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98005000 0x7f0e9800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea817df40 con 0x7f0e98005000 2023-11-06T13:28:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9800bf90 con 0x7f0e980038e0 2023-11-06T13:28:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9800c150 con 0x7f0e98004690 2023-11-06T13:28:01.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98005000 0x7f0e9800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0eace89700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e980038e0 0x7f0e98003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea7fff700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98004690 0x7f0e98004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 -- 172.21.15.38:0/3622228349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98004690 msgr2=0x7f0e98004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98004690 0x7f0e98004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 -- 172.21.15.38:0/3622228349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e980038e0 msgr2=0x7f0e98003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e980038e0 0x7f0e98003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 -- 172.21.15.38:0/3622228349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980033f0 con 0x7f0e98005000 2023-11-06T13:28:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea7fff700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98004690 0x7f0e98004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 -- 172.21.15.38:0/3622228349 reap_dead start 2023-11-06T13:28:01.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ead68a700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98005000 0x7f0e9800b8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0ea000c500 tx=0x7f0ea805f060).ready entity=mon.0 client_cookie=8c9e45a9a3683b47 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0002030 con 0x7f0e98005000 2023-11-06T13:28:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000ce30 con 0x7f0e98005000 2023-11-06T13:28:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.482+0000 7f0ea77fe700 1 -- 172.21.15.38:0/3622228349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0005d50 con 0x7f0e98005000 2023-11-06T13:28:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/3622228349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98005000 msgr2=0x7f0e9800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98005000 0x7f0e9800b8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f0ea000c500 tx=0x7f0ea805f060).stop 2023-11-06T13:28:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/3622228349 shutdown_connections 2023-11-06T13:28:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 --2- 172.21.15.38:0/3622228349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e98005000 0x7f0e9800b8e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/3622228349 >> 172.21.15.38:0/3622228349 conn(0x7f0ea805e1b0 msgr2=0x7f0ea805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/3622228349 shutdown_connections 2023-11-06T13:28:01.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.483+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/3622228349 wait complete. 2023-11-06T13:28:01.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.484+0000 7f0eaf0ed700 1 Processor -- start 2023-11-06T13:28:01.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.484+0000 7f0eaf0ed700 1 -- start start 2023-11-06T13:28:01.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0eaf0ed700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98005000 0x7f0ea8173ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0eaf0ed700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea818de80 0x7f0ea818f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0eaf0ed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ea80c84a0 0x7f0ea816f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0eaf0ed700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea818f1f0 con 0x7f0ea80c84a0 2023-11-06T13:28:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0eaf0ed700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea818e300 con 0x7f0ea818de80 2023-11-06T13:28:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0eaf0ed700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea818e5e0 con 0x7f0e98005000 2023-11-06T13:28:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0ead68a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ea80c84a0 0x7f0ea816f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0ead68a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ea80c84a0 0x7f0ea816f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43634/0 (socket says 172.21.15.38:43634) 2023-11-06T13:28:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.485+0000 7f0ead68a700 1 -- 172.21.15.38:0/1518782634 learned_addr learned my addr 172.21.15.38:0/1518782634 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ea7fff700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea818de80 0x7f0ea818f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0eace89700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98005000 0x7f0ea8173ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ead68a700 1 -- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98005000 msgr2=0x7f0ea8173ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ead68a700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e98005000 0x7f0ea8173ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ead68a700 1 -- 172.21.15.38:0/1518782634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea818de80 msgr2=0x7f0ea818f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ead68a700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea818de80 0x7f0ea818f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ead68a700 1 -- 172.21.15.38:0/1518782634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea818e8c0 con 0x7f0ea80c84a0 2023-11-06T13:28:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ea7fff700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea818de80 0x7f0ea818f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:01.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ead68a700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ea80c84a0 0x7f0ea816f7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f0ea0006000 tx=0x7f0ea0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0002030 con 0x7f0ea80c84a0 2023-11-06T13:28:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0005e40 con 0x7f0ea80c84a0 2023-11-06T13:28:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea818eba0 con 0x7f0ea80c84a0 2023-11-06T13:28:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0013870 con 0x7f0ea80c84a0 2023-11-06T13:28:01.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.486+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea818fb70 con 0x7f0ea80c84a0 2023-11-06T13:28:01.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.487+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ea818fd90 con 0x7f0ea80c84a0 2023-11-06T13:28:01.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.488+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f0ea0013be0 con 0x7f0ea80c84a0 2023-11-06T13:28:01.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.488+0000 7f0ea4ff9700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e8c08cbd0 0x7f0e8c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.488+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0ea0019070 con 0x7f0ea80c84a0 2023-11-06T13:28:01.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0ea4ff9700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] conn(0x7f0e8c0985b0 0x7f0e8c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 --> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e8c09b0d0 con 0x7f0e8c0985b0 2023-11-06T13:28:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea00b5670 con 0x7f0ea80c84a0 2023-11-06T13:28:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0eace89700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e8c08cbd0 0x7f0e8c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0ea7fff700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] conn(0x7f0e8c0985b0 0x7f0e8c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0ea7fff700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] conn(0x7f0e8c0985b0 0x7f0e8c09aa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.489+0000 7f0eace89700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e8c08cbd0 0x7f0e8c08f090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0ea80c98b0 tx=0x7f0e9c008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.490+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== osd.3 v2:172.21.15.38:6800/91126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0e8c09b0d0 con 0x7f0e8c0985b0 2023-11-06T13:28:01.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.504+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 --> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ea818f040 con 0x7f0e8c0985b0 2023-11-06T13:28:01.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0ea4ff9700 1 -- 172.21.15.38:0/1518782634 <== osd.3 v2:172.21.15.38:6800/91126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ea818f040 con 0x7f0e8c0985b0 2023-11-06T13:28:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] conn(0x7f0e8c0985b0 msgr2=0x7f0e8c09aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:6800/91126,v1:172.21.15.38:6801/91126] conn(0x7f0e8c0985b0 0x7f0e8c09aa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e8c08cbd0 msgr2=0x7f0e8c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e8c08cbd0 0x7f0e8c08f090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f0ea80c98b0 tx=0x7f0e9c008040).stop 2023-11-06T13:28:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ea80c84a0 msgr2=0x7f0ea816f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 --2- 172.21.15.38:0/1518782634 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0ea80c84a0 0x7f0ea816f7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f0ea0006000 tx=0x7f0ea0015000).stop 2023-11-06T13:28:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0ead68a700 1 -- 172.21.15.38:0/1518782634 reap_dead start 2023-11-06T13:28:01.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 shutdown_connections 2023-11-06T13:28:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 >> 172.21.15.38:0/1518782634 conn(0x7f0ea805e1b0 msgr2=0x7f0ea80eb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 shutdown_connections 2023-11-06T13:28:01.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.505+0000 7f0eaf0ed700 1 -- 172.21.15.38:0/1518782634 wait complete. 2023-11-06T13:28:01.520 INFO:teuthology.orchestra.run.smithi038.stdout:73014444041 2023-11-06T13:28:01.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-06T13:28:01.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.636+0000 7f9a674a8700 1 Processor -- start 2023-11-06T13:28:01.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.636+0000 7f9a674a8700 1 -- start start 2023-11-06T13:28:01.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a674a8700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a60175890 0x7f9a60181130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a674a8700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9a60084d90 0x7f9a60181a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a674a8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a60180390 con 0x7f9a60181620 2023-11-06T13:28:01.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a674a8700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a600ec070 con 0x7f9a60175890 2023-11-06T13:28:01.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a674a8700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a600ec350 con 0x7f9a60084d90 2023-11-06T13:28:01.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a60175890 0x7f9a60181130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a60175890 0x7f9a60181130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:43854/0 (socket says 172.21.15.38:43854) 2023-11-06T13:28:01.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 -- 172.21.15.38:0/1474486006 learned_addr learned my addr 172.21.15.38:0/1474486006 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a64a43700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9a60181620 0x7f9a60062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:35642/0 (socket says 172.21.15.38:35642) 2023-11-06T13:28:01.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65a45700 1 --2- 172.21.15.38:0/1474486006 >> v2:172.21.15.163:3300/0 conn(0x7f9a60084d90 0x7f9a60181a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 -- 172.21.15.38:0/1474486006 >> v2:172.21.15.163:3300/0 conn(0x7f9a60084d90 msgr2=0x7f9a60181a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 --2- 172.21.15.38:0/1474486006 >> v2:172.21.15.163:3300/0 conn(0x7f9a60084d90 0x7f9a60181a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 -- 172.21.15.38:0/1474486006 >> v1:172.21.15.44:6789/0 conn(0x7f9a60181620 legacy=0x7f9a60062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a5ffff700 1 -- 172.21.15.38:0/1474486006 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275499520 0 0) 0x7f9a60180390 con 0x7f9a60181620 2023-11-06T13:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 -- 172.21.15.38:0/1474486006 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60180650 con 0x7f9a60175890 2023-11-06T13:28:01.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a65244700 1 --2- 172.21.15.38:0/1474486006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60181130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9a600c4020 tx=0x7f9a500090f0).ready entity=mon.1 client_cookie=4e0845c34a188ba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a5ffff700 1 -- 172.21.15.38:0/1474486006 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000b520 con 0x7f9a60175890 2023-11-06T13:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a5ffff700 1 -- 172.21.15.38:0/1474486006 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5000b680 con 0x7f9a60175890 2023-11-06T13:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.638+0000 7f9a5ffff700 1 -- 172.21.15.38:0/1474486006 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000ba00 con 0x7f9a60175890 2023-11-06T13:28:01.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 -- 172.21.15.38:0/1474486006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 msgr2=0x7f9a60181130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 --2- 172.21.15.38:0/1474486006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60181130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9a600c4020 tx=0x7f9a500090f0).stop 2023-11-06T13:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 -- 172.21.15.38:0/1474486006 shutdown_connections 2023-11-06T13:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 --2- 172.21.15.38:0/1474486006 >> v2:172.21.15.163:3300/0 conn(0x7f9a60084d90 0x7f9a60181a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 --2- 172.21.15.38:0/1474486006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60181130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 -- 172.21.15.38:0/1474486006 >> 172.21.15.38:0/1474486006 conn(0x7f9a600f2b00 msgr2=0x7f9a600eeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 -- 172.21.15.38:0/1474486006 shutdown_connections 2023-11-06T13:28:01.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.639+0000 7f9a674a8700 1 -- 172.21.15.38:0/1474486006 wait complete. 2023-11-06T13:28:01.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.641+0000 7f9a674a8700 1 Processor -- start 2023-11-06T13:28:01.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.641+0000 7f9a674a8700 1 -- start start 2023-11-06T13:28:01.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a674a8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a60084d90 0x7f9a6017fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a674a8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60175c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a674a8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60181620 0x7f9a60068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a674a8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60068530 con 0x7f9a60181620 2023-11-06T13:28:01.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a674a8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60068810 con 0x7f9a60175890 2023-11-06T13:28:01.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a674a8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60176160 con 0x7f9a60084d90 2023-11-06T13:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60181620 0x7f9a60068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60181620 0x7f9a60068ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43638/0 (socket says 172.21.15.38:43638) 2023-11-06T13:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 -- 172.21.15.38:0/3941168938 learned_addr learned my addr 172.21.15.38:0/3941168938 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65244700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a60084d90 0x7f9a6017fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a64a43700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60175c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 -- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a60084d90 msgr2=0x7f9a6017fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a60084d90 0x7f9a6017fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 -- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 msgr2=0x7f9a60175c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60175c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 -- 172.21.15.38:0/3941168938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009370 con 0x7f9a60181620 2023-11-06T13:28:01.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a64a43700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a60175890 0x7f9a60175c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:01.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a65a45700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60181620 0x7f9a60068ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f9a5800e930 tx=0x7f9a58006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.642+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5800ee70 con 0x7f9a60181620 2023-11-06T13:28:01.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.643+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a601763b0 con 0x7f9a60181620 2023-11-06T13:28:01.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.643+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a60176970 con 0x7f9a60181620 2023-11-06T13:28:01.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.643+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a580094c0 con 0x7f9a60181620 2023-11-06T13:28:01.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.643+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5800ca00 con 0x7f9a60181620 2023-11-06T13:28:01.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.643+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a6006c580 con 0x7f9a60181620 2023-11-06T13:28:01.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.644+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f9a5801b400 con 0x7f9a60181620 2023-11-06T13:28:01.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a5d7fa700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9a4c08cbd0 0x7f9a4c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f9a580b2c90 con 0x7f9a60181620 2023-11-06T13:28:01.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a5d7fa700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] conn(0x7f9a4c098530 0x7f9a4c09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 --> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a4c09b050 con 0x7f9a4c098530 2023-11-06T13:28:01.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a580b2f30 con 0x7f9a60181620 2023-11-06T13:28:01.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a65244700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9a4c08cbd0 0x7f9a4c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.645+0000 7f9a64a43700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] conn(0x7f9a4c098530 0x7f9a4c09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.646+0000 7f9a65244700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9a4c08cbd0 0x7f9a4c08f090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9a50006dd0 tx=0x7f9a50017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.646+0000 7f9a64a43700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] conn(0x7f9a4c098530 0x7f9a4c09a9d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.647+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== osd.4 v2:172.21.15.44:6816/121240 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9a4c09b050 con 0x7f9a4c098530 2023-11-06T13:28:01.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.661+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 --> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a600689c0 con 0x7f9a4c098530 2023-11-06T13:28:01.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.661+0000 7f9a5d7fa700 1 -- 172.21.15.38:0/3941168938 <== osd.4 v2:172.21.15.44:6816/121240 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a600689c0 con 0x7f9a4c098530 2023-11-06T13:28:01.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] conn(0x7f9a4c098530 msgr2=0x7f9a4c09a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.44:6816/121240,v1:172.21.15.44:6817/121240] conn(0x7f9a4c098530 0x7f9a4c09a9d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9a4c08cbd0 msgr2=0x7f9a4c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9a4c08cbd0 0x7f9a4c08f090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9a50006dd0 tx=0x7f9a50017000).stop 2023-11-06T13:28:01.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60181620 msgr2=0x7f9a60068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 --2- 172.21.15.38:0/3941168938 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9a60181620 0x7f9a60068ca0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f9a5800e930 tx=0x7f9a58006f90).stop 2023-11-06T13:28:01.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a65a45700 1 -- 172.21.15.38:0/3941168938 reap_dead start 2023-11-06T13:28:01.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 shutdown_connections 2023-11-06T13:28:01.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 >> 172.21.15.38:0/3941168938 conn(0x7f9a600f2b00 msgr2=0x7f9a60083bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 shutdown_connections 2023-11-06T13:28:01.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.662+0000 7f9a674a8700 1 -- 172.21.15.38:0/3941168938 wait complete. 2023-11-06T13:28:01.676 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:01.677 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-06T13:28:01.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.793+0000 7f4b20acb700 1 Processor -- start 2023-11-06T13:28:01.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.793+0000 7f4b20acb700 1 -- start start 2023-11-06T13:28:01.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b20acb700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4b1c1756e0 0x7f4b1c0640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b20acb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b1c0645d0 0x7f4b1c17de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b20acb700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c17d9d0 con 0x7f4b1c17e350 2023-11-06T13:28:01.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b20acb700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0c8560 con 0x7f4b1c0645d0 2023-11-06T13:28:01.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b20acb700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c064a50 con 0x7f4b1c1756e0 2023-11-06T13:28:01.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b19d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b1c0645d0 0x7f4b1c17de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b19d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4b1c0645d0 0x7f4b1c17de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43652/0 (socket says 172.21.15.38:43652) 2023-11-06T13:28:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b19d9b700 1 -- 172.21.15.38:0/1823204433 learned_addr learned my addr 172.21.15.38:0/1823204433 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.794+0000 7f4b1a59c700 1 --2- 172.21.15.38:0/1823204433 >> v2:172.21.15.163:3300/0 conn(0x7f4b1c1756e0 0x7f4b1c0640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b19d9b700 1 -- 172.21.15.38:0/1823204433 >> v2:172.21.15.163:3300/0 conn(0x7f4b1c1756e0 msgr2=0x7f4b1c0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b19d9b700 1 --2- 172.21.15.38:0/1823204433 >> v2:172.21.15.163:3300/0 conn(0x7f4b1c1756e0 0x7f4b1c0640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b19d9b700 1 -- 172.21.15.38:0/1823204433 >> v1:172.21.15.163:6789/0 conn(0x7f4b1c17e350 legacy=0x7f4b1c0f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b19d9b700 1 -- 172.21.15.38:0/1823204433 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c17c800 con 0x7f4b1c0645d0 2023-11-06T13:28:01.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b19d9b700 1 --2- 172.21.15.38:0/1823204433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c17de60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f4b1c0ce060 tx=0x7f4b100090f0).ready entity=mon.0 client_cookie=e2a612767f77b460 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b1959a700 1 -- 172.21.15.38:0/1823204433 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000b520 con 0x7f4b1c0645d0 2023-11-06T13:28:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b1959a700 1 -- 172.21.15.38:0/1823204433 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000b680 con 0x7f4b1c0645d0 2023-11-06T13:28:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b1959a700 1 -- 172.21.15.38:0/1823204433 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000ba00 con 0x7f4b1c0645d0 2023-11-06T13:28:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 -- 172.21.15.38:0/1823204433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 msgr2=0x7f4b1c17de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 --2- 172.21.15.38:0/1823204433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c17de60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f4b1c0ce060 tx=0x7f4b100090f0).stop 2023-11-06T13:28:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 -- 172.21.15.38:0/1823204433 shutdown_connections 2023-11-06T13:28:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 --2- 172.21.15.38:0/1823204433 >> v2:172.21.15.163:3300/0 conn(0x7f4b1c1756e0 0x7f4b1c0640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 --2- 172.21.15.38:0/1823204433 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c17de60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 -- 172.21.15.38:0/1823204433 >> 172.21.15.38:0/1823204433 conn(0x7f4b1c069ea0 msgr2=0x7f4b1c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 -- 172.21.15.38:0/1823204433 shutdown_connections 2023-11-06T13:28:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.795+0000 7f4b20acb700 1 -- 172.21.15.38:0/1823204433 wait complete. 2023-11-06T13:28:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.797+0000 7f4b20acb700 1 Processor -- start 2023-11-06T13:28:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.797+0000 7f4b20acb700 1 -- start start 2023-11-06T13:28:01.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b20acb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c169990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b20acb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b1c1756e0 0x7f4b1c0f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b20acb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b1c17e350 0x7f4b1c0f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b20acb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0f6270 con 0x7f4b1c0645d0 2023-11-06T13:28:01.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b20acb700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0f5400 con 0x7f4b1c1756e0 2023-11-06T13:28:01.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b20acb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0f4510 con 0x7f4b1c17e350 2023-11-06T13:28:01.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c169990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c169990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43658/0 (socket says 172.21.15.38:43658) 2023-11-06T13:28:01.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 -- 172.21.15.38:0/3774335458 learned_addr learned my addr 172.21.15.38:0/3774335458 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b19d9b700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b1c1756e0 0x7f4b1c0f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1ad9d700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b1c17e350 0x7f4b1c0f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 -- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b1c17e350 msgr2=0x7f4b1c0f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b1c17e350 0x7f4b1c0f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 -- 172.21.15.38:0/3774335458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b1c1756e0 msgr2=0x7f4b1c0f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b1c1756e0 0x7f4b1c0f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 -- 172.21.15.38:0/3774335458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009370 con 0x7f4b1c0645d0 2023-11-06T13:28:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1ad9d700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b1c17e350 0x7f4b1c0f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b19d9b700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b1c1756e0 0x7f4b1c0f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:01.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.798+0000 7f4b1a59c700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c169990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4b0c00e900 tx=0x7f4b0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.799+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00c640 con 0x7f4b1c0645d0 2023-11-06T13:28:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.799+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00c7a0 con 0x7f4b1c0645d0 2023-11-06T13:28:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.799+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c0f47f0 con 0x7f4b1c0645d0 2023-11-06T13:28:01.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.799+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00cb20 con 0x7f4b1c0645d0 2023-11-06T13:28:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.799+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c0f4db0 con 0x7f4b1c0645d0 2023-11-06T13:28:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.799+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b1c06c580 con 0x7f4b1c0645d0 2023-11-06T13:28:01.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.800+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f4b0c01b400 con 0x7f4b1c0645d0 2023-11-06T13:28:01.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b0a7fc700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4afc08cbd0 0x7f4afc08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4b0c0b2c40 con 0x7f4b1c0645d0 2023-11-06T13:28:01.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b0a7fc700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] conn(0x7f4afc0985b0 0x7f4afc09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b19d9b700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4afc08cbd0 0x7f4afc08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 --> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4afc09b0d0 con 0x7f4afc0985b0 2023-11-06T13:28:01.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b0c0b2ee0 con 0x7f4b1c0645d0 2023-11-06T13:28:01.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b1ad9d700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] conn(0x7f4afc0985b0 0x7f4afc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.801+0000 7f4b19d9b700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4afc08cbd0 0x7f4afc08f090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4b10009130 tx=0x7f4b10017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.802+0000 7f4b1ad9d700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] conn(0x7f4afc0985b0 0x7f4afc09aa50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.802+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== osd.5 v2:172.21.15.163:6816/91792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f4afc09b0d0 con 0x7f4afc0985b0 2023-11-06T13:28:01.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.817+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 --> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b1c0f56e0 con 0x7f4afc0985b0 2023-11-06T13:28:01.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.817+0000 7f4b0a7fc700 1 -- 172.21.15.38:0/3774335458 <== osd.5 v2:172.21.15.163:6816/91792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b1c0f56e0 con 0x7f4afc0985b0 2023-11-06T13:28:01.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.817+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] conn(0x7f4afc0985b0 msgr2=0x7f4afc09aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.817+0000 7f4b20acb700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6816/91792,v1:172.21.15.163:6817/91792] conn(0x7f4afc0985b0 0x7f4afc09aa50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4afc08cbd0 msgr2=0x7f4afc08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4afc08cbd0 0x7f4afc08f090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4b10009130 tx=0x7f4b10017000).stop 2023-11-06T13:28:01.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 msgr2=0x7f4b1c169990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 --2- 172.21.15.38:0/3774335458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4b1c0645d0 0x7f4b1c169990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4b0c00e900 tx=0x7f4b0c009060).stop 2023-11-06T13:28:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b1ad9d700 1 -- 172.21.15.38:0/3774335458 reap_dead start 2023-11-06T13:28:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 shutdown_connections 2023-11-06T13:28:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 >> 172.21.15.38:0/3774335458 conn(0x7f4b1c069ea0 msgr2=0x7f4b1c17f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 shutdown_connections 2023-11-06T13:28:01.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.818+0000 7f4b20acb700 1 -- 172.21.15.38:0/3774335458 wait complete. 2023-11-06T13:28:01.832 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:01.833 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-06T13:28:01.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.950+0000 7ff68a4e1700 1 Processor -- start 2023-11-06T13:28:01.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.950+0000 7ff68a4e1700 1 -- start start 2023-11-06T13:28:01.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.951+0000 7ff68a4e1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff6841752a0 0x7ff684182a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.951+0000 7ff68a4e1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff684175680 0x7ff68417ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.951+0000 7ff68a4e1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff684180420 0x7ff6840efb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.951+0000 7ff68a4e1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6840871b0 con 0x7ff6841752a0 2023-11-06T13:28:01.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.951+0000 7ff68a4e1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6840882f0 con 0x7ff684180420 2023-11-06T13:28:01.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.951+0000 7ff68a4e1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff684182ef0 con 0x7ff684175680 2023-11-06T13:28:01.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff6841752a0 0x7ff684182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff6841752a0 0x7ff684182a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43662/0 (socket says 172.21.15.38:43662) 2023-11-06T13:28:01.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 -- 172.21.15.38:0/1987605671 learned_addr learned my addr 172.21.15.38:0/1987605671 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff688cde700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.163:3300/0 conn(0x7ff684175680 0x7ff68417ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff689ce0700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.44:3300/0 conn(0x7ff684180420 0x7ff6840efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 -- 172.21.15.38:0/1987605671 >> v2:172.21.15.163:3300/0 conn(0x7ff684175680 msgr2=0x7ff68417ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.163:3300/0 conn(0x7ff684175680 0x7ff68417ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 -- 172.21.15.38:0/1987605671 >> v2:172.21.15.44:3300/0 conn(0x7ff684180420 msgr2=0x7ff6840efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:01.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.44:3300/0 conn(0x7ff684180420 0x7ff6840efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 -- 172.21.15.38:0/1987605671 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff684180850 con 0x7ff6841752a0 2023-11-06T13:28:01.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff689ce0700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.44:3300/0 conn(0x7ff684180420 0x7ff6840efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:01.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff6894df700 1 --2- 172.21.15.38:0/1987605671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6841752a0 0x7ff684182a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff6840ca980 tx=0x7ff67c009840).ready entity=mon.0 client_cookie=462a46faea8c4420 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff683fff700 1 -- 172.21.15.38:0/1987605671 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00e070 con 0x7ff6841752a0 2023-11-06T13:28:01.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff683fff700 1 -- 172.21.15.38:0/1987605671 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00ba50 con 0x7ff6841752a0 2023-11-06T13:28:01.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.952+0000 7ff683fff700 1 -- 172.21.15.38:0/1987605671 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00bdd0 con 0x7ff6841752a0 2023-11-06T13:28:01.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1987605671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6841752a0 msgr2=0x7ff684182a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1987605671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6841752a0 0x7ff684182a00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff6840ca980 tx=0x7ff67c009840).stop 2023-11-06T13:28:01.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1987605671 shutdown_connections 2023-11-06T13:28:01.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.44:3300/0 conn(0x7ff684180420 0x7ff6840efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1987605671 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff6841752a0 0x7ff684182a00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1987605671 >> v2:172.21.15.163:3300/0 conn(0x7ff684175680 0x7ff68417ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1987605671 >> 172.21.15.38:0/1987605671 conn(0x7ff6840f51f0 msgr2=0x7ff6840f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1987605671 shutdown_connections 2023-11-06T13:28:01.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.953+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1987605671 wait complete. 2023-11-06T13:28:01.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.954+0000 7ff68a4e1700 1 Processor -- start 2023-11-06T13:28:01.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.954+0000 7ff68a4e1700 1 -- start start 2023-11-06T13:28:01.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff68a4e1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6841752a0 0x7ff6840c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff68a4e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff684175680 0x7ff684173540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff68a4e1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff684180420 0x7ff684173a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff68a4e1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6840c97b0 con 0x7ff684180420 2023-11-06T13:28:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff68a4e1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6840c88c0 con 0x7ff684175680 2023-11-06T13:28:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff68a4e1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6840c8ba0 con 0x7ff6841752a0 2023-11-06T13:28:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff689ce0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff684180420 0x7ff684173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff689ce0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff684180420 0x7ff684173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43670/0 (socket says 172.21.15.38:43670) 2023-11-06T13:28:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.955+0000 7ff689ce0700 1 -- 172.21.15.38:0/1729001786 learned_addr learned my addr 172.21.15.38:0/1729001786 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff6894df700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6841752a0 0x7ff6840c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff688cde700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff684175680 0x7ff684173540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff689ce0700 1 -- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6841752a0 msgr2=0x7ff6840c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff689ce0700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff6841752a0 0x7ff6840c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff689ce0700 1 -- 172.21.15.38:0/1729001786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff684175680 msgr2=0x7ff684173540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff689ce0700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff684175680 0x7ff684173540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff689ce0700 1 -- 172.21.15.38:0/1729001786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c009ae0 con 0x7ff684180420 2023-11-06T13:28:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff688cde700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff684175680 0x7ff684173540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff689ce0700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff684180420 0x7ff684173a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff67400c880 tx=0x7ff674008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674010580 con 0x7ff684180420 2023-11-06T13:28:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6740106e0 con 0x7ff684180420 2023-11-06T13:28:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6840c8e80 con 0x7ff684180420 2023-11-06T13:28:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674010a60 con 0x7ff684180420 2023-11-06T13:28:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.956+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6840c9440 con 0x7ff684180420 2023-11-06T13:28:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.957+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6840475a0 con 0x7ff684180420 2023-11-06T13:28:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.958+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff67401b460 con 0x7ff684180420 2023-11-06T13:28:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.958+0000 7ff6817fa700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff67008cbd0 0x7ff67008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.958+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff6740b2030 con 0x7ff684180420 2023-11-06T13:28:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff6817fa700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] conn(0x7ff6700985b0 0x7ff67009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 --> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff67009b0d0 con 0x7ff6700985b0 2023-11-06T13:28:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6740b4540 con 0x7ff684180420 2023-11-06T13:28:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff6894df700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff67008cbd0 0x7ff67008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff688cde700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] conn(0x7ff6700985b0 0x7ff67009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:01.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff688cde700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] conn(0x7ff6700985b0 0x7ff67009aa50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.959+0000 7ff6894df700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff67008cbd0 0x7ff67008f090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff67c009fd0 tx=0x7ff684088260).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:01.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.960+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== osd.6 v2:172.21.15.38:6808/91142 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff67009b0d0 con 0x7ff6700985b0 2023-11-06T13:28:01.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.974+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 --> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6840c98f0 con 0x7ff6700985b0 2023-11-06T13:28:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.974+0000 7ff6817fa700 1 -- 172.21.15.38:0/1729001786 <== osd.6 v2:172.21.15.38:6808/91142 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6840c98f0 con 0x7ff6700985b0 2023-11-06T13:28:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] conn(0x7ff6700985b0 msgr2=0x7ff67009aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:6808/91142,v1:172.21.15.38:6811/91142] conn(0x7ff6700985b0 0x7ff67009aa50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff67008cbd0 msgr2=0x7ff67008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff67008cbd0 0x7ff67008f090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff67c009fd0 tx=0x7ff684088260).stop 2023-11-06T13:28:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff684180420 msgr2=0x7ff684173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 --2- 172.21.15.38:0/1729001786 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff684180420 0x7ff684173a30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff67400c880 tx=0x7ff674008040).stop 2023-11-06T13:28:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff689ce0700 1 -- 172.21.15.38:0/1729001786 reap_dead start 2023-11-06T13:28:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 shutdown_connections 2023-11-06T13:28:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 >> 172.21.15.38:0/1729001786 conn(0x7ff6840f51f0 msgr2=0x7ff68417e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 shutdown_connections 2023-11-06T13:28:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:01.975+0000 7ff68a4e1700 1 -- 172.21.15.38:0/1729001786 wait complete. 2023-11-06T13:28:01.989 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:01.990 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-06T13:28:02.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.106+0000 7efea91c2700 1 Processor -- start 2023-11-06T13:28:02.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.106+0000 7efea91c2700 1 -- start start 2023-11-06T13:28:02.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea91c2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efea41756e0 0x7efea40640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea91c2700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efea417e570 0x7efea4185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea91c2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea417d9d0 con 0x7efea40645d0 2023-11-06T13:28:02.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea91c2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea40c8560 con 0x7efea41756e0 2023-11-06T13:28:02.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea91c2700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea4064a50 con 0x7efea417e570 2023-11-06T13:28:02.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea259c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efea40645d0 0x7efea417de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51780/0 (socket says 172.21.15.38:51780) 2023-11-06T13:28:02.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea259c700 1 -- 172.21.15.38:0/3005122834 learned_addr learned my addr 172.21.15.38:0/3005122834 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:02.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea359e700 1 --2- 172.21.15.38:0/3005122834 >> v2:172.21.15.163:3300/0 conn(0x7efea417e570 0x7efea4185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203250903 0 0) 0x7efea417d9d0 con 0x7efea40645d0 2023-11-06T13:28:02.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea2d9d700 1 --2- 172.21.15.38:0/3005122834 >> v2:172.21.15.44:3300/0 conn(0x7efea41756e0 0x7efea40640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8c0033f0 con 0x7efea40645d0 2023-11-06T13:28:02.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.107+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068608598 0 0) 0x7efe8c0033f0 con 0x7efea40645d0 2023-11-06T13:28:02.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 >> v2:172.21.15.163:3300/0 conn(0x7efea417e570 msgr2=0x7efea4185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 --2- 172.21.15.38:0/3005122834 >> v2:172.21.15.163:3300/0 conn(0x7efea417e570 0x7efea4185580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 >> v2:172.21.15.44:3300/0 conn(0x7efea41756e0 msgr2=0x7efea40640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 --2- 172.21.15.38:0/3005122834 >> v2:172.21.15.44:3300/0 conn(0x7efea41756e0 0x7efea40640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea417c800 con 0x7efea40645d0 2023-11-06T13:28:02.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7efe98001470 con 0x7efea40645d0 2023-11-06T13:28:02.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 >> v1:172.21.15.38:6789/0 conn(0x7efea40645d0 legacy=0x7efea417de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c003930 0x7efe8c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe8c004690 0x7efe8c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe8c005000 0x7efe8c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea4064a50 con 0x7efe8c005000 2023-11-06T13:28:02.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c00bdd0 con 0x7efe8c003930 2023-11-06T13:28:02.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c00bf10 con 0x7efe8c004690 2023-11-06T13:28:02.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe8c005000 0x7efe8c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea2d9d700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c003930 0x7efe8c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea259c700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe8c004690 0x7efe8c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 -- 172.21.15.38:0/3005122834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe8c004690 msgr2=0x7efe8c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe8c004690 0x7efe8c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 -- 172.21.15.38:0/3005122834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c003930 msgr2=0x7efe8c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c003930 0x7efe8c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 -- 172.21.15.38:0/3005122834 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0033f0 con 0x7efe8c005000 2023-11-06T13:28:02.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea2d9d700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c003930 0x7efe8c003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 -- 172.21.15.38:0/3005122834 reap_dead start 2023-11-06T13:28:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea359e700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe8c005000 0x7efe8c00b8e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7efe9c00e240 tx=0x7efe9c00b040).ready entity=mon.0 client_cookie=984e1abdfe455cb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c009ac0 con 0x7efe8c005000 2023-11-06T13:28:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00f040 con 0x7efe8c005000 2023-11-06T13:28:02.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.108+0000 7efea1d9b700 1 -- 172.21.15.38:0/3005122834 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00ed00 con 0x7efe8c005000 2023-11-06T13:28:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 -- 172.21.15.38:0/3005122834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe8c005000 msgr2=0x7efe8c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe8c005000 0x7efe8c00b8e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7efe9c00e240 tx=0x7efe9c00b040).stop 2023-11-06T13:28:02.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 -- 172.21.15.38:0/3005122834 shutdown_connections 2023-11-06T13:28:02.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 --2- 172.21.15.38:0/3005122834 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe8c005000 0x7efe8c00b8e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 -- 172.21.15.38:0/3005122834 >> 172.21.15.38:0/3005122834 conn(0x7efea4069ea0 msgr2=0x7efea406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 -- 172.21.15.38:0/3005122834 shutdown_connections 2023-11-06T13:28:02.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.109+0000 7efea91c2700 1 -- 172.21.15.38:0/3005122834 wait complete. 2023-11-06T13:28:02.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.110+0000 7efea91c2700 1 Processor -- start 2023-11-06T13:28:02.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.110+0000 7efea91c2700 1 -- start start 2023-11-06T13:28:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.111+0000 7efea91c2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c005000 0x7efea40ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.111+0000 7efea91c2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efea40ecc70 0x7efea4190250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.111+0000 7efea91c2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efea40c8640 0x7efea41648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.111+0000 7efea91c2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40ee030 con 0x7efea40ecc70 2023-11-06T13:28:02.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.111+0000 7efea91c2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40ed140 con 0x7efe8c005000 2023-11-06T13:28:02.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.111+0000 7efea91c2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40ed420 con 0x7efea40c8640 2023-11-06T13:28:02.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efea40ecc70 0x7efea4190250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efea40ecc70 0x7efea4190250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43678/0 (socket says 172.21.15.38:43678) 2023-11-06T13:28:02.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 -- 172.21.15.38:0/1378140849 learned_addr learned my addr 172.21.15.38:0/1378140849 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea2d9d700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c005000 0x7efea40ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea359e700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efea40c8640 0x7efea41648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 -- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efea40c8640 msgr2=0x7efea41648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efea40c8640 0x7efea41648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 -- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c005000 msgr2=0x7efea40ee4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c005000 0x7efea40ee4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 -- 172.21.15.38:0/1378140849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea40ed700 con 0x7efea40ecc70 2023-11-06T13:28:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea359e700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efea40c8640 0x7efea41648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:02.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea259c700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efea40ecc70 0x7efea4190250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7efe98007fd0 tx=0x7efe98001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98000cb0 con 0x7efea40ecc70 2023-11-06T13:28:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98011590 con 0x7efea40ecc70 2023-11-06T13:28:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98011910 con 0x7efea40ecc70 2023-11-06T13:28:02.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea40ed9e0 con 0x7efea40ecc70 2023-11-06T13:28:02.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.112+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea4190740 con 0x7efea40ecc70 2023-11-06T13:28:02.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.113+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efea406c580 con 0x7efea40ecc70 2023-11-06T13:28:02.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.114+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7efe98011d00 con 0x7efea40ecc70 2023-11-06T13:28:02.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efe8affd700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe9008cbd0 0x7efe9008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efe980b25d0 con 0x7efea40ecc70 2023-11-06T13:28:02.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efe8affd700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] conn(0x7efe900985b0 0x7efe9009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efea2d9d700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe9008cbd0 0x7efe9008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 --> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe9009b0d0 con 0x7efe900985b0 2023-11-06T13:28:02.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe980b2920 con 0x7efea40ecc70 2023-11-06T13:28:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efea359e700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] conn(0x7efe900985b0 0x7efe9009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.115+0000 7efea2d9d700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe9008cbd0 0x7efe9008f090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7efe94006f70 tx=0x7efe94008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.116+0000 7efea359e700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] conn(0x7efe900985b0 0x7efe9009aa50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.116+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== osd.7 v2:172.21.15.44:6801/121229 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7efe9009b0d0 con 0x7efe900985b0 2023-11-06T13:28:02.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.131+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 --> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efea40ede80 con 0x7efe900985b0 2023-11-06T13:28:02.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.131+0000 7efe8affd700 1 -- 172.21.15.38:0/1378140849 <== osd.7 v2:172.21.15.44:6801/121229 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efea40ede80 con 0x7efe900985b0 2023-11-06T13:28:02.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] conn(0x7efe900985b0 msgr2=0x7efe9009aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.44:6801/121229,v1:172.21.15.44:6803/121229] conn(0x7efe900985b0 0x7efe9009aa50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe9008cbd0 msgr2=0x7efe9008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe9008cbd0 0x7efe9008f090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7efe94006f70 tx=0x7efe94008040).stop 2023-11-06T13:28:02.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efea40ecc70 msgr2=0x7efea4190250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 --2- 172.21.15.38:0/1378140849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efea40ecc70 0x7efea4190250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7efe98007fd0 tx=0x7efe98001e90).stop 2023-11-06T13:28:02.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea359e700 1 -- 172.21.15.38:0/1378140849 reap_dead start 2023-11-06T13:28:02.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 shutdown_connections 2023-11-06T13:28:02.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 >> 172.21.15.38:0/1378140849 conn(0x7efea4069ea0 msgr2=0x7efea40c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 shutdown_connections 2023-11-06T13:28:02.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.132+0000 7efea91c2700 1 -- 172.21.15.38:0/1378140849 wait complete. 2023-11-06T13:28:02.147 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:02.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2023-11-06T13:28:02.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.264+0000 7fca1cc2e700 1 Processor -- start 2023-11-06T13:28:02.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.264+0000 7fca1cc2e700 1 -- start start 2023-11-06T13:28:02.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca1cc2e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fca181756c0 0x7fca180ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca1cc2e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1817c750 con 0x7fca180ecf60 2023-11-06T13:28:02.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca1cc2e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1817d890 con 0x7fca180ca510 2023-11-06T13:28:02.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca1cc2e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca18175aa0 con 0x7fca181756c0 2023-11-06T13:28:02.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca17fff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fca180ecf60 0x7fca1817dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:35646/0 (socket says 172.21.15.38:35646) 2023-11-06T13:28:02.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca17fff700 1 -- 172.21.15.38:0/650411422 learned_addr learned my addr 172.21.15.38:0/650411422 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:02.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.265+0000 7fca177fe700 1 --2- 172.21.15.38:0/650411422 >> v2:172.21.15.163:3300/0 conn(0x7fca181756c0 0x7fca180ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317582706 0 0) 0x7fca1817c750 con 0x7fca180ecf60 2023-11-06T13:28:02.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca040033f0 con 0x7fca180ecf60 2023-11-06T13:28:02.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826519302 0 0) 0x7fca1817d890 con 0x7fca180ca510 2023-11-06T13:28:02.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca1817c750 con 0x7fca180ca510 2023-11-06T13:28:02.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca177fe700 1 -- 172.21.15.38:0/650411422 >> v1:172.21.15.163:6789/0 conn(0x7fca180ca510 legacy=0x7fca180ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca177fe700 1 -- 172.21.15.38:0/650411422 >> v1:172.21.15.44:6789/0 conn(0x7fca180ecf60 legacy=0x7fca1817dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca177fe700 1 -- 172.21.15.38:0/650411422 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1817c9a0 con 0x7fca181756c0 2023-11-06T13:28:02.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca177fe700 1 --2- 172.21.15.38:0/650411422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca181756c0 0x7fca180ca020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fca08009760 tx=0x7fca08009060).ready entity=mon.2 client_cookie=626c352fd2805b6e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800d4a0 con 0x7fca181756c0 2023-11-06T13:28:02.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0800d600 con 0x7fca181756c0 2023-11-06T13:28:02.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca16ffd700 1 -- 172.21.15.38:0/650411422 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800d980 con 0x7fca181756c0 2023-11-06T13:28:02.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca1cc2e700 1 -- 172.21.15.38:0/650411422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca181756c0 msgr2=0x7fca180ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.266+0000 7fca1cc2e700 1 --2- 172.21.15.38:0/650411422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca181756c0 0x7fca180ca020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fca08009760 tx=0x7fca08009060).stop 2023-11-06T13:28:02.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.267+0000 7fca1cc2e700 1 -- 172.21.15.38:0/650411422 shutdown_connections 2023-11-06T13:28:02.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.267+0000 7fca1cc2e700 1 --2- 172.21.15.38:0/650411422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca181756c0 0x7fca180ca020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.267+0000 7fca1cc2e700 1 -- 172.21.15.38:0/650411422 >> 172.21.15.38:0/650411422 conn(0x7fca180ef420 msgr2=0x7fca1805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.267+0000 7fca1cc2e700 1 -- 172.21.15.38:0/650411422 shutdown_connections 2023-11-06T13:28:02.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.267+0000 7fca1cc2e700 1 -- 172.21.15.38:0/650411422 wait complete. 2023-11-06T13:28:02.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.268+0000 7fca1cc2e700 1 Processor -- start 2023-11-06T13:28:02.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.268+0000 7fca1cc2e700 1 -- start start 2023-11-06T13:28:02.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca1cc2e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca180ca510 0x7fca18154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca1cc2e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca180ecf60 0x7fca1818ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca1cc2e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca181756c0 0x7fca1818f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca1cc2e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180eb390 con 0x7fca181756c0 2023-11-06T13:28:02.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca1cc2e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18190c20 con 0x7fca180ca510 2023-11-06T13:28:02.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca1cc2e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1818f6e0 con 0x7fca180ecf60 2023-11-06T13:28:02.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca17fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca181756c0 0x7fca1818f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca17fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca181756c0 0x7fca1818f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43686/0 (socket says 172.21.15.38:43686) 2023-11-06T13:28:02.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca0effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca180ecf60 0x7fca1818ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca17fff700 1 -- 172.21.15.38:0/3271877099 learned_addr learned my addr 172.21.15.38:0/3271877099 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.269+0000 7fca177fe700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca180ca510 0x7fca18154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca17fff700 1 -- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca180ecf60 msgr2=0x7fca1818ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca17fff700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca180ecf60 0x7fca1818ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca17fff700 1 -- 172.21.15.38:0/3271877099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca180ca510 msgr2=0x7fca18154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca17fff700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca180ca510 0x7fca18154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca17fff700 1 -- 172.21.15.38:0/3271877099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080092a0 con 0x7fca181756c0 2023-11-06T13:28:02.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca0effd700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca180ecf60 0x7fca1818ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:02.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca17fff700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca181756c0 0x7fca1818f0b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fca10001560 tx=0x7fca100015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10005d30 con 0x7fca181756c0 2023-11-06T13:28:02.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10005e90 con 0x7fca181756c0 2023-11-06T13:28:02.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1818f9c0 con 0x7fca181756c0 2023-11-06T13:28:02.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100072e0 con 0x7fca181756c0 2023-11-06T13:28:02.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.270+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca181902f0 con 0x7fca181756c0 2023-11-06T13:28:02.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.271+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca180475a0 con 0x7fca181756c0 2023-11-06T13:28:02.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.272+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fca10007650 con 0x7fca181756c0 2023-11-06T13:28:02.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.272+0000 7fca0ffff700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc9f808cbd0 0x7fc9f808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.272+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fca100b2310 con 0x7fca181756c0 2023-11-06T13:28:02.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca177fe700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc9f808cbd0 0x7fc9f808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca0ffff700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] conn(0x7fc9f80985b0 0x7fc9f809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 --> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9f809b0d0 con 0x7fc9f80985b0 2023-11-06T13:28:02.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca100b2660 con 0x7fca181756c0 2023-11-06T13:28:02.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca0effd700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] conn(0x7fc9f80985b0 0x7fc9f809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca177fe700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc9f808cbd0 0x7fc9f808f090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fca08006d60 tx=0x7fca08016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.273+0000 7fca0effd700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] conn(0x7fc9f80985b0 0x7fc9f809aa50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.274+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== osd.8 v2:172.21.15.163:6800/91790 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc9f809b0d0 con 0x7fc9f80985b0 2023-11-06T13:28:02.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.288+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 --> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca18190d60 con 0x7fc9f80985b0 2023-11-06T13:28:02.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca0ffff700 1 -- 172.21.15.38:0/3271877099 <== osd.8 v2:172.21.15.163:6800/91790 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca18190d60 con 0x7fc9f80985b0 2023-11-06T13:28:02.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] conn(0x7fc9f80985b0 msgr2=0x7fc9f809aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6800/91790,v1:172.21.15.163:6801/91790] conn(0x7fc9f80985b0 0x7fc9f809aa50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc9f808cbd0 msgr2=0x7fc9f808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc9f808cbd0 0x7fc9f808f090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fca08006d60 tx=0x7fca08016000).stop 2023-11-06T13:28:02.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca181756c0 msgr2=0x7fca1818f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 --2- 172.21.15.38:0/3271877099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca181756c0 0x7fca1818f0b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fca10001560 tx=0x7fca100015b0).stop 2023-11-06T13:28:02.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca17fff700 1 -- 172.21.15.38:0/3271877099 reap_dead start 2023-11-06T13:28:02.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 shutdown_connections 2023-11-06T13:28:02.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 >> 172.21.15.38:0/3271877099 conn(0x7fca180ef420 msgr2=0x7fca180f1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 shutdown_connections 2023-11-06T13:28:02.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.289+0000 7fca1cc2e700 1 -- 172.21.15.38:0/3271877099 wait complete. 2023-11-06T13:28:02.305 INFO:teuthology.orchestra.run.smithi038.stdout:73014444039 2023-11-06T13:28:02.306 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2023-11-06T13:28:02.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.422+0000 7f150500d700 1 Processor -- start 2023-11-06T13:28:02.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.422+0000 7f150500d700 1 -- start start 2023-11-06T13:28:02.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f150500d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15001756e0 0x7f15000640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f150500d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f150017e570 0x7f1500185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f150500d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150017d9d0 con 0x7f15000645d0 2023-11-06T13:28:02.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f150500d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15000c8560 con 0x7f15001756e0 2023-11-06T13:28:02.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f150500d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1500064a50 con 0x7f150017e570 2023-11-06T13:28:02.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fe59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f15000645d0 0x7f150017de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51786/0 (socket says 172.21.15.38:51786) 2023-11-06T13:28:02.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fe59c700 1 -- 172.21.15.38:0/3699825910 learned_addr learned my addr 172.21.15.38:0/3699825910 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fed9d700 1 --2- 172.21.15.38:0/3699825910 >> v2:172.21.15.44:3300/0 conn(0x7f15001756e0 0x7f15000640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14ff59e700 1 --2- 172.21.15.38:0/3699825910 >> v2:172.21.15.163:3300/0 conn(0x7f150017e570 0x7f1500185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fdd9b700 1 -- 172.21.15.38:0/3699825910 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100704818 0 0) 0x7f150017d9d0 con 0x7f15000645d0 2023-11-06T13:28:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fdd9b700 1 -- 172.21.15.38:0/3699825910 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ec0033f0 con 0x7f15000645d0 2023-11-06T13:28:02.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fed9d700 1 -- 172.21.15.38:0/3699825910 >> v2:172.21.15.163:3300/0 conn(0x7f150017e570 msgr2=0x7f1500185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fed9d700 1 --2- 172.21.15.38:0/3699825910 >> v2:172.21.15.163:3300/0 conn(0x7f150017e570 0x7f1500185580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fed9d700 1 -- 172.21.15.38:0/3699825910 >> v1:172.21.15.38:6789/0 conn(0x7f15000645d0 legacy=0x7f150017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fed9d700 1 -- 172.21.15.38:0/3699825910 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150017c800 con 0x7f15001756e0 2023-11-06T13:28:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fed9d700 1 --2- 172.21.15.38:0/3699825910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 0x7f15000640e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f15001545a0 tx=0x7f14f0009060).ready entity=mon.1 client_cookie=244ef10be42b385d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.424+0000 7f14fdd9b700 1 -- 172.21.15.38:0/3699825910 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000d4a0 con 0x7f15001756e0 2023-11-06T13:28:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f14fdd9b700 1 -- 172.21.15.38:0/3699825910 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f000d600 con 0x7f15001756e0 2023-11-06T13:28:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f14fdd9b700 1 -- 172.21.15.38:0/3699825910 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000d980 con 0x7f15001756e0 2023-11-06T13:28:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 -- 172.21.15.38:0/3699825910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 msgr2=0x7f15000640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 --2- 172.21.15.38:0/3699825910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 0x7f15000640e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f15001545a0 tx=0x7f14f0009060).stop 2023-11-06T13:28:02.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 -- 172.21.15.38:0/3699825910 shutdown_connections 2023-11-06T13:28:02.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 --2- 172.21.15.38:0/3699825910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 0x7f15000640e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 --2- 172.21.15.38:0/3699825910 >> v2:172.21.15.163:3300/0 conn(0x7f150017e570 0x7f1500185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 -- 172.21.15.38:0/3699825910 >> 172.21.15.38:0/3699825910 conn(0x7f1500069ea0 msgr2=0x7f150006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 -- 172.21.15.38:0/3699825910 shutdown_connections 2023-11-06T13:28:02.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.425+0000 7f150500d700 1 -- 172.21.15.38:0/3699825910 wait complete. 2023-11-06T13:28:02.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.427+0000 7f150500d700 1 Processor -- start 2023-11-06T13:28:02.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.427+0000 7f150500d700 1 -- start start 2023-11-06T13:28:02.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15000645d0 0x7f150017ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 0x7f150018f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f150017e570 0x7f15000f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000cc3c0 con 0x7f150017e570 2023-11-06T13:28:02.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150018fdb0 con 0x7f15001756e0 2023-11-06T13:28:02.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000f4890 con 0x7f15000645d0 2023-11-06T13:28:02.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f150017e570 0x7f15000f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f150017e570 0x7f15000f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43698/0 (socket says 172.21.15.38:43698) 2023-11-06T13:28:02.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 -- 172.21.15.38:0/3225187056 learned_addr learned my addr 172.21.15.38:0/3225187056 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14fe59c700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 0x7f150018f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14fed9d700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15000645d0 0x7f150017ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 -- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15000645d0 msgr2=0x7f150017ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f15000645d0 0x7f150017ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 -- 172.21.15.38:0/3225187056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 msgr2=0x7f150018f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15001756e0 0x7f150018f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 -- 172.21.15.38:0/3225187056 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f00092a0 con 0x7f150017e570 2023-11-06T13:28:02.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14ff59e700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f150017e570 0x7f15000f5910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f14f8009df0 tx=0x7f14f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800cb50 con 0x7f150017e570 2023-11-06T13:28:02.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f800f040 con 0x7f150017e570 2023-11-06T13:28:02.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15000f4b70 con 0x7f150017e570 2023-11-06T13:28:02.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800cec0 con 0x7f150017e570 2023-11-06T13:28:02.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.428+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15000f5130 con 0x7f150017e570 2023-11-06T13:28:02.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.429+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f150006c580 con 0x7f150017e570 2023-11-06T13:28:02.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.430+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f14f8013610 con 0x7f150017e570 2023-11-06T13:28:02.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14f6ffd700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f14e008cbd0 0x7f14e008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f14f80b32d0 con 0x7f150017e570 2023-11-06T13:28:02.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14f6ffd700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] conn(0x7f14e00985b0 0x7f14e009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 --> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14e009b0d0 con 0x7f14e00985b0 2023-11-06T13:28:02.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f80b3620 con 0x7f150017e570 2023-11-06T13:28:02.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14fed9d700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f14e008cbd0 0x7f14e008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14fe59c700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] conn(0x7f14e00985b0 0x7f14e009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14fe59c700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] conn(0x7f14e00985b0 0x7f14e009aa50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.431+0000 7f14fed9d700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f14e008cbd0 0x7f14e008f090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f14f0009fd0 tx=0x7f14f0016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.432+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== osd.9 v2:172.21.15.38:6824/91143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f14e009b0d0 con 0x7f14e00985b0 2023-11-06T13:28:02.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.446+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 --> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15000f5780 con 0x7f14e00985b0 2023-11-06T13:28:02.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f14f6ffd700 1 -- 172.21.15.38:0/3225187056 <== osd.9 v2:172.21.15.38:6824/91143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15000f5780 con 0x7f14e00985b0 2023-11-06T13:28:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] conn(0x7f14e00985b0 msgr2=0x7f14e009aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:6824/91143,v1:172.21.15.38:6825/91143] conn(0x7f14e00985b0 0x7f14e009aa50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f14e008cbd0 msgr2=0x7f14e008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f14e008cbd0 0x7f14e008f090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f14f0009fd0 tx=0x7f14f0016000).stop 2023-11-06T13:28:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f150017e570 msgr2=0x7f15000f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 --2- 172.21.15.38:0/3225187056 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f150017e570 0x7f15000f5910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f14f8009df0 tx=0x7f14f800b040).stop 2023-11-06T13:28:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f14ff59e700 1 -- 172.21.15.38:0/3225187056 reap_dead start 2023-11-06T13:28:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 shutdown_connections 2023-11-06T13:28:02.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 >> 172.21.15.38:0/3225187056 conn(0x7f1500069ea0 msgr2=0x7f150017f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 shutdown_connections 2023-11-06T13:28:02.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.447+0000 7f150500d700 1 -- 172.21.15.38:0/3225187056 wait complete. 2023-11-06T13:28:02.462 INFO:teuthology.orchestra.run.smithi038.stdout:73014444039 2023-11-06T13:28:02.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2023-11-06T13:28:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.579+0000 7f8c966b6700 1 Processor -- start 2023-11-06T13:28:02.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.579+0000 7f8c966b6700 1 -- start start 2023-11-06T13:28:02.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c966b6700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c901756e0 0x7f8c900640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c966b6700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8c900645d0 0x7f8c9017de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c966b6700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9017d9d0 con 0x7f8c9017e350 2023-11-06T13:28:02.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c966b6700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c900c8560 con 0x7f8c901756e0 2023-11-06T13:28:02.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c966b6700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c90064a50 con 0x7f8c900645d0 2023-11-06T13:28:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c901756e0 0x7f8c900640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c901756e0 0x7f8c900640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43706/0 (socket says 172.21.15.38:43706) 2023-11-06T13:28:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 -- 172.21.15.38:0/796109994 learned_addr learned my addr 172.21.15.38:0/796109994 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8f7fe700 1 --2- 172.21.15.38:0/796109994 >> v2:172.21.15.163:3300/0 conn(0x7f8c900645d0 0x7f8c9017de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 -- 172.21.15.38:0/796109994 >> v2:172.21.15.163:3300/0 conn(0x7f8c900645d0 msgr2=0x7f8c9017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 --2- 172.21.15.38:0/796109994 >> v2:172.21.15.163:3300/0 conn(0x7f8c900645d0 0x7f8c9017de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 -- 172.21.15.38:0/796109994 >> v1:172.21.15.163:6789/0 conn(0x7f8c9017e350 legacy=0x7f8c900f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 -- 172.21.15.38:0/796109994 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9017c800 con 0x7f8c901756e0 2023-11-06T13:28:02.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8f7fe700 1 --2- 172.21.15.38:0/796109994 >> v2:172.21.15.163:3300/0 conn(0x7f8c900645d0 0x7f8c9017de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.580+0000 7f8c8ffff700 1 --2- 172.21.15.38:0/796109994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c901756e0 0x7f8c900640e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f8c900cab80 tx=0x7f8c800090f0).ready entity=mon.0 client_cookie=2766bf8777b65f62 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c8effd700 1 -- 172.21.15.38:0/796109994 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000b5a0 con 0x7f8c901756e0 2023-11-06T13:28:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c8effd700 1 -- 172.21.15.38:0/796109994 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8000b700 con 0x7f8c901756e0 2023-11-06T13:28:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c8effd700 1 -- 172.21.15.38:0/796109994 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000ba80 con 0x7f8c901756e0 2023-11-06T13:28:02.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 -- 172.21.15.38:0/796109994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c901756e0 msgr2=0x7f8c900640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 --2- 172.21.15.38:0/796109994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c901756e0 0x7f8c900640e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f8c900cab80 tx=0x7f8c800090f0).stop 2023-11-06T13:28:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 -- 172.21.15.38:0/796109994 shutdown_connections 2023-11-06T13:28:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 --2- 172.21.15.38:0/796109994 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c901756e0 0x7f8c900640e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 --2- 172.21.15.38:0/796109994 >> v2:172.21.15.163:3300/0 conn(0x7f8c900645d0 0x7f8c9017de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 -- 172.21.15.38:0/796109994 >> 172.21.15.38:0/796109994 conn(0x7f8c90069ea0 msgr2=0x7f8c9006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 -- 172.21.15.38:0/796109994 shutdown_connections 2023-11-06T13:28:02.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.581+0000 7f8c966b6700 1 -- 172.21.15.38:0/796109994 wait complete. 2023-11-06T13:28:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.583+0000 7f8c966b6700 1 Processor -- start 2023-11-06T13:28:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.583+0000 7f8c966b6700 1 -- start start 2023-11-06T13:28:02.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c900645d0 0x7f8c900f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c901756e0 0x7f8c900cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9017e350 0x7f8c9016e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900f2860 con 0x7f8c9017e350 2023-11-06T13:28:02.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c90152270 con 0x7f8c901756e0 2023-11-06T13:28:02.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900f0e40 con 0x7f8c900645d0 2023-11-06T13:28:02.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9017e350 0x7f8c9016e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9017e350 0x7f8c9016e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43718/0 (socket says 172.21.15.38:43718) 2023-11-06T13:28:02.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 -- 172.21.15.38:0/4258449748 learned_addr learned my addr 172.21.15.38:0/4258449748 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c8ffff700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c900645d0 0x7f8c900f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c8f7fe700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c901756e0 0x7f8c900cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 -- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c900645d0 msgr2=0x7f8c900f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c900645d0 0x7f8c900f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 -- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c901756e0 msgr2=0x7f8c900cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c901756e0 0x7f8c900cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 -- 172.21.15.38:0/4258449748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80009370 con 0x7f8c9017e350 2023-11-06T13:28:02.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c8ffff700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c900645d0 0x7f8c900f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:02.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c94c53700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9017e350 0x7f8c9016e050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8c8800b810 tx=0x7f8c88009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800d600 con 0x7f8c9017e350 2023-11-06T13:28:02.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800d780 con 0x7f8c9017e350 2023-11-06T13:28:02.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.584+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c900f1120 con 0x7f8c9017e350 2023-11-06T13:28:02.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.585+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800db40 con 0x7f8c9017e350 2023-11-06T13:28:02.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.585+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c900f16e0 con 0x7f8c9017e350 2023-11-06T13:28:02.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.585+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c9006c580 con 0x7f8c9017e350 2023-11-06T13:28:02.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.586+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f8c8800f460 con 0x7f8c9017e350 2023-11-06T13:28:02.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c77fff700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c7c08cbd0 0x7f8c7c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f8c880b2c80 con 0x7f8c9017e350 2023-11-06T13:28:02.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c8ffff700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c7c08cbd0 0x7f8c7c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c77fff700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] conn(0x7f8c7c0985b0 0x7f8c7c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 --> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c7c09b0d0 con 0x7f8c7c0985b0 2023-11-06T13:28:02.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c880b2fd0 con 0x7f8c9017e350 2023-11-06T13:28:02.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c8f7fe700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] conn(0x7f8c7c0985b0 0x7f8c7c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.587+0000 7f8c8ffff700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c7c08cbd0 0x7f8c7c08f090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8c80009130 tx=0x7f8c80015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.588+0000 7f8c8f7fe700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] conn(0x7f8c7c0985b0 0x7f8c7c09aa50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.589+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== osd.10 v2:172.21.15.44:6824/121259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8c7c09b0d0 con 0x7f8c7c0985b0 2023-11-06T13:28:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.603+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 --> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c901524b0 con 0x7f8c7c0985b0 2023-11-06T13:28:02.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c77fff700 1 -- 172.21.15.38:0/4258449748 <== osd.10 v2:172.21.15.44:6824/121259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c901524b0 con 0x7f8c7c0985b0 2023-11-06T13:28:02.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] conn(0x7f8c7c0985b0 msgr2=0x7f8c7c09aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.44:6824/121259,v1:172.21.15.44:6825/121259] conn(0x7f8c7c0985b0 0x7f8c7c09aa50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c7c08cbd0 msgr2=0x7f8c7c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c7c08cbd0 0x7f8c7c08f090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8c80009130 tx=0x7f8c80015000).stop 2023-11-06T13:28:02.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9017e350 msgr2=0x7f8c9016e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 --2- 172.21.15.38:0/4258449748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c9017e350 0x7f8c9016e050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8c8800b810 tx=0x7f8c88009290).stop 2023-11-06T13:28:02.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c94c53700 1 -- 172.21.15.38:0/4258449748 reap_dead start 2023-11-06T13:28:02.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 shutdown_connections 2023-11-06T13:28:02.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 >> 172.21.15.38:0/4258449748 conn(0x7f8c90069ea0 msgr2=0x7f8c900c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 shutdown_connections 2023-11-06T13:28:02.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.604+0000 7f8c966b6700 1 -- 172.21.15.38:0/4258449748 wait complete. 2023-11-06T13:28:02.619 INFO:teuthology.orchestra.run.smithi038.stdout:73014444039 2023-11-06T13:28:02.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2023-11-06T13:28:02.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.735+0000 7ff081d40700 1 Processor -- start 2023-11-06T13:28:02.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.735+0000 7ff081d40700 1 -- start start 2023-11-06T13:28:02.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff081d40700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 0x7ff07c17de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff081d40700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff07c17e350 0x7ff07c185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff081d40700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c17d9d0 con 0x7ff07c1756e0 2023-11-06T13:28:02.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff081d40700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c0c8560 con 0x7ff07c0647f0 2023-11-06T13:28:02.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff081d40700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c17c800 con 0x7ff07c17e350 2023-11-06T13:28:02.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff07affd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 0x7ff07c17de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff07bfff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff07c17e350 0x7ff07c185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff07affd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 0x7ff07c17de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:43978/0 (socket says 172.21.15.38:43978) 2023-11-06T13:28:02.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff07bfff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff07c17e350 0x7ff07c185580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36922/0 (socket says 172.21.15.38:36922) 2023-11-06T13:28:02.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.736+0000 7ff07affd700 1 -- 172.21.15.38:0/3952387037 learned_addr learned my addr 172.21.15.38:0/3952387037 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07bfff700 1 -- 172.21.15.38:0/3952387037 >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 msgr2=0x7ff07c17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07bfff700 1 --2- 172.21.15.38:0/3952387037 >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 0x7ff07c17de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07bfff700 1 -- 172.21.15.38:0/3952387037 >> v1:172.21.15.44:6789/0 conn(0x7ff07c1756e0 legacy=0x7ff07c0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07bfff700 1 -- 172.21.15.38:0/3952387037 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c17cae0 con 0x7ff07c17e350 2023-11-06T13:28:02.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07affd700 1 --2- 172.21.15.38:0/3952387037 >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 0x7ff07c17de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:02.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07bfff700 1 --2- 172.21.15.38:0/3952387037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c17e350 0x7ff07c185580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff07c062d40 tx=0x7ff074009780).ready entity=mon.2 client_cookie=dc34d638b0e889d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07a7fc700 1 -- 172.21.15.38:0/3952387037 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400e070 con 0x7ff07c17e350 2023-11-06T13:28:02.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07a7fc700 1 -- 172.21.15.38:0/3952387037 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400bb60 con 0x7ff07c17e350 2023-11-06T13:28:02.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff07a7fc700 1 -- 172.21.15.38:0/3952387037 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074012410 con 0x7ff07c17e350 2023-11-06T13:28:02.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 -- 172.21.15.38:0/3952387037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c17e350 msgr2=0x7ff07c185580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 --2- 172.21.15.38:0/3952387037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c17e350 0x7ff07c185580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7ff07c062d40 tx=0x7ff074009780).stop 2023-11-06T13:28:02.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 -- 172.21.15.38:0/3952387037 shutdown_connections 2023-11-06T13:28:02.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 --2- 172.21.15.38:0/3952387037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c17e350 0x7ff07c185580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 --2- 172.21.15.38:0/3952387037 >> v2:172.21.15.44:3300/0 conn(0x7ff07c0647f0 0x7ff07c17de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 -- 172.21.15.38:0/3952387037 >> 172.21.15.38:0/3952387037 conn(0x7ff07c069ea0 msgr2=0x7ff07c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 -- 172.21.15.38:0/3952387037 shutdown_connections 2023-11-06T13:28:02.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.737+0000 7ff081d40700 1 -- 172.21.15.38:0/3952387037 wait complete. 2023-11-06T13:28:02.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.739+0000 7ff081d40700 1 Processor -- start 2023-11-06T13:28:02.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.739+0000 7ff081d40700 1 -- start start 2023-11-06T13:28:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff081d40700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c0647f0 0x7ff07c16e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff081d40700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07c1756e0 0x7ff07c16e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff081d40700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff07c17e350 0x7ff07c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff081d40700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0ef8f0 con 0x7ff07c17e350 2023-11-06T13:28:02.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff081d40700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0c4f10 con 0x7ff07c1756e0 2023-11-06T13:28:02.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff081d40700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0c4be0 con 0x7ff07c0647f0 2023-11-06T13:28:02.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff07bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff07c17e350 0x7ff07c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff07bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff07c17e350 0x7ff07c0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43732/0 (socket says 172.21.15.38:43732) 2023-11-06T13:28:02.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff07bfff700 1 -- 172.21.15.38:0/521023471 learned_addr learned my addr 172.21.15.38:0/521023471 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff07b7fe700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c0647f0 0x7ff07c16e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.740+0000 7ff07affd700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07c1756e0 0x7ff07c16e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff07bfff700 1 -- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c0647f0 msgr2=0x7ff07c16e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff07bfff700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff07c0647f0 0x7ff07c16e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff07bfff700 1 -- 172.21.15.38:0/521023471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07c1756e0 msgr2=0x7ff07c16e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff07bfff700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07c1756e0 0x7ff07c16e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff07bfff700 1 -- 172.21.15.38:0/521023471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009370 con 0x7ff07c17e350 2023-11-06T13:28:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff07bfff700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff07c17e350 0x7ff07c0c53a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff07c06c830 tx=0x7ff074009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400b6f0 con 0x7ff07c17e350 2023-11-06T13:28:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07401d630 con 0x7ff07c17e350 2023-11-06T13:28:02.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff074009a20 con 0x7ff07c17e350 2023-11-06T13:28:02.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07401d9b0 con 0x7ff07c17e350 2023-11-06T13:28:02.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.741+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c0ef330 con 0x7ff07c17e350 2023-11-06T13:28:02.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.742+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff07c062fe0 con 0x7ff07c17e350 2023-11-06T13:28:02.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff07401dd20 con 0x7ff07c17e350 2023-11-06T13:28:02.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff0737fe700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff05c08cbd0 0x7ff05c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff0740b3e90 con 0x7ff07c17e350 2023-11-06T13:28:02.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff0737fe700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] conn(0x7ff05c0985b0 0x7ff05c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff07b7fe700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff05c08cbd0 0x7ff05c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 --> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff05c09b0d0 con 0x7ff05c0985b0 2023-11-06T13:28:02.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.743+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0740b9460 con 0x7ff07c17e350 2023-11-06T13:28:02.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.744+0000 7ff07affd700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] conn(0x7ff05c0985b0 0x7ff05c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.744+0000 7ff07b7fe700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff05c08cbd0 0x7ff05c08f090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff07c0635d0 tx=0x7ff064000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.744+0000 7ff07affd700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] conn(0x7ff05c0985b0 0x7ff05c09aa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.745+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== osd.11 v2:172.21.15.163:6824/91802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff05c09b0d0 con 0x7ff05c0985b0 2023-11-06T13:28:02.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.759+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 --> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff07c0c51f0 con 0x7ff05c0985b0 2023-11-06T13:28:02.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff0737fe700 1 -- 172.21.15.38:0/521023471 <== osd.11 v2:172.21.15.163:6824/91802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff07c0c51f0 con 0x7ff05c0985b0 2023-11-06T13:28:02.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] conn(0x7ff05c0985b0 msgr2=0x7ff05c09aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6824/91802,v1:172.21.15.163:6825/91802] conn(0x7ff05c0985b0 0x7ff05c09aa50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff05c08cbd0 msgr2=0x7ff05c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff05c08cbd0 0x7ff05c08f090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff07c0635d0 tx=0x7ff064000bc0).stop 2023-11-06T13:28:02.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff07c17e350 msgr2=0x7ff07c0c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 --2- 172.21.15.38:0/521023471 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff07c17e350 0x7ff07c0c53a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff07c06c830 tx=0x7ff074009780).stop 2023-11-06T13:28:02.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff07bfff700 1 -- 172.21.15.38:0/521023471 reap_dead start 2023-11-06T13:28:02.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 shutdown_connections 2023-11-06T13:28:02.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 >> 172.21.15.38:0/521023471 conn(0x7ff07c069ea0 msgr2=0x7ff07c0cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 shutdown_connections 2023-11-06T13:28:02.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.760+0000 7ff081d40700 1 -- 172.21.15.38:0/521023471 wait complete. 2023-11-06T13:28:02.775 INFO:teuthology.orchestra.run.smithi038.stdout:73014444039 2023-11-06T13:28:02.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-06T13:28:02.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.891+0000 7ff2073be700 1 Processor -- start 2023-11-06T13:28:02.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.892+0000 7ff2073be700 1 -- start start 2023-11-06T13:28:02.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff2073be700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2001756e0 0x7ff2000640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff2073be700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20017d9d0 con 0x7ff20017e570 2023-11-06T13:28:02.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff2073be700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff200064a50 con 0x7ff2000645d0 2023-11-06T13:28:02.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff2073be700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000c8560 con 0x7ff2001756e0 2023-11-06T13:28:02.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff20595b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff20017e570 0x7ff200185580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51800/0 (socket says 172.21.15.38:51800) 2023-11-06T13:28:02.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff20595b700 1 -- 172.21.15.38:0/2990114101 learned_addr learned my addr 172.21.15.38:0/2990114101 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:02.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff20515a700 1 --2- 172.21.15.38:0/2990114101 >> v2:172.21.15.44:3300/0 conn(0x7ff2001756e0 0x7ff2000640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff1fffff700 1 -- 172.21.15.38:0/2990114101 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650175557 0 0) 0x7ff20017d9d0 con 0x7ff20017e570 2023-11-06T13:28:02.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff1fffff700 1 -- 172.21.15.38:0/2990114101 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e80033f0 con 0x7ff20017e570 2023-11-06T13:28:02.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff1fffff700 1 -- 172.21.15.38:0/2990114101 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709776877 0 0) 0x7ff1e80033f0 con 0x7ff20017e570 2023-11-06T13:28:02.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff20515a700 1 -- 172.21.15.38:0/2990114101 >> v1:172.21.15.163:6789/0 conn(0x7ff2000645d0 legacy=0x7ff20017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff20515a700 1 -- 172.21.15.38:0/2990114101 >> v1:172.21.15.38:6789/0 conn(0x7ff20017e570 legacy=0x7ff200185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.893+0000 7ff20515a700 1 -- 172.21.15.38:0/2990114101 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20017c800 con 0x7ff2001756e0 2023-11-06T13:28:02.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff20515a700 1 --2- 172.21.15.38:0/2990114101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000640e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff1f8009e60 tx=0x7ff1f8009780).ready entity=mon.1 client_cookie=57390a4166bddb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff1fffff700 1 -- 172.21.15.38:0/2990114101 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800e070 con 0x7ff2001756e0 2023-11-06T13:28:02.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff1fffff700 1 -- 172.21.15.38:0/2990114101 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f800b850 con 0x7ff2001756e0 2023-11-06T13:28:02.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff1fffff700 1 -- 172.21.15.38:0/2990114101 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0001470 con 0x7ff2001756e0 2023-11-06T13:28:02.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 -- 172.21.15.38:0/2990114101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 msgr2=0x7ff2000640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 --2- 172.21.15.38:0/2990114101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000640e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7ff1f8009e60 tx=0x7ff1f8009780).stop 2023-11-06T13:28:02.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 -- 172.21.15.38:0/2990114101 shutdown_connections 2023-11-06T13:28:02.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 --2- 172.21.15.38:0/2990114101 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000640e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 -- 172.21.15.38:0/2990114101 >> 172.21.15.38:0/2990114101 conn(0x7ff200069ea0 msgr2=0x7ff20006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:02.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 -- 172.21.15.38:0/2990114101 shutdown_connections 2023-11-06T13:28:02.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.894+0000 7ff2073be700 1 -- 172.21.15.38:0/2990114101 wait complete. 2023-11-06T13:28:02.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.896+0000 7ff2073be700 1 Processor -- start 2023-11-06T13:28:02.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.896+0000 7ff2073be700 1 -- start start 2023-11-06T13:28:02.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff2073be700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 0x7ff2000c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff2073be700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff2073be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff20017e570 0x7ff200180030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff2073be700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000c4a40 con 0x7ff2000645d0 2023-11-06T13:28:02.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff2073be700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000c52a0 con 0x7ff2001756e0 2023-11-06T13:28:02.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff2073be700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff200180b70 con 0x7ff20017e570 2023-11-06T13:28:02.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 0x7ff2000c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 0x7ff2000c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43742/0 (socket says 172.21.15.38:43742) 2023-11-06T13:28:02.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 -- 172.21.15.38:0/3047711293 learned_addr learned my addr 172.21.15.38:0/3047711293 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:02.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20595b700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff20017e570 0x7ff200180030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff204959700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 -- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff20017e570 msgr2=0x7ff200180030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff20017e570 0x7ff200180030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 -- 172.21.15.38:0/3047711293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 msgr2=0x7ff2000c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:02.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:02.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 -- 172.21.15.38:0/3047711293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8009a20 con 0x7ff2000645d0 2023-11-06T13:28:02.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff204959700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.897+0000 7ff20515a700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 0x7ff2000c86b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff1f8013ce0 tx=0x7ff1f8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.898+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8009420 con 0x7ff2000645d0 2023-11-06T13:28:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.898+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8000f40 con 0x7ff2000645d0 2023-11-06T13:28:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.898+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f801d640 con 0x7ff2000645d0 2023-11-06T13:28:02.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.898+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff200180e50 con 0x7ff2000645d0 2023-11-06T13:28:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.898+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2000c4f30 con 0x7ff2000645d0 2023-11-06T13:28:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.899+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2000c5580 con 0x7ff2000645d0 2023-11-06T13:28:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.900+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff1f801da70 con 0x7ff2000645d0 2023-11-06T13:28:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.900+0000 7ff1fd7fa700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1ec08cbd0 0x7ff1ec08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:02.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.900+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff1f80b3b00 con 0x7ff2000645d0 2023-11-06T13:28:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.900+0000 7ff204959700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1ec08cbd0 0x7ff1ec08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.901+0000 7ff204959700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1ec08cbd0 0x7ff1ec08f090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff1f4007fd0 tx=0x7ff1f4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:02.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:02.904+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff1f8084040 con 0x7ff2000645d0 2023-11-06T13:28:03.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.078+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff200180940 con 0x7ff2000645d0 2023-11-06T13:28:03.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.078+0000 7ff1fd7fa700 1 -- 172.21.15.38:0/3047711293 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1f80b3e60 con 0x7ff2000645d0 2023-11-06T13:28:03.082 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:03.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1ec08cbd0 msgr2=0x7ff1ec08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1ec08cbd0 0x7ff1ec08f090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff1f4007fd0 tx=0x7ff1f4009040).stop 2023-11-06T13:28:03.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 msgr2=0x7ff2000c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 0x7ff2000c86b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff1f8013ce0 tx=0x7ff1f8009780).stop 2023-11-06T13:28:03.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 shutdown_connections 2023-11-06T13:28:03.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff20017e570 0x7ff200180030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff2000645d0 0x7ff2000c86b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1ec08cbd0 0x7ff1ec08f090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 --2- 172.21.15.38:0/3047711293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2001756e0 0x7ff2000c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 >> 172.21.15.38:0/3047711293 conn(0x7ff200069ea0 msgr2=0x7ff2000f5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:03.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 shutdown_connections 2023-11-06T13:28:03.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.080+0000 7ff2073be700 1 -- 172.21.15.38:0/3047711293 wait complete. 2023-11-06T13:28:03.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.0 2023-11-06T13:28:03.096 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-06T13:28:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.212+0000 7f9059545700 1 Processor -- start 2023-11-06T13:28:03.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.212+0000 7f9059545700 1 -- start start 2023-11-06T13:28:03.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9059545700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9054175510 0x7f90541758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9059545700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90540cada0 0x7f90540cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9059545700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f905417c950 0x7f905417cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9059545700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905417e680 con 0x7f90540cada0 2023-11-06T13:28:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9059545700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905417d790 con 0x7f9054175510 2023-11-06T13:28:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9059545700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905417da70 con 0x7f905417c950 2023-11-06T13:28:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90540cada0 0x7f90540cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f90540cada0 0x7f90540cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43754/0 (socket says 172.21.15.38:43754) 2023-11-06T13:28:03.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 -- 172.21.15.38:0/238148057 learned_addr learned my addr 172.21.15.38:0/238148057 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f9052ffd700 1 --2- 172.21.15.38:0/238148057 >> v2:172.21.15.44:3300/0 conn(0x7f9054175510 0x7f90541758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90537fe700 1 --2- 172.21.15.38:0/238148057 >> v2:172.21.15.163:3300/0 conn(0x7f905417c950 0x7f905417cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 -- 172.21.15.38:0/238148057 >> v2:172.21.15.163:3300/0 conn(0x7f905417c950 msgr2=0x7f905417cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:03.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 --2- 172.21.15.38:0/238148057 >> v2:172.21.15.163:3300/0 conn(0x7f905417c950 0x7f905417cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 -- 172.21.15.38:0/238148057 >> v2:172.21.15.44:3300/0 conn(0x7f9054175510 msgr2=0x7f90541758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:03.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 --2- 172.21.15.38:0/238148057 >> v2:172.21.15.44:3300/0 conn(0x7f9054175510 0x7f90541758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 -- 172.21.15.38:0/238148057 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905417dd50 con 0x7f90540cada0 2023-11-06T13:28:03.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.213+0000 7f90527fc700 1 --2- 172.21.15.38:0/238148057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cada0 0x7f90540cb200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9054083930 tx=0x7f903c0090f0).ready entity=mon.0 client_cookie=c4a90bd9d9f11395 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9051ffb700 1 -- 172.21.15.38:0/238148057 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00b5a0 con 0x7f90540cada0 2023-11-06T13:28:03.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9051ffb700 1 -- 172.21.15.38:0/238148057 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00b700 con 0x7f90540cada0 2023-11-06T13:28:03.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9051ffb700 1 -- 172.21.15.38:0/238148057 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ba80 con 0x7f90540cada0 2023-11-06T13:28:03.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 -- 172.21.15.38:0/238148057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cada0 msgr2=0x7f90540cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 --2- 172.21.15.38:0/238148057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cada0 0x7f90540cb200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9054083930 tx=0x7f903c0090f0).stop 2023-11-06T13:28:03.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 -- 172.21.15.38:0/238148057 shutdown_connections 2023-11-06T13:28:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 --2- 172.21.15.38:0/238148057 >> v2:172.21.15.163:3300/0 conn(0x7f905417c950 0x7f905417cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 --2- 172.21.15.38:0/238148057 >> v2:172.21.15.44:3300/0 conn(0x7f9054175510 0x7f90541758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 --2- 172.21.15.38:0/238148057 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f90540cada0 0x7f90540cb200 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 -- 172.21.15.38:0/238148057 >> 172.21.15.38:0/238148057 conn(0x7f90540f28b0 msgr2=0x7f9054069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 -- 172.21.15.38:0/238148057 shutdown_connections 2023-11-06T13:28:03.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.214+0000 7f9059545700 1 -- 172.21.15.38:0/238148057 wait complete. 2023-11-06T13:28:03.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.216+0000 7f9059545700 1 Processor -- start 2023-11-06T13:28:03.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.216+0000 7f9059545700 1 -- start start 2023-11-06T13:28:03.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90540cada0 0x7f9054150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 0x7f9054150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f905417c950 0x7f90540f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90540f0510 con 0x7f9054175510 2023-11-06T13:28:03.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90540efc50 con 0x7f90540cada0 2023-11-06T13:28:03.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054192090 con 0x7f905417c950 2023-11-06T13:28:03.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 0x7f9054150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 0x7f9054150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43760/0 (socket says 172.21.15.38:43760) 2023-11-06T13:28:03.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 -- 172.21.15.38:0/1682667076 learned_addr learned my addr 172.21.15.38:0/1682667076 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:03.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9052ffd700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90540cada0 0x7f9054150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90537fe700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f905417c950 0x7f90540f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 -- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f905417c950 msgr2=0x7f90540f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f905417c950 0x7f90540f09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 -- 172.21.15.38:0/1682667076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90540cada0 msgr2=0x7f9054150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90540cada0 0x7f9054150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 -- 172.21.15.38:0/1682667076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c009370 con 0x7f9054175510 2023-11-06T13:28:03.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f90527fc700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 0x7f9054150700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9054089720 tx=0x7f903c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00b870 con 0x7f9054175510 2023-11-06T13:28:03.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00b9d0 con 0x7f9054175510 2023-11-06T13:28:03.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c01c670 con 0x7f9054175510 2023-11-06T13:28:03.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.217+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90540efec0 con 0x7f9054175510 2023-11-06T13:28:03.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.218+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9054192370 con 0x7f9054175510 2023-11-06T13:28:03.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.218+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90540f07f0 con 0x7f9054175510 2023-11-06T13:28:03.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.219+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f903c01ca20 con 0x7f9054175510 2023-11-06T13:28:03.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.220+0000 7f904affd700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f903408cbd0 0x7f903408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.220+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f903c0b3eb0 con 0x7f9054175510 2023-11-06T13:28:03.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.220+0000 7f9052ffd700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f903408cbd0 0x7f903408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.220+0000 7f9052ffd700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f903408cbd0 0x7f903408f090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f904400bb00 tx=0x7f9044008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.224+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f903c0843f0 con 0x7f9054175510 2023-11-06T13:28:03.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.399+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f905406c580 con 0x7f9054175510 2023-11-06T13:28:03.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.399+0000 7f904affd700 1 -- 172.21.15.38:0/1682667076 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f903c020070 con 0x7f9054175510 2023-11-06T13:28:03.404 INFO:teuthology.orchestra.run.smithi038.stdout:73014444039 2023-11-06T13:28:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f903408cbd0 msgr2=0x7f903408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f903408cbd0 0x7f903408f090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f904400bb00 tx=0x7f9044008040).stop 2023-11-06T13:28:03.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 msgr2=0x7f9054150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 0x7f9054150700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9054089720 tx=0x7f903c015000).stop 2023-11-06T13:28:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 shutdown_connections 2023-11-06T13:28:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f905417c950 0x7f90540f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f903408cbd0 0x7f903408f090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f90540cada0 0x7f9054150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 --2- 172.21.15.38:0/1682667076 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9054175510 0x7f9054150700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 >> 172.21.15.38:0/1682667076 conn(0x7f90540f28b0 msgr2=0x7f9054069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 shutdown_connections 2023-11-06T13:28:03.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.401+0000 7f9059545700 1 -- 172.21.15.38:0/1682667076 wait complete. 2023-11-06T13:28:03.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.1 2023-11-06T13:28:03.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-06T13:28:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.532+0000 7fa744dfb700 1 Processor -- start 2023-11-06T13:28:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.532+0000 7fa744dfb700 1 -- start start 2023-11-06T13:28:03.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa744dfb700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa7400cb4b0 0x7fa7401758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa744dfb700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa74017c950 0x7fa74017cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa744dfb700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74017e680 con 0x7fa740175510 2023-11-06T13:28:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa744dfb700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74017d790 con 0x7fa7400cb4b0 2023-11-06T13:28:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa744dfb700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74017da70 con 0x7fa74017c950 2023-11-06T13:28:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa74017c950 0x7fa74017cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa74017c950 0x7fa74017cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36972/0 (socket says 172.21.15.38:36972) 2023-11-06T13:28:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 -- 172.21.15.38:0/456232070 learned_addr learned my addr 172.21.15.38:0/456232070 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73dd9b700 1 --2- 172.21.15.38:0/456232070 >> v2:172.21.15.44:3300/0 conn(0x7fa7400cb4b0 0x7fa7401758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 -- 172.21.15.38:0/456232070 >> v2:172.21.15.44:3300/0 conn(0x7fa7400cb4b0 msgr2=0x7fa7401758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 --2- 172.21.15.38:0/456232070 >> v2:172.21.15.44:3300/0 conn(0x7fa7400cb4b0 0x7fa7401758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 -- 172.21.15.38:0/456232070 >> v1:172.21.15.44:6789/0 conn(0x7fa740175510 legacy=0x7fa7400cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 -- 172.21.15.38:0/456232070 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74017dd50 con 0x7fa74017c950 2023-11-06T13:28:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.534+0000 7fa73ed9d700 1 --2- 172.21.15.38:0/456232070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74017cde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa730009f20 tx=0x7fa730009840).ready entity=mon.2 client_cookie=37e0b0012104618d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa73d59a700 1 -- 172.21.15.38:0/456232070 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000e070 con 0x7fa74017c950 2023-11-06T13:28:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa73d59a700 1 -- 172.21.15.38:0/456232070 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000b990 con 0x7fa74017c950 2023-11-06T13:28:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa73d59a700 1 -- 172.21.15.38:0/456232070 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000bd10 con 0x7fa74017c950 2023-11-06T13:28:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 -- 172.21.15.38:0/456232070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 msgr2=0x7fa74017cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 --2- 172.21.15.38:0/456232070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74017cde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fa730009f20 tx=0x7fa730009840).stop 2023-11-06T13:28:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 -- 172.21.15.38:0/456232070 shutdown_connections 2023-11-06T13:28:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 --2- 172.21.15.38:0/456232070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74017cde0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 --2- 172.21.15.38:0/456232070 >> v2:172.21.15.44:3300/0 conn(0x7fa7400cb4b0 0x7fa7401758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 -- 172.21.15.38:0/456232070 >> 172.21.15.38:0/456232070 conn(0x7fa7400f28b0 msgr2=0x7fa740069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 -- 172.21.15.38:0/456232070 shutdown_connections 2023-11-06T13:28:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.535+0000 7fa744dfb700 1 -- 172.21.15.38:0/456232070 wait complete. 2023-11-06T13:28:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.537+0000 7fa744dfb700 1 Processor -- start 2023-11-06T13:28:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.537+0000 7fa744dfb700 1 -- start start 2023-11-06T13:28:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa744dfb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7400cb4b0 0x7fa740175e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa744dfb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 0x7fa7401923e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa744dfb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74016ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa744dfb700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740191f50 con 0x7fa740175510 2023-11-06T13:28:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa744dfb700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740191060 con 0x7fa7400cb4b0 2023-11-06T13:28:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa744dfb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa740191340 con 0x7fa74017c950 2023-11-06T13:28:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 0x7fa7401923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 0x7fa7401923e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43768/0 (socket says 172.21.15.38:43768) 2023-11-06T13:28:03.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 -- 172.21.15.38:0/3060567425 learned_addr learned my addr 172.21.15.38:0/3060567425 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:03.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73e59c700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7400cb4b0 0x7fa740175e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73ed9d700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74016ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 -- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 msgr2=0x7fa74016ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74016ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 -- 172.21.15.38:0/3060567425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7400cb4b0 msgr2=0x7fa740175e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7400cb4b0 0x7fa740175e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 -- 172.21.15.38:0/3060567425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009ae0 con 0x7fa740175510 2023-11-06T13:28:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73ed9d700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74016ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa73dd9b700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 0x7fa7401923e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa72800e900 tx=0x7fa728009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.538+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728012600 con 0x7fa740175510 2023-11-06T13:28:03.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.539+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728012760 con 0x7fa740175510 2023-11-06T13:28:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.539+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa740191620 con 0x7fa740175510 2023-11-06T13:28:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.539+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728012ae0 con 0x7fa740175510 2023-11-06T13:28:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.539+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa740191be0 con 0x7fa740175510 2023-11-06T13:28:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.540+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7400ca9e0 con 0x7fa740175510 2023-11-06T13:28:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.540+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fa72801b400 con 0x7fa740175510 2023-11-06T13:28:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.541+0000 7fa7367fc700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72008cbd0 0x7fa72008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.541+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa7280b2560 con 0x7fa740175510 2023-11-06T13:28:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.541+0000 7fa73e59c700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72008cbd0 0x7fa72008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.542+0000 7fa73e59c700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72008cbd0 0x7fa72008f090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa738003920 tx=0x7fa738000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.545+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa728082a20 con 0x7fa740175510 2023-11-06T13:28:03.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.720+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa74006c580 con 0x7fa740175510 2023-11-06T13:28:03.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.720+0000 7fa7367fc700 1 -- 172.21.15.38:0/3060567425 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa728086040 con 0x7fa740175510 2023-11-06T13:28:03.725 INFO:teuthology.orchestra.run.smithi038.stdout:73014444041 2023-11-06T13:28:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72008cbd0 msgr2=0x7fa72008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72008cbd0 0x7fa72008f090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fa738003920 tx=0x7fa738000bc0).stop 2023-11-06T13:28:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 msgr2=0x7fa7401923e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 0x7fa7401923e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa72800e900 tx=0x7fa728009060).stop 2023-11-06T13:28:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 shutdown_connections 2023-11-06T13:28:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa74017c950 0x7fa74016ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72008cbd0 0x7fa72008f090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7400cb4b0 0x7fa740175e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 --2- 172.21.15.38:0/3060567425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740175510 0x7fa7401923e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 >> 172.21.15.38:0/3060567425 conn(0x7fa7400f28b0 msgr2=0x7fa7400cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 shutdown_connections 2023-11-06T13:28:03.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.722+0000 7fa744dfb700 1 -- 172.21.15.38:0/3060567425 wait complete. 2023-11-06T13:28:03.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.2 2023-11-06T13:28:03.739 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-06T13:28:03.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.854+0000 7fed589f0700 1 Processor -- start 2023-11-06T13:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.854+0000 7fed589f0700 1 -- start start 2023-11-06T13:28:03.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.855+0000 7fed589f0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fed540647f0 0x7fed5417de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.855+0000 7fed589f0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5417d9d0 con 0x7fed541756e0 2023-11-06T13:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.855+0000 7fed589f0700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5417c800 con 0x7fed5417e350 2023-11-06T13:28:03.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.855+0000 7fed589f0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540c8560 con 0x7fed540647f0 2023-11-06T13:28:03.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed51d9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fed540647f0 0x7fed5417de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed52d9d700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fed5417e350 0x7fed54185580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:35086/0 (socket says 172.21.15.38:35086) 2023-11-06T13:28:03.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed52d9d700 1 -- 172.21.15.38:0/2224376549 learned_addr learned my addr 172.21.15.38:0/2224376549 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:03.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed5159a700 1 -- 172.21.15.38:0/2224376549 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32563471 0 0) 0x7fed5417c800 con 0x7fed5417e350 2023-11-06T13:28:03.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed5159a700 1 -- 172.21.15.38:0/2224376549 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed400033f0 con 0x7fed5417e350 2023-11-06T13:28:03.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed51d9b700 1 -- 172.21.15.38:0/2224376549 >> v1:172.21.15.163:6789/0 conn(0x7fed5417e350 legacy=0x7fed54185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed5159a700 1 -- 172.21.15.38:0/2224376549 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861314983 0 0) 0x7fed5417d9d0 con 0x7fed541756e0 2023-11-06T13:28:03.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed51d9b700 1 -- 172.21.15.38:0/2224376549 >> v1:172.21.15.44:6789/0 conn(0x7fed541756e0 legacy=0x7fed540640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed51d9b700 1 -- 172.21.15.38:0/2224376549 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5417cae0 con 0x7fed540647f0 2023-11-06T13:28:03.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.856+0000 7fed51d9b700 1 --2- 172.21.15.38:0/2224376549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed540647f0 0x7fed5417de60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fed3c009760 tx=0x7fed3c009060).ready entity=mon.1 client_cookie=368f8e3bbb488c9c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed5159a700 1 -- 172.21.15.38:0/2224376549 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00f510 con 0x7fed540647f0 2023-11-06T13:28:03.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed5159a700 1 -- 172.21.15.38:0/2224376549 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00f670 con 0x7fed540647f0 2023-11-06T13:28:03.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed5159a700 1 -- 172.21.15.38:0/2224376549 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00f9f0 con 0x7fed540647f0 2023-11-06T13:28:03.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 -- 172.21.15.38:0/2224376549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed540647f0 msgr2=0x7fed5417de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 --2- 172.21.15.38:0/2224376549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed540647f0 0x7fed5417de60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fed3c009760 tx=0x7fed3c009060).stop 2023-11-06T13:28:03.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 -- 172.21.15.38:0/2224376549 shutdown_connections 2023-11-06T13:28:03.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 --2- 172.21.15.38:0/2224376549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed540647f0 0x7fed5417de60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 -- 172.21.15.38:0/2224376549 >> 172.21.15.38:0/2224376549 conn(0x7fed54069ea0 msgr2=0x7fed5406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:03.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 -- 172.21.15.38:0/2224376549 shutdown_connections 2023-11-06T13:28:03.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.857+0000 7fed589f0700 1 -- 172.21.15.38:0/2224376549 wait complete. 2023-11-06T13:28:03.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.859+0000 7fed589f0700 1 Processor -- start 2023-11-06T13:28:03.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.859+0000 7fed589f0700 1 -- start start 2023-11-06T13:28:03.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 0x7fed54190160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed541756e0 0x7fed5416da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed5417e350 0x7fed54176d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54175ac0 con 0x7fed540647f0 2023-11-06T13:28:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54175cd0 con 0x7fed541756e0 2023-11-06T13:28:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54175fb0 con 0x7fed5417e350 2023-11-06T13:28:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 0x7fed54190160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 0x7fed54190160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43778/0 (socket says 172.21.15.38:43778) 2023-11-06T13:28:03.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 -- 172.21.15.38:0/980517811 learned_addr learned my addr 172.21.15.38:0/980517811 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:03.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed51d9b700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed541756e0 0x7fed5416da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed52d9d700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed5417e350 0x7fed54176d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 -- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed5417e350 msgr2=0x7fed54176d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed5417e350 0x7fed54176d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 -- 172.21.15.38:0/980517811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed541756e0 msgr2=0x7fed5416da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:03.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed541756e0 0x7fed5416da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:03.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 -- 172.21.15.38:0/980517811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0092a0 con 0x7fed540647f0 2023-11-06T13:28:03.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed52d9d700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed5417e350 0x7fed54176d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:03.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed51d9b700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed541756e0 0x7fed5416da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed5259c700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 0x7fed54190160 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fed4c00c7e0 tx=0x7fed4c001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0016c0 con 0x7fed540647f0 2023-11-06T13:28:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c010510 con 0x7fed540647f0 2023-11-06T13:28:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54176290 con 0x7fed540647f0 2023-11-06T13:28:03.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0108d0 con 0x7fed540647f0 2023-11-06T13:28:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.860+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed54176850 con 0x7fed540647f0 2023-11-06T13:28:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.861+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5406c580 con 0x7fed540647f0 2023-11-06T13:28:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.862+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fed4c010c80 con 0x7fed540647f0 2023-11-06T13:28:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.863+0000 7fed4a7fc700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fed3408cbd0 0x7fed3408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:03.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.863+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fed4c0b2cf0 con 0x7fed540647f0 2023-11-06T13:28:03.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.863+0000 7fed51d9b700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fed3408cbd0 0x7fed3408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:03.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.863+0000 7fed51d9b700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fed3408cbd0 0x7fed3408f090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fed3c006d10 tx=0x7fed3c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:03.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:03.867+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fed4c0831b0 con 0x7fed540647f0 2023-11-06T13:28:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.039+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed5417cdc0 con 0x7fed540647f0 2023-11-06T13:28:04.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.040+0000 7fed4a7fc700 1 -- 172.21.15.38:0/980517811 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed4c0867d0 con 0x7fed540647f0 2023-11-06T13:28:04.044 INFO:teuthology.orchestra.run.smithi038.stdout:73014444041 2023-11-06T13:28:04.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fed3408cbd0 msgr2=0x7fed3408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fed3408cbd0 0x7fed3408f090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fed3c006d10 tx=0x7fed3c017000).stop 2023-11-06T13:28:04.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 msgr2=0x7fed54190160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 0x7fed54190160 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fed4c00c7e0 tx=0x7fed4c001630).stop 2023-11-06T13:28:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 shutdown_connections 2023-11-06T13:28:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed5417e350 0x7fed54176d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fed540647f0 0x7fed54190160 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fed3408cbd0 0x7fed3408f090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 --2- 172.21.15.38:0/980517811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed541756e0 0x7fed5416da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 >> 172.21.15.38:0/980517811 conn(0x7fed54069ea0 msgr2=0x7fed540cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 shutdown_connections 2023-11-06T13:28:04.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.042+0000 7fed589f0700 1 -- 172.21.15.38:0/980517811 wait complete. 2023-11-06T13:28:04.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.3 2023-11-06T13:28:04.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-06T13:28:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.174+0000 7fbb01d83700 1 Processor -- start 2023-11-06T13:28:04.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.174+0000 7fbb01d83700 1 -- start start 2023-11-06T13:28:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbafc175510 0x7fbafc1758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 0x7fbafc0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbafc17e680 con 0x7fbafc17c950 2023-11-06T13:28:04.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc17d4f0 con 0x7fbafc0cada0 2023-11-06T13:28:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc17d790 con 0x7fbafc175510 2023-11-06T13:28:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafaffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 0x7fbafc0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafb7fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fbafc175510 0x7fbafc1758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafaffd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 0x7fbafc0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:44044/0 (socket says 172.21.15.38:44044) 2023-11-06T13:28:04.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafaffd700 1 -- 172.21.15.38:0/1236748923 learned_addr learned my addr 172.21.15.38:0/1236748923 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafbfff700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbafc17c950 0x7fbafc17cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:35682/0 (socket says 172.21.15.38:35682) 2023-11-06T13:28:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafb7fe700 1 -- 172.21.15.38:0/1236748923 >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 msgr2=0x7fbafc0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafb7fe700 1 --2- 172.21.15.38:0/1236748923 >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 0x7fbafc0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafb7fe700 1 -- 172.21.15.38:0/1236748923 >> v1:172.21.15.44:6789/0 conn(0x7fbafc17c950 legacy=0x7fbafc17cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafb7fe700 1 -- 172.21.15.38:0/1236748923 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc17da70 con 0x7fbafc175510 2023-11-06T13:28:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafaffd700 1 --2- 172.21.15.38:0/1236748923 >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 0x7fbafc0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafb7fe700 1 --2- 172.21.15.38:0/1236748923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc175510 0x7fbafc1758f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbaf0009760 tx=0x7fbaf0009060).ready entity=mon.2 client_cookie=9b83e873f416f898 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafa7fc700 1 -- 172.21.15.38:0/1236748923 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00090d0 con 0x7fbafc175510 2023-11-06T13:28:04.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafa7fc700 1 -- 172.21.15.38:0/1236748923 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf000f510 con 0x7fbafc175510 2023-11-06T13:28:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbafa7fc700 1 -- 172.21.15.38:0/1236748923 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000f890 con 0x7fbafc175510 2023-11-06T13:28:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 -- 172.21.15.38:0/1236748923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc175510 msgr2=0x7fbafc1758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 --2- 172.21.15.38:0/1236748923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc175510 0x7fbafc1758f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbaf0009760 tx=0x7fbaf0009060).stop 2023-11-06T13:28:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 -- 172.21.15.38:0/1236748923 shutdown_connections 2023-11-06T13:28:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 --2- 172.21.15.38:0/1236748923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc175510 0x7fbafc1758f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 --2- 172.21.15.38:0/1236748923 >> v2:172.21.15.44:3300/0 conn(0x7fbafc0cada0 0x7fbafc0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.175+0000 7fbb01d83700 1 -- 172.21.15.38:0/1236748923 >> 172.21.15.38:0/1236748923 conn(0x7fbafc0f28b0 msgr2=0x7fbafc069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.176+0000 7fbb01d83700 1 -- 172.21.15.38:0/1236748923 shutdown_connections 2023-11-06T13:28:04.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.176+0000 7fbb01d83700 1 -- 172.21.15.38:0/1236748923 wait complete. 2023-11-06T13:28:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.177+0000 7fbb01d83700 1 Processor -- start 2023-11-06T13:28:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.177+0000 7fbb01d83700 1 -- start start 2023-11-06T13:28:04.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbb01d83700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 0x7fbafc177600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbb01d83700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbafc175510 0x7fbafc181aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbb01d83700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc17c950 0x7fbafc1905c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbb01d83700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc1771e0 con 0x7fbafc0cada0 2023-11-06T13:28:04.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbb01d83700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc176280 con 0x7fbafc175510 2023-11-06T13:28:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbb01d83700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc176560 con 0x7fbafc17c950 2023-11-06T13:28:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbafb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 0x7fbafc177600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbafb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 0x7fbafc177600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43780/0 (socket says 172.21.15.38:43780) 2023-11-06T13:28:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbafb7fe700 1 -- 172.21.15.38:0/4137266185 learned_addr learned my addr 172.21.15.38:0/4137266185 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:04.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbafbfff700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc17c950 0x7fbafc1905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.178+0000 7fbafaffd700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbafc175510 0x7fbafc181aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbafb7fe700 1 -- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc17c950 msgr2=0x7fbafc1905c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbafb7fe700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc17c950 0x7fbafc1905c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbafb7fe700 1 -- 172.21.15.38:0/4137266185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbafc175510 msgr2=0x7fbafc181aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbafb7fe700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbafc175510 0x7fbafc181aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbafb7fe700 1 -- 172.21.15.38:0/4137266185 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec009370 con 0x7fbafc0cada0 2023-11-06T13:28:04.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbafb7fe700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 0x7fbafc177600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbaf0009e00 tx=0x7fbaf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000fea0 con 0x7fbafc0cada0 2023-11-06T13:28:04.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0006950 con 0x7fbafc0cada0 2023-11-06T13:28:04.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf00092a0 con 0x7fbafc0cada0 2023-11-06T13:28:04.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf000f8b0 con 0x7fbafc0cada0 2023-11-06T13:28:04.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.179+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc176b20 con 0x7fbafc0cada0 2023-11-06T13:28:04.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.180+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbafc177450 con 0x7fbafc0cada0 2023-11-06T13:28:04.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.181+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fbaf001b620 con 0x7fbafc0cada0 2023-11-06T13:28:04.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.183+0000 7fbae37fe700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbae808cba0 0x7fbae808f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.183+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fbaf00b3930 con 0x7fbafc0cada0 2023-11-06T13:28:04.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.183+0000 7fbafaffd700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbae808cba0 0x7fbae808f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.183+0000 7fbafaffd700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbae808cba0 0x7fbae808f060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fbafc0ebeb0 tx=0x7fbaec0090f0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.186+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbaf0059e60 con 0x7fbafc0cada0 2023-11-06T13:28:04.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.358+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbafc06c580 con 0x7fbafc0cada0 2023-11-06T13:28:04.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.359+0000 7fbae37fe700 1 -- 172.21.15.38:0/4137266185 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbaf0029020 con 0x7fbafc0cada0 2023-11-06T13:28:04.363 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbae808cba0 msgr2=0x7fbae808f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbae808cba0 0x7fbae808f060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fbafc0ebeb0 tx=0x7fbaec0090f0).stop 2023-11-06T13:28:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 msgr2=0x7fbafc177600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 0x7fbafc177600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbaf0009e00 tx=0x7fbaf0017000).stop 2023-11-06T13:28:04.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 shutdown_connections 2023-11-06T13:28:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbafc17c950 0x7fbafc1905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fbafc0cada0 0x7fbafc177600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbae808cba0 0x7fbae808f060 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 --2- 172.21.15.38:0/4137266185 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbafc175510 0x7fbafc181aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 >> 172.21.15.38:0/4137266185 conn(0x7fbafc0f28b0 msgr2=0x7fbafc0c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 shutdown_connections 2023-11-06T13:28:04.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.360+0000 7fbb01d83700 1 -- 172.21.15.38:0/4137266185 wait complete. 2023-11-06T13:28:04.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.4 2023-11-06T13:28:04.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-06T13:28:04.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d2dcc3700 1 Processor -- start 2023-11-06T13:28:04.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d2dcc3700 1 -- start start 2023-11-06T13:28:04.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d2dcc3700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0d2817e570 0x7f0d28186590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d2dcc3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2817d9d0 con 0x7f0d280647f0 2023-11-06T13:28:04.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d2dcc3700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2817c800 con 0x7f0d281756e0 2023-11-06T13:28:04.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d2dcc3700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280c8560 con 0x7f0d2817e570 2023-11-06T13:28:04.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d26ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0d280647f0 0x7f0d2817de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51810/0 (socket says 172.21.15.38:51810) 2023-11-06T13:28:04.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d26ffd700 1 -- 172.21.15.38:0/1614870156 learned_addr learned my addr 172.21.15.38:0/1614870156 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:04.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d27fff700 1 --2- 172.21.15.38:0/1614870156 >> v2:172.21.15.44:3300/0 conn(0x7f0d2817e570 0x7f0d28186590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d267fc700 1 -- 172.21.15.38:0/1614870156 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438369418 0 0) 0x7f0d2817d9d0 con 0x7f0d280647f0 2023-11-06T13:28:04.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d267fc700 1 -- 172.21.15.38:0/1614870156 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d100033f0 con 0x7f0d280647f0 2023-11-06T13:28:04.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d27fff700 1 -- 172.21.15.38:0/1614870156 >> v1:172.21.15.44:6789/0 conn(0x7f0d281756e0 legacy=0x7f0d280640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d27fff700 1 -- 172.21.15.38:0/1614870156 >> v1:172.21.15.38:6789/0 conn(0x7f0d280647f0 legacy=0x7f0d2817de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.494+0000 7f0d27fff700 1 -- 172.21.15.38:0/1614870156 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2817cae0 con 0x7f0d2817e570 2023-11-06T13:28:04.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d27fff700 1 --2- 172.21.15.38:0/1614870156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d2817e570 0x7f0d28186590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0d20009760 tx=0x7f0d20009060).ready entity=mon.1 client_cookie=6c6b1491227bdc5e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d267fc700 1 -- 172.21.15.38:0/1614870156 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000f510 con 0x7f0d2817e570 2023-11-06T13:28:04.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d267fc700 1 -- 172.21.15.38:0/1614870156 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2000f670 con 0x7f0d2817e570 2023-11-06T13:28:04.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d267fc700 1 -- 172.21.15.38:0/1614870156 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000f9f0 con 0x7f0d2817e570 2023-11-06T13:28:04.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/1614870156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d2817e570 msgr2=0x7f0d28186590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/1614870156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d2817e570 0x7f0d28186590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0d20009760 tx=0x7f0d20009060).stop 2023-11-06T13:28:04.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/1614870156 shutdown_connections 2023-11-06T13:28:04.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/1614870156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d2817e570 0x7f0d28186590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/1614870156 >> 172.21.15.38:0/1614870156 conn(0x7f0d28069ea0 msgr2=0x7f0d2806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:04.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/1614870156 shutdown_connections 2023-11-06T13:28:04.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.495+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/1614870156 wait complete. 2023-11-06T13:28:04.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.497+0000 7f0d2dcc3700 1 Processor -- start 2023-11-06T13:28:04.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.497+0000 7f0d2dcc3700 1 -- start start 2023-11-06T13:28:04.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d2dcc3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 0x7f0d281771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d2dcc3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d281756e0 0x7f0d2816d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d2dcc3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2817e570 0x7f0d2818ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d2dcc3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28176d30 con 0x7f0d280647f0 2023-11-06T13:28:04.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d2dcc3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28175e40 con 0x7f0d281756e0 2023-11-06T13:28:04.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d2dcc3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28176120 con 0x7f0d2817e570 2023-11-06T13:28:04.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 0x7f0d281771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 0x7f0d281771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43796/0 (socket says 172.21.15.38:43796) 2023-11-06T13:28:04.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 -- 172.21.15.38:0/415417272 learned_addr learned my addr 172.21.15.38:0/415417272 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:04.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d26ffd700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d281756e0 0x7f0d2816d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d27fff700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2817e570 0x7f0d2818ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 -- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2817e570 msgr2=0x7f0d2818ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2817e570 0x7f0d2818ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 -- 172.21.15.38:0/415417272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d281756e0 msgr2=0x7f0d2816d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d281756e0 0x7f0d2816d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 -- 172.21.15.38:0/415417272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200092a0 con 0x7f0d280647f0 2023-11-06T13:28:04.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d26ffd700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d281756e0 0x7f0d2816d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:04.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.498+0000 7f0d277fe700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 0x7f0d281771c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f0d1800c7c0 tx=0x7f0d180015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.499+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800a580 con 0x7f0d280647f0 2023-11-06T13:28:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.499+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1800a6e0 con 0x7f0d280647f0 2023-11-06T13:28:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.499+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800aa80 con 0x7f0d280647f0 2023-11-06T13:28:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.499+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d28176400 con 0x7f0d280647f0 2023-11-06T13:28:04.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.499+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d281769c0 con 0x7f0d280647f0 2023-11-06T13:28:04.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.500+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d28177010 con 0x7f0d280647f0 2023-11-06T13:28:04.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.501+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f0d1801b400 con 0x7f0d280647f0 2023-11-06T13:28:04.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.501+0000 7f0d0f7fe700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0d1408cbd0 0x7f0d1408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.502+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0d180b1f80 con 0x7f0d280647f0 2023-11-06T13:28:04.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.502+0000 7f0d26ffd700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0d1408cbd0 0x7f0d1408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.502+0000 7f0d26ffd700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0d1408cbd0 0x7f0d1408f090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0d1c007fd0 tx=0x7f0d1c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.506+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0d180824c0 con 0x7f0d280647f0 2023-11-06T13:28:04.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.679+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0d2806c580 con 0x7f0d280647f0 2023-11-06T13:28:04.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.680+0000 7f0d0f7fe700 1 -- 172.21.15.38:0/415417272 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d18085ae0 con 0x7f0d280647f0 2023-11-06T13:28:04.683 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:04.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.681+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0d1408cbd0 msgr2=0x7f0d1408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.681+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0d1408cbd0 0x7f0d1408f090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0d1c007fd0 tx=0x7f0d1c009040).stop 2023-11-06T13:28:04.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 msgr2=0x7f0d281771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 0x7f0d281771c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f0d1800c7c0 tx=0x7f0d180015e0).stop 2023-11-06T13:28:04.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 shutdown_connections 2023-11-06T13:28:04.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d2817e570 0x7f0d2818ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0d280647f0 0x7f0d281771c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0d1408cbd0 0x7f0d1408f090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 --2- 172.21.15.38:0/415417272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d281756e0 0x7f0d2816d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 >> 172.21.15.38:0/415417272 conn(0x7f0d28069ea0 msgr2=0x7f0d280f25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:04.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 shutdown_connections 2023-11-06T13:28:04.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.682+0000 7f0d2dcc3700 1 -- 172.21.15.38:0/415417272 wait complete. 2023-11-06T13:28:04.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.5 2023-11-06T13:28:04.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-06T13:28:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.814+0000 7fa10759e700 1 Processor -- start 2023-11-06T13:28:04.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.814+0000 7fa10759e700 1 -- start start 2023-11-06T13:28:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.815+0000 7fa10759e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1081752a0 0x7fa108182a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.815+0000 7fa10759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa108180640 0x7fa108085d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.815+0000 7fa10759e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1080871b0 con 0x7fa108175680 2023-11-06T13:28:04.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.815+0000 7fa10759e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1080882f0 con 0x7fa1081752a0 2023-11-06T13:28:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.815+0000 7fa10759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa108182ef0 con 0x7fa108180640 2023-11-06T13:28:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.815+0000 7fa10659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1081752a0 0x7fa108182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa1081752a0 0x7fa108182a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43798/0 (socket says 172.21.15.38:43798) 2023-11-06T13:28:04.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 -- 172.21.15.38:0/306041783 learned_addr learned my addr 172.21.15.38:0/306041783 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa106d9d700 1 --2- 172.21.15.38:0/306041783 >> v2:172.21.15.44:3300/0 conn(0x7fa108180640 0x7fa108085d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 -- 172.21.15.38:0/306041783 >> v2:172.21.15.44:3300/0 conn(0x7fa108180640 msgr2=0x7fa108085d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 --2- 172.21.15.38:0/306041783 >> v2:172.21.15.44:3300/0 conn(0x7fa108180640 0x7fa108085d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10559a700 1 -- 172.21.15.38:0/306041783 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290155437 0 0) 0x7fa1080871b0 con 0x7fa108175680 2023-11-06T13:28:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 -- 172.21.15.38:0/306041783 >> v1:172.21.15.163:6789/0 conn(0x7fa108175680 legacy=0x7fa10817ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 -- 172.21.15.38:0/306041783 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa108087400 con 0x7fa1081752a0 2023-11-06T13:28:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10659c700 1 --2- 172.21.15.38:0/306041783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1081752a0 0x7fa108182a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa1080ca980 tx=0x7fa100009840).ready entity=mon.0 client_cookie=866bf93e1bc31b59 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10559a700 1 -- 172.21.15.38:0/306041783 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000e070 con 0x7fa1081752a0 2023-11-06T13:28:04.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10559a700 1 -- 172.21.15.38:0/306041783 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10000ba20 con 0x7fa1081752a0 2023-11-06T13:28:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.816+0000 7fa10559a700 1 -- 172.21.15.38:0/306041783 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000bda0 con 0x7fa1081752a0 2023-11-06T13:28:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 -- 172.21.15.38:0/306041783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1081752a0 msgr2=0x7fa108182a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 --2- 172.21.15.38:0/306041783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1081752a0 0x7fa108182a00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fa1080ca980 tx=0x7fa100009840).stop 2023-11-06T13:28:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 -- 172.21.15.38:0/306041783 shutdown_connections 2023-11-06T13:28:04.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 --2- 172.21.15.38:0/306041783 >> v2:172.21.15.44:3300/0 conn(0x7fa108180640 0x7fa108085d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 --2- 172.21.15.38:0/306041783 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa1081752a0 0x7fa108182a00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 -- 172.21.15.38:0/306041783 >> 172.21.15.38:0/306041783 conn(0x7fa1080f51f0 msgr2=0x7fa1080f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 -- 172.21.15.38:0/306041783 shutdown_connections 2023-11-06T13:28:04.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.817+0000 7fa10759e700 1 -- 172.21.15.38:0/306041783 wait complete. 2023-11-06T13:28:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.818+0000 7fa10759e700 1 Processor -- start 2023-11-06T13:28:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.818+0000 7fa10759e700 1 -- start start 2023-11-06T13:28:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa10759e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1081752a0 0x7fa108192510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa10759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa108175680 0x7fa10818fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa10759e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 0x7fa108173370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa10759e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa108150ca0 con 0x7fa108180640 2023-11-06T13:28:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa10759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10814fdb0 con 0x7fa108175680 2023-11-06T13:28:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa10759e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa108150090 con 0x7fa1081752a0 2023-11-06T13:28:04.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.819+0000 7fa106d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 0x7fa108173370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 0x7fa108173370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43806/0 (socket says 172.21.15.38:43806) 2023-11-06T13:28:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 -- 172.21.15.38:0/3149713072 learned_addr learned my addr 172.21.15.38:0/3149713072 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa10659c700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1081752a0 0x7fa108192510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa105d9b700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa108175680 0x7fa10818fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 -- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1081752a0 msgr2=0x7fa108192510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1081752a0 0x7fa108192510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 -- 172.21.15.38:0/3149713072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa108175680 msgr2=0x7fa10818fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa108175680 0x7fa10818fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:04.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 -- 172.21.15.38:0/3149713072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100009ae0 con 0x7fa108180640 2023-11-06T13:28:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa106d9d700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 0x7fa108173370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa0f800e900 tx=0x7fa0f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80094d0 con 0x7fa108180640 2023-11-06T13:28:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f8012600 con 0x7fa108180640 2023-11-06T13:28:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8012980 con 0x7fa108180640 2023-11-06T13:28:04.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa108150370 con 0x7fa108180640 2023-11-06T13:28:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.820+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa108150930 con 0x7fa108180640 2023-11-06T13:28:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.821+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa108150e10 con 0x7fa108180640 2023-11-06T13:28:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.822+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fa0f801b400 con 0x7fa108180640 2023-11-06T13:28:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.822+0000 7fa0fe7fc700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa0e808cbd0 0x7fa0e808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:04.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.823+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa0f80b2560 con 0x7fa108180640 2023-11-06T13:28:04.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.823+0000 7fa10659c700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa0e808cbd0 0x7fa0e808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:04.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.823+0000 7fa10659c700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa0e808cbd0 0x7fa0e808f090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa100009880 tx=0x7fa108088260).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:04.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:04.826+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa0f8082aa0 con 0x7fa108180640 2023-11-06T13:28:05.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.001+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa1080876e0 con 0x7fa108180640 2023-11-06T13:28:05.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.001+0000 7fa0fe7fc700 1 -- 172.21.15.38:0/3149713072 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0f80860c0 con 0x7fa108180640 2023-11-06T13:28:05.005 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:05.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa0e808cbd0 msgr2=0x7fa0e808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa0e808cbd0 0x7fa0e808f090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa100009880 tx=0x7fa108088260).stop 2023-11-06T13:28:05.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 msgr2=0x7fa108173370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 0x7fa108173370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa0f800e900 tx=0x7fa0f8009060).stop 2023-11-06T13:28:05.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 shutdown_connections 2023-11-06T13:28:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa108180640 0x7fa108173370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1081752a0 0x7fa108192510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa0e808cbd0 0x7fa0e808f090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 --2- 172.21.15.38:0/3149713072 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa108175680 0x7fa10818fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 >> 172.21.15.38:0/3149713072 conn(0x7fa1080f51f0 msgr2=0x7fa1080f14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 shutdown_connections 2023-11-06T13:28:05.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.003+0000 7fa10759e700 1 -- 172.21.15.38:0/3149713072 wait complete. 2023-11-06T13:28:05.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.6 2023-11-06T13:28:05.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-06T13:28:05.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.134+0000 7fe278787700 1 Processor -- start 2023-11-06T13:28:05.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.134+0000 7fe278787700 1 -- start start 2023-11-06T13:28:05.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe278787700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2701756e0 0x7fe2700640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe278787700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe2700645d0 0x7fe27017de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe278787700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27017d9d0 con 0x7fe27017e350 2023-11-06T13:28:05.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe278787700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700c8560 con 0x7fe2701756e0 2023-11-06T13:28:05.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe278787700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe270064a50 con 0x7fe2700645d0 2023-11-06T13:28:05.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe275d22700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe2700645d0 0x7fe27017de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe276d24700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fe27017e350 0x7fe2700f1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:35106/0 (socket says 172.21.15.38:35106) 2023-11-06T13:28:05.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe276d24700 1 -- 172.21.15.38:0/2903484428 learned_addr learned my addr 172.21.15.38:0/2903484428 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:05.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.135+0000 7fe276523700 1 --2- 172.21.15.38:0/2903484428 >> v2:172.21.15.44:3300/0 conn(0x7fe2701756e0 0x7fe2700640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275521700 1 -- 172.21.15.38:0/2903484428 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323577040 0 0) 0x7fe27017d9d0 con 0x7fe27017e350 2023-11-06T13:28:05.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275521700 1 -- 172.21.15.38:0/2903484428 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c0033f0 con 0x7fe27017e350 2023-11-06T13:28:05.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275d22700 1 -- 172.21.15.38:0/2903484428 >> v2:172.21.15.44:3300/0 conn(0x7fe2701756e0 msgr2=0x7fe2700640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:05.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275d22700 1 --2- 172.21.15.38:0/2903484428 >> v2:172.21.15.44:3300/0 conn(0x7fe2701756e0 0x7fe2700640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275d22700 1 -- 172.21.15.38:0/2903484428 >> v1:172.21.15.163:6789/0 conn(0x7fe27017e350 legacy=0x7fe2700f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275d22700 1 -- 172.21.15.38:0/2903484428 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27017c800 con 0x7fe2700645d0 2023-11-06T13:28:05.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275d22700 1 --2- 172.21.15.38:0/2903484428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2700645d0 0x7fe27017de60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe2700cab80 tx=0x7fe260009060).ready entity=mon.2 client_cookie=332c20c45f86be17 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275521700 1 -- 172.21.15.38:0/2903484428 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000d4a0 con 0x7fe2700645d0 2023-11-06T13:28:05.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275521700 1 -- 172.21.15.38:0/2903484428 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26000d600 con 0x7fe2700645d0 2023-11-06T13:28:05.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe275521700 1 -- 172.21.15.38:0/2903484428 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26000d980 con 0x7fe2700645d0 2023-11-06T13:28:05.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe278787700 1 -- 172.21.15.38:0/2903484428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2700645d0 msgr2=0x7fe27017de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.136+0000 7fe278787700 1 --2- 172.21.15.38:0/2903484428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2700645d0 0x7fe27017de60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe2700cab80 tx=0x7fe260009060).stop 2023-11-06T13:28:05.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.137+0000 7fe278787700 1 -- 172.21.15.38:0/2903484428 shutdown_connections 2023-11-06T13:28:05.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.137+0000 7fe278787700 1 --2- 172.21.15.38:0/2903484428 >> v2:172.21.15.44:3300/0 conn(0x7fe2701756e0 0x7fe2700640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.137+0000 7fe278787700 1 --2- 172.21.15.38:0/2903484428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2700645d0 0x7fe27017de60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.137+0000 7fe278787700 1 -- 172.21.15.38:0/2903484428 >> 172.21.15.38:0/2903484428 conn(0x7fe270069ea0 msgr2=0x7fe27006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.137+0000 7fe278787700 1 -- 172.21.15.38:0/2903484428 shutdown_connections 2023-11-06T13:28:05.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.137+0000 7fe278787700 1 -- 172.21.15.38:0/2903484428 wait complete. 2023-11-06T13:28:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.138+0000 7fe278787700 1 Processor -- start 2023-11-06T13:28:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.138+0000 7fe278787700 1 -- start start 2023-11-06T13:28:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe278787700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 0x7fe270180030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe278787700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2701756e0 0x7fe27016eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe278787700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe27017e350 0x7fe270190c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe278787700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270180520 con 0x7fe2700645d0 2023-11-06T13:28:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe278787700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700f4580 con 0x7fe27017e350 2023-11-06T13:28:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe278787700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270180720 con 0x7fe2701756e0 2023-11-06T13:28:05.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 0x7fe270180030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 0x7fe270180030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43816/0 (socket says 172.21.15.38:43816) 2023-11-06T13:28:05.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 -- 172.21.15.38:0/1470554858 learned_addr learned my addr 172.21.15.38:0/1470554858 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:05.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe275d22700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2701756e0 0x7fe27016eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 -- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2701756e0 msgr2=0x7fe27016eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276d24700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe27017e350 0x7fe270190c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2701756e0 0x7fe27016eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 -- 172.21.15.38:0/1470554858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe27017e350 msgr2=0x7fe270190c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe27017e350 0x7fe270190c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.139+0000 7fe276523700 1 -- 172.21.15.38:0/1470554858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600092a0 con 0x7fe2700645d0 2023-11-06T13:28:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.140+0000 7fe276523700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 0x7fe270180030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fe26c00e900 tx=0x7fe26c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.140+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0093b0 con 0x7fe2700645d0 2023-11-06T13:28:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.140+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c012600 con 0x7fe2700645d0 2023-11-06T13:28:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.140+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c012980 con 0x7fe2700645d0 2023-11-06T13:28:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.140+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270180a00 con 0x7fe2700645d0 2023-11-06T13:28:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.140+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe270180fc0 con 0x7fe2700645d0 2023-11-06T13:28:05.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.141+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27006c580 con 0x7fe2700645d0 2023-11-06T13:28:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.141+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fe26c01b400 con 0x7fe2700645d0 2023-11-06T13:28:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.142+0000 7fe2667fc700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe25408cbd0 0x7fe25408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.142+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fe26c0b23e0 con 0x7fe2700645d0 2023-11-06T13:28:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.143+0000 7fe275d22700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe25408cbd0 0x7fe25408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.143+0000 7fe275d22700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe25408cbd0 0x7fe25408f090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fe260009fd0 tx=0x7fe260016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.146+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fe26c082920 con 0x7fe2700645d0 2023-11-06T13:28:05.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.322+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe27017cae0 con 0x7fe2700645d0 2023-11-06T13:28:05.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.322+0000 7fe2667fc700 1 -- 172.21.15.38:0/1470554858 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe26c085f40 con 0x7fe2700645d0 2023-11-06T13:28:05.326 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:05.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe25408cbd0 msgr2=0x7fe25408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe25408cbd0 0x7fe25408f090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fe260009fd0 tx=0x7fe260016000).stop 2023-11-06T13:28:05.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 msgr2=0x7fe270180030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 0x7fe270180030 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fe26c00e900 tx=0x7fe26c009060).stop 2023-11-06T13:28:05.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 shutdown_connections 2023-11-06T13:28:05.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe25408cbd0 0x7fe25408f090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe27017e350 0x7fe270190c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2700645d0 0x7fe270180030 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 --2- 172.21.15.38:0/1470554858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2701756e0 0x7fe27016eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 >> 172.21.15.38:0/1470554858 conn(0x7fe270069ea0 msgr2=0x7fe27017eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 shutdown_connections 2023-11-06T13:28:05.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.324+0000 7fe278787700 1 -- 172.21.15.38:0/1470554858 wait complete. 2023-11-06T13:28:05.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.7 2023-11-06T13:28:05.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2023-11-06T13:28:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.457+0000 7f52d7496700 1 Processor -- start 2023-11-06T13:28:05.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.457+0000 7f52d7496700 1 -- start start 2023-11-06T13:28:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d7496700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f52d017e570 0x7f52d0186590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d7496700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d017d9d0 con 0x7f52d01756e0 2023-11-06T13:28:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d7496700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d017c800 con 0x7f52d00647f0 2023-11-06T13:28:05.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d7496700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d00c8560 con 0x7f52d017e570 2023-11-06T13:28:05.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d5232700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f52d01756e0 0x7f52d00640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51812/0 (socket says 172.21.15.38:51812) 2023-11-06T13:28:05.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d5232700 1 -- 172.21.15.38:0/2567878607 learned_addr learned my addr 172.21.15.38:0/2567878607 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:05.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.458+0000 7f52d5a33700 1 --2- 172.21.15.38:0/2567878607 >> v2:172.21.15.163:3300/0 conn(0x7f52d017e570 0x7f52d0186590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736982736 0 0) 0x7f52d017d9d0 con 0x7f52d01756e0 2023-11-06T13:28:05.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc0033f0 con 0x7f52d01756e0 2023-11-06T13:28:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028256526 0 0) 0x7f52bc0033f0 con 0x7f52d01756e0 2023-11-06T13:28:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 >> v2:172.21.15.163:3300/0 conn(0x7f52d017e570 msgr2=0x7f52d0186590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 --2- 172.21.15.38:0/2567878607 >> v2:172.21.15.163:3300/0 conn(0x7f52d017e570 0x7f52d0186590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 >> v1:172.21.15.163:6789/0 conn(0x7f52d00647f0 legacy=0x7f52d017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d017cae0 con 0x7f52d01756e0 2023-11-06T13:28:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f52cc001470 con 0x7f52d01756e0 2023-11-06T13:28:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d5a33700 1 --2- 172.21.15.38:0/2567878607 >> v2:172.21.15.163:3300/0 conn(0x7f52d017e570 0x7f52d0186590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 >> v1:172.21.15.38:6789/0 conn(0x7f52d01756e0 legacy=0x7f52d00640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52bc0038e0 0x7f52bc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52bc004690 0x7f52bc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc005000 0x7f52bc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00be20 con 0x7f52bc004690 2023-11-06T13:28:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00bf90 con 0x7f52bc0038e0 2023-11-06T13:28:05.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00c150 con 0x7f52bc005000 2023-11-06T13:28:05.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d4a31700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52bc004690 0x7f52bc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d5a33700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc005000 0x7f52bc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d4a31700 1 -- 172.21.15.38:0/2567878607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc005000 msgr2=0x7f52bc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:05.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d4a31700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc005000 0x7f52bc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d4a31700 1 -- 172.21.15.38:0/2567878607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52bc0038e0 msgr2=0x7f52bc003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:05.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d5232700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52bc0038e0 0x7f52bc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d4a31700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52bc0038e0 0x7f52bc003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d5a33700 1 -- 172.21.15.38:0/2567878607 reap_dead start 2023-11-06T13:28:05.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d4a31700 1 -- 172.21.15.38:0/2567878607 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0033f0 con 0x7f52bc004690 2023-11-06T13:28:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.459+0000 7f52d5232700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52bc0038e0 0x7f52bc003cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d4a31700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52bc004690 0x7f52bc004b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f52c0001820 tx=0x7f52c0007b90).ready entity=mon.0 client_cookie=6d24658eac7efee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0007ea0 con 0x7f52bc004690 2023-11-06T13:28:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c0012400 con 0x7f52bc004690 2023-11-06T13:28:05.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52c7fff700 1 -- 172.21.15.38:0/2567878607 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00127c0 con 0x7f52bc004690 2023-11-06T13:28:05.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 -- 172.21.15.38:0/2567878607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52bc004690 msgr2=0x7f52bc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52bc004690 0x7f52bc004b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f52c0001820 tx=0x7f52c0007b90).stop 2023-11-06T13:28:05.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 -- 172.21.15.38:0/2567878607 shutdown_connections 2023-11-06T13:28:05.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 --2- 172.21.15.38:0/2567878607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52bc004690 0x7f52bc004b10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 -- 172.21.15.38:0/2567878607 >> 172.21.15.38:0/2567878607 conn(0x7f52d0069ea0 msgr2=0x7f52d006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 -- 172.21.15.38:0/2567878607 shutdown_connections 2023-11-06T13:28:05.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.460+0000 7f52d7496700 1 -- 172.21.15.38:0/2567878607 wait complete. 2023-11-06T13:28:05.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.462+0000 7f52d7496700 1 Processor -- start 2023-11-06T13:28:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.462+0000 7f52d7496700 1 -- start start 2023-11-06T13:28:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d7496700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc004690 0x7f52d016a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d7496700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 0x7f52d0190360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d7496700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d0169600 0x7f52d0190850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d7496700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d016ba30 con 0x7f52d0169180 2023-11-06T13:28:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d7496700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d016aad0 con 0x7f52d0169600 2023-11-06T13:28:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d7496700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d016adb0 con 0x7f52bc004690 2023-11-06T13:28:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 0x7f52d0190360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 0x7f52d0190360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43836/0 (socket says 172.21.15.38:43836) 2023-11-06T13:28:05.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 -- 172.21.15.38:0/4055113911 learned_addr learned my addr 172.21.15.38:0/4055113911 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d5232700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc004690 0x7f52d016a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 -- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc004690 msgr2=0x7f52d016a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc004690 0x7f52d016a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 -- 172.21.15.38:0/4055113911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d0169600 msgr2=0x7f52d0190850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d0169600 0x7f52d0190850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:28:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 -- 172.21.15.38:0/4055113911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d016b090 con 0x7f52d0169180 2023-11-06T13:28:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.463+0000 7f52d4a31700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 0x7f52d0190360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f52c0001e10 tx=0x7f52c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.464+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0007ea0 con 0x7f52d0169180 2023-11-06T13:28:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.464+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c0011940 con 0x7f52d0169180 2023-11-06T13:28:05.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.464+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d016b370 con 0x7f52d0169180 2023-11-06T13:28:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.464+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0011ce0 con 0x7f52d0169180 2023-11-06T13:28:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.464+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0190d40 con 0x7f52d0169180 2023-11-06T13:28:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.465+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d016b810 con 0x7f52d0169180 2023-11-06T13:28:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.466+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f52c00273f0 con 0x7f52d0169180 2023-11-06T13:28:05.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.466+0000 7f52c57fa700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f52b408cbd0 0x7f52b408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.466+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f52c00b3030 con 0x7f52d0169180 2023-11-06T13:28:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.466+0000 7f52d5232700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f52b408cbd0 0x7f52b408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.467+0000 7f52d5232700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f52b408cbd0 0x7f52b408f090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f52d00604d0 tx=0x7f52cc009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.469+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f52c0083570 con 0x7f52d0169180 2023-11-06T13:28:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.645+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f52d006c580 con 0x7f52d0169180 2023-11-06T13:28:05.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.645+0000 7f52c57fa700 1 -- 172.21.15.38:0/4055113911 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52c0086b90 con 0x7f52d0169180 2023-11-06T13:28:05.649 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f52b408cbd0 msgr2=0x7f52b408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f52b408cbd0 0x7f52b408f090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f52d00604d0 tx=0x7f52cc009040).stop 2023-11-06T13:28:05.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 msgr2=0x7f52d0190360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 0x7f52d0190360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f52c0001e10 tx=0x7f52c0016000).stop 2023-11-06T13:28:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 shutdown_connections 2023-11-06T13:28:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f52b408cbd0 0x7f52b408f090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52d0169600 0x7f52d0190850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:28:05.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52bc004690 0x7f52d016a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 --2- 172.21.15.38:0/4055113911 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f52d0169180 0x7f52d0190360 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 >> 172.21.15.38:0/4055113911 conn(0x7f52d0069ea0 msgr2=0x7f52d0171140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 shutdown_connections 2023-11-06T13:28:05.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.647+0000 7f52d7496700 1 -- 172.21.15.38:0/4055113911 wait complete. 2023-11-06T13:28:05.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.8 2023-11-06T13:28:05.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2023-11-06T13:28:05.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.779+0000 7f7fc2aa4700 1 Processor -- start 2023-11-06T13:28:05.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.779+0000 7f7fc2aa4700 1 -- start start 2023-11-06T13:28:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc2aa4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7fbc1798f0 0x7f7fbc17e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc2aa4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7fbc17eba0 0x7f7fbc17ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc2aa4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc178d50 con 0x7f7fbc175080 2023-11-06T13:28:05.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc2aa4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc17d700 con 0x7f7fbc1798f0 2023-11-06T13:28:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc2aa4700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc17d9e0 con 0x7f7fbc17eba0 2023-11-06T13:28:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc0840700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f7fbc175080 0x7f7fbc1791e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51826/0 (socket says 172.21.15.38:51826) 2023-11-06T13:28:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc0840700 1 -- 172.21.15.38:0/2613992303 learned_addr learned my addr 172.21.15.38:0/2613992303 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:05.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fbbfff700 1 --2- 172.21.15.38:0/2613992303 >> v2:172.21.15.38:3300/0 conn(0x7f7fbc1798f0 0x7f7fbc17e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fbb7fe700 1 -- 172.21.15.38:0/2613992303 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543445334 0 0) 0x7f7fbc178d50 con 0x7f7fbc175080 2023-11-06T13:28:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fbb7fe700 1 -- 172.21.15.38:0/2613992303 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fa40033f0 con 0x7f7fbc175080 2023-11-06T13:28:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fc1041700 1 --2- 172.21.15.38:0/2613992303 >> v2:172.21.15.44:3300/0 conn(0x7f7fbc17eba0 0x7f7fbc17ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fbbfff700 1 -- 172.21.15.38:0/2613992303 >> v2:172.21.15.44:3300/0 conn(0x7f7fbc17eba0 msgr2=0x7f7fbc17ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:05.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.780+0000 7f7fbbfff700 1 --2- 172.21.15.38:0/2613992303 >> v2:172.21.15.44:3300/0 conn(0x7f7fbc17eba0 0x7f7fbc17ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fbbfff700 1 -- 172.21.15.38:0/2613992303 >> v1:172.21.15.38:6789/0 conn(0x7f7fbc175080 legacy=0x7f7fbc1791e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fbbfff700 1 -- 172.21.15.38:0/2613992303 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc17dcc0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fbbfff700 1 --2- 172.21.15.38:0/2613992303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc17e6b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7fbc06c800 tx=0x7f7fb0009060).ready entity=mon.0 client_cookie=501bfa9d7956a48 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fbb7fe700 1 -- 172.21.15.38:0/2613992303 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000f510 con 0x7f7fbc1798f0 2023-11-06T13:28:05.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fbb7fe700 1 -- 172.21.15.38:0/2613992303 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000f670 con 0x7f7fbc1798f0 2023-11-06T13:28:05.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fbb7fe700 1 -- 172.21.15.38:0/2613992303 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000f9f0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/2613992303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 msgr2=0x7f7fbc17e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/2613992303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc17e6b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f7fbc06c800 tx=0x7f7fb0009060).stop 2023-11-06T13:28:05.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/2613992303 shutdown_connections 2023-11-06T13:28:05.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/2613992303 >> v2:172.21.15.44:3300/0 conn(0x7f7fbc17eba0 0x7f7fbc17ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/2613992303 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc17e6b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/2613992303 >> 172.21.15.38:0/2613992303 conn(0x7f7fbc05e1b0 msgr2=0x7f7fbc05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/2613992303 shutdown_connections 2023-11-06T13:28:05.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.781+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/2613992303 wait complete. 2023-11-06T13:28:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.783+0000 7f7fc2aa4700 1 Processor -- start 2023-11-06T13:28:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.783+0000 7f7fc2aa4700 1 -- start start 2023-11-06T13:28:05.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc2aa4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fbc175080 0x7f7fbc164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc2aa4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc1654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc2aa4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fbc17eba0 0x7f7fbc16e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc2aa4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc169530 con 0x7f7fbc1798f0 2023-11-06T13:28:05.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc2aa4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc168640 con 0x7f7fbc175080 2023-11-06T13:28:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc2aa4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc168920 con 0x7f7fbc17eba0 2023-11-06T13:28:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc1654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc1654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43858/0 (socket says 172.21.15.38:43858) 2023-11-06T13:28:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 -- 172.21.15.38:0/1744704370 learned_addr learned my addr 172.21.15.38:0/1744704370 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:05.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc0840700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fbc175080 0x7f7fbc164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fc1041700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fbc17eba0 0x7f7fbc16e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 -- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fbc17eba0 msgr2=0x7f7fbc16e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fbc17eba0 0x7f7fbc16e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 -- 172.21.15.38:0/1744704370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fbc175080 msgr2=0x7f7fbc164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fbc175080 0x7f7fbc164fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.784+0000 7f7fbbfff700 1 -- 172.21.15.38:0/1744704370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00092a0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.785+0000 7f7fbbfff700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc1654b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f7fb0009dd0 tx=0x7f7fb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.785+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000f7e0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.785+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000f940 con 0x7f7fbc1798f0 2023-11-06T13:28:05.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.785+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc168c00 con 0x7f7fbc1798f0 2023-11-06T13:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.785+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb001b660 con 0x7f7fbc1798f0 2023-11-06T13:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.785+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc1691c0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.786+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc06c580 con 0x7f7fbc1798f0 2023-11-06T13:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.787+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f7fb001ba10 con 0x7f7fbc1798f0 2023-11-06T13:28:05.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.787+0000 7f7fb8ff9700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7fa808cbd0 0x7f7fa808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.787+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7fb00b39b0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.787+0000 7f7fc0840700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7fa808cbd0 0x7f7fa808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:05.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.788+0000 7f7fc0840700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7fa808cbd0 0x7f7fa808f090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7fbc0eafc0 tx=0x7f7fac012040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:05.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.791+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f7fb0083ef0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.967+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f7fbc17dfa0 con 0x7f7fbc1798f0 2023-11-06T13:28:05.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.967+0000 7f7fb8ff9700 1 -- 172.21.15.38:0/1744704370 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fb0029090 con 0x7f7fbc1798f0 2023-11-06T13:28:05.971 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.969+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7fa808cbd0 msgr2=0x7f7fa808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.969+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7fa808cbd0 0x7f7fa808f090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7fbc0eafc0 tx=0x7f7fac012040).stop 2023-11-06T13:28:05.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.969+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 msgr2=0x7f7fbc1654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.969+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc1654b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f7fb0009dd0 tx=0x7f7fb0017000).stop 2023-11-06T13:28:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 shutdown_connections 2023-11-06T13:28:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7fbc17eba0 0x7f7fbc16e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7fa808cbd0 0x7f7fa808f090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fbc175080 0x7f7fbc164fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 --2- 172.21.15.38:0/1744704370 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7fbc1798f0 0x7f7fbc1654b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 >> 172.21.15.38:0/1744704370 conn(0x7f7fbc05e1b0 msgr2=0x7f7fbc0ed8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 shutdown_connections 2023-11-06T13:28:05.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:05.970+0000 7f7fc2aa4700 1 -- 172.21.15.38:0/1744704370 wait complete. 2023-11-06T13:28:05.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.9 2023-11-06T13:28:05.985 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2023-11-06T13:28:06.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.102+0000 7f03af791700 1 Processor -- start 2023-11-06T13:28:06.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.102+0000 7f03af791700 1 -- start start 2023-11-06T13:28:06.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03af791700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f03a81756e0 0x7f03a80640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03af791700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f03a817e570 0x7f03a8185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03af791700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a817d9d0 con 0x7f03a80645d0 2023-11-06T13:28:06.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03af791700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80c8560 con 0x7f03a817e570 2023-11-06T13:28:06.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03af791700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a8064a50 con 0x7f03a81756e0 2023-11-06T13:28:06.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03ad52d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f03a81756e0 0x7f03a80640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03acd2c700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f03a80645d0 0x7f03a817de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:35136/0 (socket says 172.21.15.38:35136) 2023-11-06T13:28:06.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03ad52d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f03a81756e0 0x7f03a80640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:37092/0 (socket says 172.21.15.38:37092) 2023-11-06T13:28:06.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03acd2c700 1 -- 172.21.15.38:0/4176428000 learned_addr learned my addr 172.21.15.38:0/4176428000 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:06.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.103+0000 7f03add2e700 1 --2- 172.21.15.38:0/4176428000 >> v2:172.21.15.44:3300/0 conn(0x7f03a817e570 0x7f03a8185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03ad52d700 1 -- 172.21.15.38:0/4176428000 >> v2:172.21.15.44:3300/0 conn(0x7f03a817e570 msgr2=0x7f03a8185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:06.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03ad52d700 1 --2- 172.21.15.38:0/4176428000 >> v2:172.21.15.44:3300/0 conn(0x7f03a817e570 0x7f03a8185580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03ad52d700 1 -- 172.21.15.38:0/4176428000 >> v1:172.21.15.163:6789/0 conn(0x7f03a80645d0 legacy=0x7f03a817de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03a7fff700 1 -- 172.21.15.38:0/4176428000 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023646875 0 0) 0x7f03a817d9d0 con 0x7f03a80645d0 2023-11-06T13:28:06.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03ad52d700 1 -- 172.21.15.38:0/4176428000 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a817c800 con 0x7f03a81756e0 2023-11-06T13:28:06.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03ad52d700 1 --2- 172.21.15.38:0/4176428000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a81756e0 0x7f03a80640e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f03a80ce060 tx=0x7f0398009780).ready entity=mon.2 client_cookie=c742bf0c4111ba59 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03a7fff700 1 -- 172.21.15.38:0/4176428000 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039800e070 con 0x7f03a81756e0 2023-11-06T13:28:06.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03a7fff700 1 -- 172.21.15.38:0/4176428000 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039800bb60 con 0x7f03a81756e0 2023-11-06T13:28:06.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03a7fff700 1 -- 172.21.15.38:0/4176428000 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398012410 con 0x7f03a81756e0 2023-11-06T13:28:06.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03af791700 1 -- 172.21.15.38:0/4176428000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a81756e0 msgr2=0x7f03a80640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03af791700 1 --2- 172.21.15.38:0/4176428000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a81756e0 0x7f03a80640e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f03a80ce060 tx=0x7f0398009780).stop 2023-11-06T13:28:06.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03af791700 1 -- 172.21.15.38:0/4176428000 shutdown_connections 2023-11-06T13:28:06.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03af791700 1 --2- 172.21.15.38:0/4176428000 >> v2:172.21.15.44:3300/0 conn(0x7f03a817e570 0x7f03a8185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03af791700 1 --2- 172.21.15.38:0/4176428000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a81756e0 0x7f03a80640e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.104+0000 7f03af791700 1 -- 172.21.15.38:0/4176428000 >> 172.21.15.38:0/4176428000 conn(0x7f03a8069ea0 msgr2=0x7f03a806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:06.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.105+0000 7f03af791700 1 -- 172.21.15.38:0/4176428000 shutdown_connections 2023-11-06T13:28:06.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.105+0000 7f03af791700 1 -- 172.21.15.38:0/4176428000 wait complete. 2023-11-06T13:28:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.106+0000 7f03af791700 1 Processor -- start 2023-11-06T13:28:06.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.106+0000 7f03af791700 1 -- start start 2023-11-06T13:28:06.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03af791700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a80645d0 0x7f03a8192960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03af791700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03a81756e0 0x7f03a8192e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03af791700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 0x7f03a816ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03af791700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80f0260 con 0x7f03a817e570 2023-11-06T13:28:06.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03af791700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8191620 con 0x7f03a81756e0 2023-11-06T13:28:06.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03af791700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8191900 con 0x7f03a80645d0 2023-11-06T13:28:06.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03add2e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 0x7f03a816ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03add2e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 0x7f03a816ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:43870/0 (socket says 172.21.15.38:43870) 2023-11-06T13:28:06.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03add2e700 1 -- 172.21.15.38:0/3214985681 learned_addr learned my addr 172.21.15.38:0/3214985681 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:06.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03ad52d700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a80645d0 0x7f03a8192960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.107+0000 7f03acd2c700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03a81756e0 0x7f03a8192e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03add2e700 1 -- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a80645d0 msgr2=0x7f03a8192960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03add2e700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a80645d0 0x7f03a8192960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03add2e700 1 -- 172.21.15.38:0/3214985681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03a81756e0 msgr2=0x7f03a8192e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03add2e700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03a81756e0 0x7f03a8192e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03add2e700 1 -- 172.21.15.38:0/3214985681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398009a20 con 0x7f03a817e570 2023-11-06T13:28:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03add2e700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 0x7f03a816ddd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f03a000e900 tx=0x7f03a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0012600 con 0x7f03a817e570 2023-11-06T13:28:06.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0012760 con 0x7f03a817e570 2023-11-06T13:28:06.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a8191be0 con 0x7f03a817e570 2023-11-06T13:28:06.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0012ae0 con 0x7f03a817e570 2023-11-06T13:28:06.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.108+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a81921a0 con 0x7f03a817e570 2023-11-06T13:28:06.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.109+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a80f03f0 con 0x7f03a817e570 2023-11-06T13:28:06.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.110+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f03a001b400 con 0x7f03a817e570 2023-11-06T13:28:06.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.110+0000 7f03a57fa700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f039408cbd0 0x7f039408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.110+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f03a00b23e0 con 0x7f03a817e570 2023-11-06T13:28:06.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.110+0000 7f03ad52d700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f039408cbd0 0x7f039408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.111+0000 7f03ad52d700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f039408cbd0 0x7f039408f090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f03980094d0 tx=0x7f0398009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.114+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f03a80f03f0 con 0x7f03a817e570 2023-11-06T13:28:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.285+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f03a80f03f0 con 0x7f03a817e570 2023-11-06T13:28:06.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.286+0000 7f03a57fa700 1 -- 172.21.15.38:0/3214985681 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f03a80f03f0 con 0x7f03a817e570 2023-11-06T13:28:06.289 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.287+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f039408cbd0 msgr2=0x7f039408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.287+0000 7f03af791700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f039408cbd0 0x7f039408f090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f03980094d0 tx=0x7f0398009780).stop 2023-11-06T13:28:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 msgr2=0x7f03a816ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 0x7f03a816ddd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f03a000e900 tx=0x7f03a0009060).stop 2023-11-06T13:28:06.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 shutdown_connections 2023-11-06T13:28:06.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f03a817e570 0x7f03a816ddd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03a80645d0 0x7f03a8192960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f039408cbd0 0x7f039408f090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 --2- 172.21.15.38:0/3214985681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03a81756e0 0x7f03a8192e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 >> 172.21.15.38:0/3214985681 conn(0x7f03a8069ea0 msgr2=0x7f03a806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:06.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 shutdown_connections 2023-11-06T13:28:06.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.288+0000 7f03af791700 1 -- 172.21.15.38:0/3214985681 wait complete. 2023-11-06T13:28:06.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.10 2023-11-06T13:28:06.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2023-11-06T13:28:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.420+0000 7f45c071a700 1 Processor -- start 2023-11-06T13:28:06.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.420+0000 7f45c071a700 1 -- start start 2023-11-06T13:28:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45c071a700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f45b80cb4b0 0x7f45b81758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45c071a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b817e680 con 0x7f45b817c950 2023-11-06T13:28:06.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45c071a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b817d4f0 con 0x7f45b8175510 2023-11-06T13:28:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45c071a700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b817d790 con 0x7f45b80cb4b0 2023-11-06T13:28:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45bdcb5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f45b80cb4b0 0x7f45b81758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45becb7700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f45b817c950 0x7f45b817cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:47062/0 (socket says 172.21.15.38:47062) 2023-11-06T13:28:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45be4b6700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f45b8175510 0x7f45b80cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:50716/0 (socket says 172.21.15.38:50716) 2023-11-06T13:28:06.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45becb7700 1 -- 172.21.15.38:0/1907454100 learned_addr learned my addr 172.21.15.38:0/1907454100 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.421+0000 7f45bdcb5700 1 --2- 172.21.15.38:0/1907454100 >> v2:172.21.15.163:3300/0 conn(0x7f45b80cb4b0 0x7f45b81758f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39548/0 (socket says 172.21.15.38:39548) 2023-11-06T13:28:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bdcb5700 1 -- 172.21.15.38:0/1907454100 >> v1:172.21.15.163:6789/0 conn(0x7f45b8175510 legacy=0x7f45b80cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bdcb5700 1 -- 172.21.15.38:0/1907454100 >> v1:172.21.15.44:6789/0 conn(0x7f45b817c950 legacy=0x7f45b817cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bdcb5700 1 -- 172.21.15.38:0/1907454100 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b817da70 con 0x7f45b80cb4b0 2023-11-06T13:28:06.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bdcb5700 1 --2- 172.21.15.38:0/1907454100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b80cb4b0 0x7f45b81758f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f45ac009790 tx=0x7f45ac009060).ready entity=mon.2 client_cookie=2e2b5117830529f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bd4b4700 1 -- 172.21.15.38:0/1907454100 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00b580 con 0x7f45b80cb4b0 2023-11-06T13:28:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bd4b4700 1 -- 172.21.15.38:0/1907454100 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac00b6e0 con 0x7f45b80cb4b0 2023-11-06T13:28:06.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45bd4b4700 1 -- 172.21.15.38:0/1907454100 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac00ba60 con 0x7f45b80cb4b0 2023-11-06T13:28:06.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 -- 172.21.15.38:0/1907454100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b80cb4b0 msgr2=0x7f45b81758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 --2- 172.21.15.38:0/1907454100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b80cb4b0 0x7f45b81758f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f45ac009790 tx=0x7f45ac009060).stop 2023-11-06T13:28:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 -- 172.21.15.38:0/1907454100 shutdown_connections 2023-11-06T13:28:06.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 --2- 172.21.15.38:0/1907454100 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b80cb4b0 0x7f45b81758f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 -- 172.21.15.38:0/1907454100 >> 172.21.15.38:0/1907454100 conn(0x7f45b80f28b0 msgr2=0x7f45b8069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 -- 172.21.15.38:0/1907454100 shutdown_connections 2023-11-06T13:28:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.422+0000 7f45c071a700 1 -- 172.21.15.38:0/1907454100 wait complete. 2023-11-06T13:28:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.424+0000 7f45c071a700 1 Processor -- start 2023-11-06T13:28:06.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.424+0000 7f45c071a700 1 -- start start 2023-11-06T13:28:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45c071a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b80cb4b0 0x7f45b81793f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45c071a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 0x7f45b81798e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45c071a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 0x7f45b8062920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45c071a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b817ae40 con 0x7f45b817c950 2023-11-06T13:28:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45c071a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b817ab60 con 0x7f45b80cb4b0 2023-11-06T13:28:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45c071a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8182130 con 0x7f45b8175510 2023-11-06T13:28:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 0x7f45b8062920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45bdcb5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 0x7f45b81798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 0x7f45b8062920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48334/0 (socket says 172.21.15.38:48334) 2023-11-06T13:28:06.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 -- 172.21.15.38:0/3298365591 learned_addr learned my addr 172.21.15.38:0/3298365591 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:06.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45bdcb5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 0x7f45b81798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39552/0 (socket says 172.21.15.38:39552) 2023-11-06T13:28:06.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45be4b6700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b80cb4b0 0x7f45b81793f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 -- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 msgr2=0x7f45b81798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 0x7f45b81798e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 -- 172.21.15.38:0/3298365591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b80cb4b0 msgr2=0x7f45b81793f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.425+0000 7f45becb7700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b80cb4b0 0x7f45b81793f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45becb7700 1 -- 172.21.15.38:0/3298365591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0092a0 con 0x7f45b817c950 2023-11-06T13:28:06.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45bdcb5700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 0x7f45b81798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:06.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45becb7700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 0x7f45b8062920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f45a800c410 tx=0x7f45a8007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800ce70 con 0x7f45b817c950 2023-11-06T13:28:06.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80072e0 con 0x7f45b817c950 2023-11-06T13:28:06.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b8179f50 con 0x7f45b817c950 2023-11-06T13:28:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80057a0 con 0x7f45b817c950 2023-11-06T13:28:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.426+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b817a510 con 0x7f45b817c950 2023-11-06T13:28:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.427+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b81758f0 con 0x7f45b817c950 2023-11-06T13:28:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.428+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f45a8005b90 con 0x7f45b817c950 2023-11-06T13:28:06.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.428+0000 7f45b67fc700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f45a408cbd0 0x7f45a408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.428+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f45a80b1740 con 0x7f45b817c950 2023-11-06T13:28:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.428+0000 7f45be4b6700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f45a408cbd0 0x7f45a408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.429+0000 7f45be4b6700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f45a408cbd0 0x7f45a408f090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f45b0001a10 tx=0x7f45b0001560).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.432+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f45a8081c80 con 0x7f45b817c950 2023-11-06T13:28:06.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.606+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f45b806c580 con 0x7f45b817c950 2023-11-06T13:28:06.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.606+0000 7f45b67fc700 1 -- 172.21.15.38:0/3298365591 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f45a8018030 con 0x7f45b817c950 2023-11-06T13:28:06.610 INFO:teuthology.orchestra.run.smithi038.stdout:73014444040 2023-11-06T13:28:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f45a408cbd0 msgr2=0x7f45a408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f45a408cbd0 0x7f45a408f090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f45b0001a10 tx=0x7f45b0001560).stop 2023-11-06T13:28:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 msgr2=0x7f45b8062920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 0x7f45b8062920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f45a800c410 tx=0x7f45a8007d30).stop 2023-11-06T13:28:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 shutdown_connections 2023-11-06T13:28:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f45b817c950 0x7f45b8062920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f45a408cbd0 0x7f45a408f090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45b80cb4b0 0x7f45b81793f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 --2- 172.21.15.38:0/3298365591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f45b8175510 0x7f45b81798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 >> 172.21.15.38:0/3298365591 conn(0x7f45b80f28b0 msgr2=0x7f45b817cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:06.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 shutdown_connections 2023-11-06T13:28:06.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.608+0000 7f45c071a700 1 -- 172.21.15.38:0/3298365591 wait complete. 2023-11-06T13:28:06.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.11 2023-11-06T13:28:06.624 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-06T13:28:06.624 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:28:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.739+0000 7fa745c9a700 1 Processor -- start 2023-11-06T13:28:06.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.740+0000 7fa745c9a700 1 -- start start 2023-11-06T13:28:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa745c9a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa740183120 0x7fa7400cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa745c9a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa740068dc0 con 0x7fa7400cac60 2023-11-06T13:28:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa745c9a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa740181460 con 0x7fa7400cb530 2023-11-06T13:28:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa745c9a700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa740181720 con 0x7fa740183120 2023-11-06T13:28:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa740183120 0x7fa7400cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa740183120 0x7fa7400cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48342/0 (socket says 172.21.15.38:48342) 2023-11-06T13:28:06.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 -- 172.21.15.38:0/1005510502 learned_addr learned my addr 172.21.15.38:0/1005510502 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 -- 172.21.15.38:0/1005510502 >> v1:172.21.15.163:6789/0 conn(0x7fa7400cb530 legacy=0x7fa740069250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73e7fc700 1 -- 172.21.15.38:0/1005510502 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891115794 0 0) 0x7fa740068dc0 con 0x7fa7400cac60 2023-11-06T13:28:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 -- 172.21.15.38:0/1005510502 >> v1:172.21.15.44:6789/0 conn(0x7fa7400cac60 legacy=0x7fa740182a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 -- 172.21.15.38:0/1005510502 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740181a00 con 0x7fa740183120 2023-11-06T13:28:06.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73effd700 1 --2- 172.21.15.38:0/1005510502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740183120 0x7fa7400cb040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa734009830 tx=0x7fa7340090f0).ready entity=mon.0 client_cookie=ed334ed6523052f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73e7fc700 1 -- 172.21.15.38:0/1005510502 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400b600 con 0x7fa740183120 2023-11-06T13:28:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.741+0000 7fa73e7fc700 1 -- 172.21.15.38:0/1005510502 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400b760 con 0x7fa740183120 2023-11-06T13:28:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa73e7fc700 1 -- 172.21.15.38:0/1005510502 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400bae0 con 0x7fa740183120 2023-11-06T13:28:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 -- 172.21.15.38:0/1005510502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740183120 msgr2=0x7fa7400cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 --2- 172.21.15.38:0/1005510502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740183120 0x7fa7400cb040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa734009830 tx=0x7fa7340090f0).stop 2023-11-06T13:28:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 -- 172.21.15.38:0/1005510502 shutdown_connections 2023-11-06T13:28:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 --2- 172.21.15.38:0/1005510502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa740183120 0x7fa7400cb040 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 -- 172.21.15.38:0/1005510502 >> 172.21.15.38:0/1005510502 conn(0x7fa7400f3cf0 msgr2=0x7fa7400efc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 -- 172.21.15.38:0/1005510502 shutdown_connections 2023-11-06T13:28:06.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.742+0000 7fa745c9a700 1 -- 172.21.15.38:0/1005510502 wait complete. 2023-11-06T13:28:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.744+0000 7fa745c9a700 1 Processor -- start 2023-11-06T13:28:06.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.744+0000 7fa745c9a700 1 -- start start 2023-11-06T13:28:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7400cac60 0x7fa74016c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 0x7fa7400ea920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa740183120 0x7fa740190790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74017c120 con 0x7fa7400cb530 2023-11-06T13:28:06.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74017af50 con 0x7fa740183120 2023-11-06T13:28:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74017b230 con 0x7fa7400cac60 2023-11-06T13:28:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 0x7fa7400ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 0x7fa7400ea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48344/0 (socket says 172.21.15.38:48344) 2023-11-06T13:28:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 -- 172.21.15.38:0/3176179518 learned_addr learned my addr 172.21.15.38:0/3176179518 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:06.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73f7fe700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7400cac60 0x7fa74016c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73ffff700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa740183120 0x7fa740190790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 -- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7400cac60 msgr2=0x7fa74016c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7400cac60 0x7fa74016c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 -- 172.21.15.38:0/3176179518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa740183120 msgr2=0x7fa740190790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa740183120 0x7fa740190790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 -- 172.21.15.38:0/3176179518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009370 con 0x7fa7400cb530 2023-11-06T13:28:06.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa73effd700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 0x7fa7400ea920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa740086fe0 tx=0x7fa734017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400b8d0 con 0x7fa7400cb530 2023-11-06T13:28:06.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400ba30 con 0x7fa7400cb530 2023-11-06T13:28:06.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74017b510 con 0x7fa7400cb530 2023-11-06T13:28:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.745+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73401c670 con 0x7fa7400cb530 2023-11-06T13:28:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.746+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74017bad0 con 0x7fa7400cb530 2023-11-06T13:28:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.746+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74017c290 con 0x7fa7400cb530 2023-11-06T13:28:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.747+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fa73401ca20 con 0x7fa7400cb530 2023-11-06T13:28:06.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.748+0000 7fa7277fe700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72c08cbd0 0x7fa72c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:06.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.748+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa7340b42d0 con 0x7fa7400cb530 2023-11-06T13:28:06.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.748+0000 7fa73f7fe700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72c08cbd0 0x7fa72c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:06.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.749+0000 7fa73f7fe700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72c08cbd0 0x7fa72c08f090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa7300038c0 tx=0x7fa730007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:06.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.751+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa734084810 con 0x7fa7400cb530 2023-11-06T13:28:06.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.919+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa740181ce0 con 0x7fa72c08cbd0 2023-11-06T13:28:06.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.932+0000 7fa7277fe700 1 -- 172.21.15.38:0/3176179518 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434783 (secure 0 0 0) 0x7fa740181ce0 con 0x7fa72c08cbd0 2023-11-06T13:28:06.940 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72c08cbd0 msgr2=0x7fa72c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72c08cbd0 0x7fa72c08f090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa7300038c0 tx=0x7fa730007d40).stop 2023-11-06T13:28:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 msgr2=0x7fa7400ea920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 0x7fa7400ea920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fa740086fe0 tx=0x7fa734017000).stop 2023-11-06T13:28:06.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 shutdown_connections 2023-11-06T13:28:06.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa72c08cbd0 0x7fa72c08f090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa740183120 0x7fa740190790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7400cac60 0x7fa74016c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 --2- 172.21.15.38:0/3176179518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa7400cb530 0x7fa7400ea920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:06.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.935+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 >> 172.21.15.38:0/3176179518 conn(0x7fa7400f3cf0 msgr2=0x7fa7401708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:06.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.936+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 shutdown_connections 2023-11-06T13:28:06.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:06.936+0000 7fa745c9a700 1 -- 172.21.15.38:0/3176179518 wait complete. 2023-11-06T13:28:06.946 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:28:06.951 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-11-06T13:28:05.257565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":56275,"num_objects":100,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":104,"num_read_kb":115,"num_write":234,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569556,"kb_used_data":4404,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892524,"statfs":{"total":1159641169920,"available":1155985944576,"internally_reserved":0,"allocated":4509696,"data_stored":2077602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53969,"num_objects":78,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":104,"num_read_kb":115,"num_write":189,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003751"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'27","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:03.272489+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:28:03.272489+0000","last_peered":"2023-11-06T13:28:03.272489+0000","last_clean":"2023-11-06T13:28:03.272489+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:28:03.272489+0000","last_undegraded":"2023-11-06T13:28:03.272489+0000","last_fullsized":"2023-11-06T13:28:03.272489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48095,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":48,"num_write":29,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'6","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.260399+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:28:02.260399+0000","last_peered":"2023-11-06T13:28:02.260399+0000","last_clean":"2023-11-06T13:28:02.260399+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:28:02.260399+0000","last_undegraded":"2023-11-06T13:28:02.260399+0000","last_fullsized":"2023-11-06T13:28:02.260399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.491675+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:27:57.491675+0000","last_peered":"2023-11-06T13:27:57.491675+0000","last_clean":"2023-11-06T13:27:57.491675+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:27:57.491675+0000","last_undegraded":"2023-11-06T13:27:57.491675+0000","last_fullsized":"2023-11-06T13:27:57.491675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.260355+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:28:02.260355+0000","last_peered":"2023-11-06T13:28:02.260355+0000","last_clean":"2023-11-06T13:28:02.260355+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:28:02.260355+0000","last_undegraded":"2023-11-06T13:28:02.260355+0000","last_fullsized":"2023-11-06T13:28:02.260355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.265486+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:28:02.265486+0000","last_peered":"2023-11-06T13:28:02.265486+0000","last_clean":"2023-11-06T13:28:02.265486+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:28:02.265486+0000","last_undegraded":"2023-11-06T13:28:02.265486+0000","last_fullsized":"2023-11-06T13:28:02.265486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261513+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.261513+0000","last_peered":"2023-11-06T13:27:57.261513+0000","last_clean":"2023-11-06T13:27:57.261513+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.261513+0000","last_undegraded":"2023-11-06T13:27:57.261513+0000","last_fullsized":"2023-11-06T13:27:57.261513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.257294+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:28:02.257294+0000","last_peered":"2023-11-06T13:28:02.257294+0000","last_clean":"2023-11-06T13:28:02.257294+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:28:02.257294+0000","last_undegraded":"2023-11-06T13:28:02.257294+0000","last_fullsized":"2023-11-06T13:28:02.257294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.265831+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:28:02.265831+0000","last_peered":"2023-11-06T13:28:02.265831+0000","last_clean":"2023-11-06T13:28:02.265831+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:28:02.265831+0000","last_undegraded":"2023-11-06T13:28:02.265831+0000","last_fullsized":"2023-11-06T13:28:02.265831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.260867+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:28:02.260867+0000","last_peered":"2023-11-06T13:28:02.260867+0000","last_clean":"2023-11-06T13:28:02.260867+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:28:02.260867+0000","last_undegraded":"2023-11-06T13:28:02.260867+0000","last_fullsized":"2023-11-06T13:28:02.260867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'3","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.270979+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:28:02.270979+0000","last_peered":"2023-11-06T13:28:02.270979+0000","last_clean":"2023-11-06T13:28:02.270979+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:28:02.270979+0000","last_undegraded":"2023-11-06T13:28:02.270979+0000","last_fullsized":"2023-11-06T13:28:02.270979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:03.257996+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:28:03.257996+0000","last_peered":"2023-11-06T13:28:03.257996+0000","last_clean":"2023-11-06T13:28:03.257996+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:28:03.257996+0000","last_undegraded":"2023-11-06T13:28:03.257996+0000","last_fullsized":"2023-11-06T13:28:03.257996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":56029,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":104,"num_read_kb":115,"num_write":232,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":112058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":213946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":8,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":6,"up_from":17,"seq":73014444041,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":0,"up_from":17,"seq":73014444041,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":165567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":3,"up_from":17,"seq":73014444042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":166449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444041,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":450560,"data_stored":221188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":51829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":48683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:28:06.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:28:07.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.106+0000 7fa060ed9700 1 Processor -- start 2023-11-06T13:28:07.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.106+0000 7fa060ed9700 1 -- start start 2023-11-06T13:28:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.107+0000 7fa060ed9700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa05c17bf30 0x7fa05c17c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.107+0000 7fa060ed9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c0ee9a0 con 0x7fa05c172470 2023-11-06T13:28:07.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.107+0000 7fa060ed9700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c0edab0 con 0x7fa05c0f01d0 2023-11-06T13:28:07.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.107+0000 7fa060ed9700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c0edd90 con 0x7fa05c17bf30 2023-11-06T13:28:07.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa05c17bf30 0x7fa05c17c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa05c17bf30 0x7fa05c17c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39580/0 (socket says 172.21.15.38:39580) 2023-11-06T13:28:07.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 -- 172.21.15.38:0/2423631449 learned_addr learned my addr 172.21.15.38:0/2423631449 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa05ad9d700 1 --1- 172.21.15.38:0/2423631449 >> v1:172.21.15.163:6789/0 conn(0x7fa05c0f01d0 0x7fa05c0f0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:50742/0 (socket says 172.21.15.38:50742) 2023-11-06T13:28:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa05a59c700 1 --1- 172.21.15.38:0/2423631449 >> v1:172.21.15.44:6789/0 conn(0x7fa05c172470 0x7fa05c0ed070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:47086/0 (socket says 172.21.15.38:47086) 2023-11-06T13:28:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 -- 172.21.15.38:0/2423631449 >> v1:172.21.15.163:6789/0 conn(0x7fa05c0f01d0 legacy=0x7fa05c0f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 -- 172.21.15.38:0/2423631449 >> v1:172.21.15.44:6789/0 conn(0x7fa05c172470 legacy=0x7fa05c0ed070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa05959a700 1 -- 172.21.15.38:0/2423631449 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194218756 0 0) 0x7fa05c0ee9a0 con 0x7fa05c172470 2023-11-06T13:28:07.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 -- 172.21.15.38:0/2423631449 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0ee070 con 0x7fa05c17bf30 2023-11-06T13:28:07.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa059d9b700 1 --2- 172.21.15.38:0/2423631449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c17c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa044006fd0 tx=0x7fa0440090f0).ready entity=mon.2 client_cookie=31b2003af392f854 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa05959a700 1 -- 172.21.15.38:0/2423631449 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400b600 con 0x7fa05c17bf30 2023-11-06T13:28:07.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa05959a700 1 -- 172.21.15.38:0/2423631449 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400b760 con 0x7fa05c17bf30 2023-11-06T13:28:07.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.108+0000 7fa05959a700 1 -- 172.21.15.38:0/2423631449 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04400bb00 con 0x7fa05c17bf30 2023-11-06T13:28:07.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 -- 172.21.15.38:0/2423631449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 msgr2=0x7fa05c17c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 --2- 172.21.15.38:0/2423631449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c17c3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa044006fd0 tx=0x7fa0440090f0).stop 2023-11-06T13:28:07.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 -- 172.21.15.38:0/2423631449 shutdown_connections 2023-11-06T13:28:07.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 --2- 172.21.15.38:0/2423631449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c17c3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 -- 172.21.15.38:0/2423631449 >> 172.21.15.38:0/2423631449 conn(0x7fa05c0ef630 msgr2=0x7fa05c05e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:07.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 -- 172.21.15.38:0/2423631449 shutdown_connections 2023-11-06T13:28:07.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.109+0000 7fa060ed9700 1 -- 172.21.15.38:0/2423631449 wait complete. 2023-11-06T13:28:07.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.110+0000 7fa060ed9700 1 Processor -- start 2023-11-06T13:28:07.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.110+0000 7fa060ed9700 1 -- start start 2023-11-06T13:28:07.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.111+0000 7fa060ed9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 0x7fa05c172b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.111+0000 7fa060ed9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c172470 0x7fa05c0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.111+0000 7fa060ed9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.111+0000 7fa060ed9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c173060 con 0x7fa05c0f01d0 2023-11-06T13:28:07.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.111+0000 7fa060ed9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c160910 con 0x7fa05c172470 2023-11-06T13:28:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.111+0000 7fa060ed9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0c7fc0 con 0x7fa05c17bf30 2023-11-06T13:28:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 0x7fa05c172b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 0x7fa05c172b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48348/0 (socket says 172.21.15.38:48348) 2023-11-06T13:28:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 -- 172.21.15.38:0/4274954871 learned_addr learned my addr 172.21.15.38:0/4274954871 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa059d9b700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c172470 0x7fa05c0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05ad9d700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 -- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 msgr2=0x7fa05c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 -- 172.21.15.38:0/4274954871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c172470 msgr2=0x7fa05c0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c172470 0x7fa05c0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 -- 172.21.15.38:0/4274954871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009370 con 0x7fa05c0f01d0 2023-11-06T13:28:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa059d9b700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c172470 0x7fa05c0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa05a59c700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 0x7fa05c172b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa05400c440 tx=0x7fa054007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540070d0 con 0x7fa05c0f01d0 2023-11-06T13:28:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054007230 con 0x7fa05c0f01d0 2023-11-06T13:28:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c0c8230 con 0x7fa05c0f01d0 2023-11-06T13:28:07.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540056e0 con 0x7fa05c0f01d0 2023-11-06T13:28:07.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.112+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c0c87f0 con 0x7fa05c0f01d0 2023-11-06T13:28:07.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.113+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c0c89e0 con 0x7fa05c0f01d0 2023-11-06T13:28:07.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.114+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fa054005a90 con 0x7fa05c0f01d0 2023-11-06T13:28:07.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.115+0000 7fa0527fc700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa03c08cbd0 0x7fa03c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.115+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa0540b1620 con 0x7fa05c0f01d0 2023-11-06T13:28:07.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.115+0000 7fa059d9b700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa03c08cbd0 0x7fa03c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.115+0000 7fa059d9b700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa03c08cbd0 0x7fa03c08f090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa044009130 tx=0x7fa044017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.119+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa054081b60 con 0x7fa05c0f01d0 2023-11-06T13:28:07.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.288+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa05c06c580 con 0x7fa03c08cbd0 2023-11-06T13:28:07.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.300+0000 7fa0527fc700 1 -- 172.21.15.38:0/4274954871 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434783 (secure 0 0 0) 0x7fa05c06c580 con 0x7fa03c08cbd0 2023-11-06T13:28:07.308 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:07.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa03c08cbd0 msgr2=0x7fa03c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa03c08cbd0 0x7fa03c08f090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fa044009130 tx=0x7fa044017000).stop 2023-11-06T13:28:07.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 msgr2=0x7fa05c172b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 0x7fa05c172b70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa05400c440 tx=0x7fa054007e30).stop 2023-11-06T13:28:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 shutdown_connections 2023-11-06T13:28:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa05c17bf30 0x7fa05c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa05c0f01d0 0x7fa05c172b70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa03c08cbd0 0x7fa03c08f090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 --2- 172.21.15.38:0/4274954871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa05c172470 0x7fa05c0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 >> 172.21.15.38:0/4274954871 conn(0x7fa05c0ef630 msgr2=0x7fa05c0e9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:07.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 shutdown_connections 2023-11-06T13:28:07.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.304+0000 7fa060ed9700 1 -- 172.21.15.38:0/4274954871 wait complete. 2023-11-06T13:28:07.314 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:28:07.319 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-06T13:28:07.258395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":56275,"num_objects":100,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":104,"num_read_kb":115,"num_write":234,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569556,"kb_used_data":4404,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892524,"statfs":{"total":1159641169920,"available":1155985944576,"internally_reserved":0,"allocated":4509696,"data_stored":2077602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51790,"num_objects":78,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":104,"num_read_kb":115,"num_write":186,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004111"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'27","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:03.272489+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:28:03.272489+0000","last_peered":"2023-11-06T13:28:03.272489+0000","last_clean":"2023-11-06T13:28:03.272489+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:28:03.272489+0000","last_undegraded":"2023-11-06T13:28:03.272489+0000","last_fullsized":"2023-11-06T13:28:03.272489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48095,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":48,"num_write":29,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'6","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.260399+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:28:02.260399+0000","last_peered":"2023-11-06T13:28:02.260399+0000","last_clean":"2023-11-06T13:28:02.260399+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:28:02.260399+0000","last_undegraded":"2023-11-06T13:28:02.260399+0000","last_fullsized":"2023-11-06T13:28:02.260399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1494,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.491675+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:27:57.491675+0000","last_peered":"2023-11-06T13:27:57.491675+0000","last_clean":"2023-11-06T13:27:57.491675+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:27:57.491675+0000","last_undegraded":"2023-11-06T13:27:57.491675+0000","last_fullsized":"2023-11-06T13:27:57.491675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.260355+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:28:02.260355+0000","last_peered":"2023-11-06T13:28:02.260355+0000","last_clean":"2023-11-06T13:28:02.260355+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:28:02.260355+0000","last_undegraded":"2023-11-06T13:28:02.260355+0000","last_fullsized":"2023-11-06T13:28:02.260355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.265486+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:28:02.265486+0000","last_peered":"2023-11-06T13:28:02.265486+0000","last_clean":"2023-11-06T13:28:02.265486+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:28:02.265486+0000","last_undegraded":"2023-11-06T13:28:02.265486+0000","last_fullsized":"2023-11-06T13:28:02.265486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261513+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.261513+0000","last_peered":"2023-11-06T13:27:57.261513+0000","last_clean":"2023-11-06T13:27:57.261513+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.261513+0000","last_undegraded":"2023-11-06T13:27:57.261513+0000","last_fullsized":"2023-11-06T13:27:57.261513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.257294+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:28:02.257294+0000","last_peered":"2023-11-06T13:28:02.257294+0000","last_clean":"2023-11-06T13:28:02.257294+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:28:02.257294+0000","last_undegraded":"2023-11-06T13:28:02.257294+0000","last_fullsized":"2023-11-06T13:28:02.257294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.265831+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:28:02.265831+0000","last_peered":"2023-11-06T13:28:02.265831+0000","last_clean":"2023-11-06T13:28:02.265831+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:28:02.265831+0000","last_undegraded":"2023-11-06T13:28:02.265831+0000","last_fullsized":"2023-11-06T13:28:02.265831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.260867+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:28:02.260867+0000","last_peered":"2023-11-06T13:28:02.260867+0000","last_clean":"2023-11-06T13:28:02.260867+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:28:02.260867+0000","last_undegraded":"2023-11-06T13:28:02.260867+0000","last_fullsized":"2023-11-06T13:28:02.260867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'3","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.270979+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:28:02.270979+0000","last_peered":"2023-11-06T13:28:02.270979+0000","last_clean":"2023-11-06T13:28:02.270979+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:28:02.270979+0000","last_undegraded":"2023-11-06T13:28:02.270979+0000","last_fullsized":"2023-11-06T13:28:02.270979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'4","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:03.257996+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:28:03.257996+0000","last_peered":"2023-11-06T13:28:03.257996+0000","last_clean":"2023-11-06T13:28:03.257996+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:28:03.257996+0000","last_undegraded":"2023-11-06T13:28:03.257996+0000","last_fullsized":"2023-11-06T13:28:03.257996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":56029,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":104,"num_read_kb":115,"num_write":232,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":112058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":213946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":8,"up_from":17,"seq":73014444040,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":6,"up_from":17,"seq":73014444041,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":0,"up_from":17,"seq":73014444041,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":165567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":3,"up_from":17,"seq":73014444042,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":166449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444041,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":450560,"data_stored":221188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":51829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":48683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:28:07.328 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-06T13:28:07.328 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-06T13:28:07.328 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-06T13:28:07.328 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-06T13:28:07.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.473+0000 7fdb80cd2700 1 Processor -- start 2023-11-06T13:28:07.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.473+0000 7fdb80cd2700 1 -- start start 2023-11-06T13:28:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb80cd2700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb7c17c510 0x7fdb7c180ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb80cd2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0ece10 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb80cd2700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c17f9a0 con 0x7fdb7c0ed2a0 2023-11-06T13:28:07.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb80cd2700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c17fc80 con 0x7fdb7c17c510 2023-11-06T13:28:07.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb7a59c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb7c17c510 0x7fdb7c180ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb79d9b700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fdb7c0ed2a0 0x7fdb7c0ed720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:50752/0 (socket says 172.21.15.38:50752) 2023-11-06T13:28:07.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb79d9b700 1 -- 172.21.15.38:0/3025122538 learned_addr learned my addr 172.21.15.38:0/3025122538 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:07.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb7a59c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb7c17c510 0x7fdb7c180ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39606/0 (socket says 172.21.15.38:39606) 2023-11-06T13:28:07.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb7a59c700 1 -- 172.21.15.38:0/3025122538 >> v1:172.21.15.163:6789/0 conn(0x7fdb7c0ed2a0 legacy=0x7fdb7c0ed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb7959a700 1 -- 172.21.15.38:0/3025122538 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007998334 0 0) 0x7fdb7c0ece10 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb7a59c700 1 -- 172.21.15.38:0/3025122538 >> v1:172.21.15.44:6789/0 conn(0x7fdb7c17e2e0 legacy=0x7fdb7c17e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.475+0000 7fdb7a59c700 1 -- 172.21.15.38:0/3025122538 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c17ff60 con 0x7fdb7c17c510 2023-11-06T13:28:07.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb7a59c700 1 --2- 172.21.15.38:0/3025122538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c180ec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fdb74009760 tx=0x7fdb74009060).ready entity=mon.2 client_cookie=2a96453734dbd5f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb7959a700 1 -- 172.21.15.38:0/3025122538 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400b580 con 0x7fdb7c17c510 2023-11-06T13:28:07.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb7959a700 1 -- 172.21.15.38:0/3025122538 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400b6e0 con 0x7fdb7c17c510 2023-11-06T13:28:07.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb7959a700 1 -- 172.21.15.38:0/3025122538 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400ba60 con 0x7fdb7c17c510 2023-11-06T13:28:07.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3025122538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 msgr2=0x7fdb7c180ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3025122538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c180ec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fdb74009760 tx=0x7fdb74009060).stop 2023-11-06T13:28:07.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3025122538 shutdown_connections 2023-11-06T13:28:07.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3025122538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c180ec0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3025122538 >> 172.21.15.38:0/3025122538 conn(0x7fdb7c05e1b0 msgr2=0x7fdb7c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:07.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3025122538 shutdown_connections 2023-11-06T13:28:07.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.476+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3025122538 wait complete. 2023-11-06T13:28:07.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.478+0000 7fdb80cd2700 1 Processor -- start 2023-11-06T13:28:07.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.478+0000 7fdb80cd2700 1 -- start start 2023-11-06T13:28:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb80cd2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 0x7fdb7c175300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb80cd2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb80cd2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 0x7fdb7c0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb80cd2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c1030 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb80cd2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0c2130 con 0x7fdb7c0ed2a0 2023-11-06T13:28:07.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb80cd2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0efb60 con 0x7fdb7c17c510 2023-11-06T13:28:07.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb79d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb7a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 0x7fdb7c175300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb7ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 0x7fdb7c0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb7a59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 0x7fdb7c175300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:49672/0 (socket says 172.21.15.38:49672) 2023-11-06T13:28:07.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb7ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 0x7fdb7c0c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48356/0 (socket says 172.21.15.38:48356) 2023-11-06T13:28:07.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb79d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39622/0 (socket says 172.21.15.38:39622) 2023-11-06T13:28:07.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.479+0000 7fdb7a59c700 1 -- 172.21.15.38:0/3111474945 learned_addr learned my addr 172.21.15.38:0/3111474945 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:07.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7ad9d700 1 -- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 msgr2=0x7fdb7c0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7ad9d700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7ad9d700 1 -- 172.21.15.38:0/3111474945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 msgr2=0x7fdb7c175300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7ad9d700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 0x7fdb7c175300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7ad9d700 1 -- 172.21.15.38:0/3111474945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740092a0 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7a59c700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 0x7fdb7c175300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:07.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb79d9b700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:07.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb7ad9d700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 0x7fdb7c0c6620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fdb6c00c810 tx=0x7fdb6c001480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00f470 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c00f5d0 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c0c1240 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00f970 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.480+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0c1800 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.481+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c0c22c0 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.482+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fdb6c012400 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.482+0000 7fdb727fc700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb5c08cbd0 0x7fdb5c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.482+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fdb6c0b1690 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.482+0000 7fdb7a59c700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb5c08cbd0 0x7fdb5c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.483+0000 7fdb7a59c700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb5c08cbd0 0x7fdb5c08f090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdb74006e00 tx=0x7fdb74017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.486+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdb6c081bd0 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.697+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdb7c084790 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.697+0000 7fdb727fc700 1 -- 172.21.15.38:0/3111474945 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fdb6c017070 con 0x7fdb7c17e2e0 2023-11-06T13:28:07.701 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:07.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb5c08cbd0 msgr2=0x7fdb5c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb5c08cbd0 0x7fdb5c08f090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdb74006e00 tx=0x7fdb74017000).stop 2023-11-06T13:28:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 msgr2=0x7fdb7c0c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 0x7fdb7c0c6620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fdb6c00c810 tx=0x7fdb6c001480).stop 2023-11-06T13:28:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 shutdown_connections 2023-11-06T13:28:07.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb7c17e2e0 0x7fdb7c0c6620 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb5c08cbd0 0x7fdb5c08f090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb7c0ed2a0 0x7fdb7c175300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 --2- 172.21.15.38:0/3111474945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb7c17c510 0x7fdb7c0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 >> 172.21.15.38:0/3111474945 conn(0x7fdb7c05e1b0 msgr2=0x7fdb7c0c4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 shutdown_connections 2023-11-06T13:28:07.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.699+0000 7fdb80cd2700 1 -- 172.21.15.38:0/3111474945 wait complete. 2023-11-06T13:28:07.714 INFO:teuthology.orchestra.run.smithi038.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-06T13:28:07.715 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-06T13:28:07.715 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:07.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.830+0000 7f8c46a30700 1 Processor -- start 2023-11-06T13:28:07.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.830+0000 7f8c46a30700 1 -- start start 2023-11-06T13:28:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.831+0000 7f8c46a30700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8c400647f0 0x7f8c4017de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.831+0000 7f8c46a30700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c4017e350 0x7f8c40185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.831+0000 7f8c46a30700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4017d9d0 con 0x7f8c401756e0 2023-11-06T13:28:07.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.831+0000 7f8c46a30700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c400c8560 con 0x7f8c4017e350 2023-11-06T13:28:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.831+0000 7f8c46a30700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4017c800 con 0x7f8c400647f0 2023-11-06T13:28:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c4017e350 0x7f8c40185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8c4017e350 0x7f8c40185580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48364/0 (socket says 172.21.15.38:48364) 2023-11-06T13:28:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 -- 172.21.15.38:0/1223644214 learned_addr learned my addr 172.21.15.38:0/1223644214 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:07.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c3f7fe700 1 --2- 172.21.15.38:0/1223644214 >> v2:172.21.15.163:3300/0 conn(0x7f8c400647f0 0x7f8c4017de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 -- 172.21.15.38:0/1223644214 >> v2:172.21.15.163:3300/0 conn(0x7f8c400647f0 msgr2=0x7f8c4017de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 --2- 172.21.15.38:0/1223644214 >> v2:172.21.15.163:3300/0 conn(0x7f8c400647f0 0x7f8c4017de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 -- 172.21.15.38:0/1223644214 >> v1:172.21.15.44:6789/0 conn(0x7f8c401756e0 legacy=0x7f8c400640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 -- 172.21.15.38:0/1223644214 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4017cae0 con 0x7f8c4017e350 2023-11-06T13:28:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c44fcd700 1 --2- 172.21.15.38:0/1223644214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c4017e350 0x7f8c40185580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f8c400cab80 tx=0x7f8c38009840).ready entity=mon.0 client_cookie=55dc33617ff31d5a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c3effd700 1 -- 172.21.15.38:0/1223644214 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800e070 con 0x7f8c4017e350 2023-11-06T13:28:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c3effd700 1 -- 172.21.15.38:0/1223644214 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800ba50 con 0x7f8c4017e350 2023-11-06T13:28:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.832+0000 7f8c3effd700 1 -- 172.21.15.38:0/1223644214 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800bdd0 con 0x7f8c4017e350 2023-11-06T13:28:07.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 -- 172.21.15.38:0/1223644214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c4017e350 msgr2=0x7f8c40185580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 --2- 172.21.15.38:0/1223644214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c4017e350 0x7f8c40185580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f8c400cab80 tx=0x7f8c38009840).stop 2023-11-06T13:28:07.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 -- 172.21.15.38:0/1223644214 shutdown_connections 2023-11-06T13:28:07.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 --2- 172.21.15.38:0/1223644214 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c4017e350 0x7f8c40185580 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 --2- 172.21.15.38:0/1223644214 >> v2:172.21.15.163:3300/0 conn(0x7f8c400647f0 0x7f8c4017de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 -- 172.21.15.38:0/1223644214 >> 172.21.15.38:0/1223644214 conn(0x7f8c40069ea0 msgr2=0x7f8c4006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:07.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 -- 172.21.15.38:0/1223644214 shutdown_connections 2023-11-06T13:28:07.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.833+0000 7f8c46a30700 1 -- 172.21.15.38:0/1223644214 wait complete. 2023-11-06T13:28:07.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.834+0000 7f8c46a30700 1 Processor -- start 2023-11-06T13:28:07.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.834+0000 7f8c46a30700 1 -- start start 2023-11-06T13:28:07.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.835+0000 7f8c46a30700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 0x7f8c4016e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.835+0000 7f8c46a30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c401756e0 0x7f8c400c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.835+0000 7f8c46a30700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c4017e350 0x7f8c400c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.835+0000 7f8c46a30700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400c4c50 con 0x7f8c400647f0 2023-11-06T13:28:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.835+0000 7f8c46a30700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40181490 con 0x7f8c4017e350 2023-11-06T13:28:07.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.835+0000 7f8c46a30700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40181770 con 0x7f8c401756e0 2023-11-06T13:28:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 0x7f8c4016e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 0x7f8c4016e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48378/0 (socket says 172.21.15.38:48378) 2023-11-06T13:28:07.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 -- 172.21.15.38:0/3012126548 learned_addr learned my addr 172.21.15.38:0/3012126548 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c44fcd700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c4017e350 0x7f8c400c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3f7fe700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c401756e0 0x7f8c400c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 -- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c401756e0 msgr2=0x7f8c400c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c401756e0 0x7f8c400c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 -- 172.21.15.38:0/3012126548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c4017e350 msgr2=0x7f8c400c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c4017e350 0x7f8c400c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 -- 172.21.15.38:0/3012126548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009ae0 con 0x7f8c400647f0 2023-11-06T13:28:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c3ffff700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 0x7f8c4016e300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8c3000c440 tx=0x7f8c30007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000cea0 con 0x7f8c400647f0 2023-11-06T13:28:07.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000f470 con 0x7f8c400647f0 2023-11-06T13:28:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000f810 con 0x7f8c400647f0 2023-11-06T13:28:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c40181a50 con 0x7f8c400647f0 2023-11-06T13:28:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.836+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4016e7f0 con 0x7f8c400647f0 2023-11-06T13:28:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.837+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4016ea70 con 0x7f8c400647f0 2023-11-06T13:28:07.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.838+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f8c3000fc00 con 0x7f8c400647f0 2023-11-06T13:28:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.839+0000 7f8c37fff700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c2008cbd0 0x7f8c2008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.839+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f8c300b1540 con 0x7f8c400647f0 2023-11-06T13:28:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.839+0000 7f8c3f7fe700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c2008cbd0 0x7f8c2008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.839+0000 7f8c3f7fe700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c2008cbd0 0x7f8c2008f090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8c28006fd0 tx=0x7f8c28008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:07.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:07.843+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8c4016ea70 con 0x7f8c400647f0 2023-11-06T13:28:08.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.015+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c4016ea70 con 0x7f8c400647f0 2023-11-06T13:28:08.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.016+0000 7f8c37fff700 1 -- 172.21.15.38:0/3012126548 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f8c4016ea70 con 0x7f8c400647f0 2023-11-06T13:28:08.020 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:08.020 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:08.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c2008cbd0 msgr2=0x7f8c2008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c2008cbd0 0x7f8c2008f090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8c28006fd0 tx=0x7f8c28008040).stop 2023-11-06T13:28:08.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 msgr2=0x7f8c4016e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 0x7f8c4016e300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f8c3000c440 tx=0x7f8c30007dc0).stop 2023-11-06T13:28:08.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 shutdown_connections 2023-11-06T13:28:08.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8c2008cbd0 0x7f8c2008f090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c4017e350 0x7f8c400c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8c400647f0 0x7f8c4016e300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 --2- 172.21.15.38:0/3012126548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8c401756e0 0x7f8c400c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 >> 172.21.15.38:0/3012126548 conn(0x7f8c40069ea0 msgr2=0x7f8c4016f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 shutdown_connections 2023-11-06T13:28:08.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.018+0000 7f8c46a30700 1 -- 172.21.15.38:0/3012126548 wait complete. 2023-11-06T13:28:08.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-06T13:27:40.368418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-06T13:27:40.848313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-06T13:27:43.934481+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-06T13:28:08.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:28:08.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.153+0000 7fc43f2bd700 1 Processor -- start 2023-11-06T13:28:08.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.153+0000 7fc43f2bd700 1 -- start start 2023-11-06T13:28:08.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.154+0000 7fc43f2bd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc438184840 0x7fc438186c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.154+0000 7fc43f2bd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43817ddd0 con 0x7fc438175a40 2023-11-06T13:28:08.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.154+0000 7fc43f2bd700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc438064780 con 0x7fc43817e260 2023-11-06T13:28:08.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.154+0000 7fc43f2bd700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4380c4c20 con 0x7fc438184840 2023-11-06T13:28:08.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d059700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc438175a40 0x7fc43817f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43782/0 (socket says 172.21.15.38:43782) 2023-11-06T13:28:08.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d059700 1 -- 172.21.15.38:0/3517785316 learned_addr learned my addr 172.21.15.38:0/3517785316 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:08.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d85a700 1 --2- 172.21.15.38:0/3517785316 >> v2:172.21.15.38:3300/0 conn(0x7fc438184840 0x7fc438186c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc437fff700 1 -- 172.21.15.38:0/3517785316 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700199859 0 0) 0x7fc43817ddd0 con 0x7fc438175a40 2023-11-06T13:28:08.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc437fff700 1 -- 172.21.15.38:0/3517785316 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4200033f0 con 0x7fc438175a40 2023-11-06T13:28:08.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d85a700 1 -- 172.21.15.38:0/3517785316 >> v1:172.21.15.44:6789/0 conn(0x7fc43817e260 legacy=0x7fc43817e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc437fff700 1 -- 172.21.15.38:0/3517785316 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288804334 0 0) 0x7fc438064780 con 0x7fc43817e260 2023-11-06T13:28:08.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d85a700 1 -- 172.21.15.38:0/3517785316 >> v1:172.21.15.38:6789/0 conn(0x7fc438175a40 legacy=0x7fc43817f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d85a700 1 -- 172.21.15.38:0/3517785316 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43817fda0 con 0x7fc438184840 2023-11-06T13:28:08.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc43d85a700 1 --2- 172.21.15.38:0/3517785316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438184840 0x7fc438186c30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc428009e60 tx=0x7fc428009780).ready entity=mon.0 client_cookie=37aa4f49bdce85ca server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc437fff700 1 -- 172.21.15.38:0/3517785316 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800e070 con 0x7fc438184840 2023-11-06T13:28:08.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc437fff700 1 -- 172.21.15.38:0/3517785316 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800bb60 con 0x7fc438184840 2023-11-06T13:28:08.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.155+0000 7fc437fff700 1 -- 172.21.15.38:0/3517785316 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42800bee0 con 0x7fc438184840 2023-11-06T13:28:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3517785316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438184840 msgr2=0x7fc438186c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3517785316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438184840 0x7fc438186c30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fc428009e60 tx=0x7fc428009780).stop 2023-11-06T13:28:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3517785316 shutdown_connections 2023-11-06T13:28:08.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3517785316 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438184840 0x7fc438186c30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3517785316 >> 172.21.15.38:0/3517785316 conn(0x7fc43806a970 msgr2=0x7fc4380f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3517785316 shutdown_connections 2023-11-06T13:28:08.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.156+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3517785316 wait complete. 2023-11-06T13:28:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.157+0000 7fc43f2bd700 1 Processor -- start 2023-11-06T13:28:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.157+0000 7fc43f2bd700 1 -- start start 2023-11-06T13:28:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.158+0000 7fc43f2bd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 0x7fc438063220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.158+0000 7fc43f2bd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43817e260 0x7fc4381781e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.158+0000 7fc43f2bd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc438184840 0x7fc4381786d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.158+0000 7fc43f2bd700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438177d50 con 0x7fc438175a40 2023-11-06T13:28:08.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.158+0000 7fc43f2bd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438183970 con 0x7fc43817e260 2023-11-06T13:28:08.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.158+0000 7fc43f2bd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438183c50 con 0x7fc438184840 2023-11-06T13:28:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 0x7fc438063220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 0x7fc438063220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48396/0 (socket says 172.21.15.38:48396) 2023-11-06T13:28:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 -- 172.21.15.38:0/3811905762 learned_addr learned my addr 172.21.15.38:0/3811905762 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43c858700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43817e260 0x7fc4381781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 -- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc438184840 msgr2=0x7fc4381786d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d85a700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc438184840 0x7fc4381786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc438184840 0x7fc4381786d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 -- 172.21.15.38:0/3811905762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43817e260 msgr2=0x7fc4381781e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43817e260 0x7fc4381781e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 -- 172.21.15.38:0/3811905762 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428009a20 con 0x7fc438175a40 2023-11-06T13:28:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43c858700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43817e260 0x7fc4381781e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d85a700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc438184840 0x7fc4381786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43d059700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 0x7fc438063220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc43000c420 tx=0x7fc430007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300072e0 con 0x7fc438175a40 2023-11-06T13:28:08.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430007440 con 0x7fc438175a40 2023-11-06T13:28:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc438183f30 con 0x7fc438175a40 2023-11-06T13:28:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300057a0 con 0x7fc438175a40 2023-11-06T13:28:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.159+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4381844f0 con 0x7fc438175a40 2023-11-06T13:28:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.160+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc438178030 con 0x7fc438175a40 2023-11-06T13:28:08.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.161+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fc430005bd0 con 0x7fc438175a40 2023-11-06T13:28:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.162+0000 7fc4357fa700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc42408cbd0 0x7fc42408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.162+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fc4300b15b0 con 0x7fc438175a40 2023-11-06T13:28:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.162+0000 7fc43c858700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc42408cbd0 0x7fc42408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.162+0000 7fc43c858700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc42408cbd0 0x7fc42408f090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc42c0011e0 tx=0x7fc42c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.166+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fc430081af0 con 0x7fc438175a40 2023-11-06T13:28:08.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.341+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc43806c580 con 0x7fc438175a40 2023-11-06T13:28:08.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.341+0000 7fc4357fa700 1 -- 172.21.15.38:0/3811905762 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc43806c580 con 0x7fc438175a40 2023-11-06T13:28:08.345 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:28:08.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc42408cbd0 msgr2=0x7fc42408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc42408cbd0 0x7fc42408f090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc42c0011e0 tx=0x7fc42c009040).stop 2023-11-06T13:28:08.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 msgr2=0x7fc438063220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 0x7fc438063220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc43000c420 tx=0x7fc430007c80).stop 2023-11-06T13:28:08.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 shutdown_connections 2023-11-06T13:28:08.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc438184840 0x7fc4381786d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc438175a40 0x7fc438063220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc42408cbd0 0x7fc42408f090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 --2- 172.21.15.38:0/3811905762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc43817e260 0x7fc4381781e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 >> 172.21.15.38:0/3811905762 conn(0x7fc43806a970 msgr2=0x7fc4380f25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 shutdown_connections 2023-11-06T13:28:08.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.343+0000 7fc43f2bd700 1 -- 172.21.15.38:0/3811905762 wait complete. 2023-11-06T13:28:08.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:28:08.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.477+0000 7fa24bfdc700 1 Processor -- start 2023-11-06T13:28:08.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.477+0000 7fa24bfdc700 1 -- start start 2023-11-06T13:28:08.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.478+0000 7fa24bfdc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa244179070 0x7fa2440ed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.478+0000 7fa24bfdc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa244180310 0x7fa2441807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.478+0000 7fa24bfdc700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa244063ed0 con 0x7fa244178c90 2023-11-06T13:28:08.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.478+0000 7fa24bfdc700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440641b0 con 0x7fa244179070 2023-11-06T13:28:08.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.478+0000 7fa24bfdc700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa244064490 con 0x7fa244180310 2023-11-06T13:28:08.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249577700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa244179070 0x7fa2440ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249d78700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa244178c90 0x7fa2440eca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:47116/0 (socket says 172.21.15.38:47116) 2023-11-06T13:28:08.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249d78700 1 -- 172.21.15.38:0/2194578023 learned_addr learned my addr 172.21.15.38:0/2194578023 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:08.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa24a579700 1 --2- 172.21.15.38:0/2194578023 >> v2:172.21.15.163:3300/0 conn(0x7fa244180310 0x7fa2441807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249577700 1 -- 172.21.15.38:0/2194578023 >> v2:172.21.15.163:3300/0 conn(0x7fa244180310 msgr2=0x7fa2441807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249577700 1 --2- 172.21.15.38:0/2194578023 >> v2:172.21.15.163:3300/0 conn(0x7fa244180310 0x7fa2441807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249577700 1 -- 172.21.15.38:0/2194578023 >> v1:172.21.15.44:6789/0 conn(0x7fa244178c90 legacy=0x7fa2440eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249577700 1 -- 172.21.15.38:0/2194578023 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244064770 con 0x7fa244179070 2023-11-06T13:28:08.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa248d76700 1 -- 172.21.15.38:0/2194578023 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158027601 0 0) 0x7fa244063ed0 con 0x7fa244178c90 2023-11-06T13:28:08.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa249577700 1 --2- 172.21.15.38:0/2194578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244179070 0x7fa2440ed170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa2440ce030 tx=0x7fa238009060).ready entity=mon.1 client_cookie=b3f262710c74976 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa248d76700 1 -- 172.21.15.38:0/2194578023 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380090d0 con 0x7fa244179070 2023-11-06T13:28:08.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa248d76700 1 -- 172.21.15.38:0/2194578023 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800f510 con 0x7fa244179070 2023-11-06T13:28:08.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.479+0000 7fa248d76700 1 -- 172.21.15.38:0/2194578023 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800f890 con 0x7fa244179070 2023-11-06T13:28:08.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 -- 172.21.15.38:0/2194578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244179070 msgr2=0x7fa2440ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/2194578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244179070 0x7fa2440ed170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa2440ce030 tx=0x7fa238009060).stop 2023-11-06T13:28:08.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 -- 172.21.15.38:0/2194578023 shutdown_connections 2023-11-06T13:28:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/2194578023 >> v2:172.21.15.163:3300/0 conn(0x7fa244180310 0x7fa2441807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/2194578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244179070 0x7fa2440ed170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 -- 172.21.15.38:0/2194578023 >> 172.21.15.38:0/2194578023 conn(0x7fa2440f5df0 msgr2=0x7fa2440f1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 -- 172.21.15.38:0/2194578023 shutdown_connections 2023-11-06T13:28:08.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.480+0000 7fa24bfdc700 1 -- 172.21.15.38:0/2194578023 wait complete. 2023-11-06T13:28:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.481+0000 7fa24bfdc700 1 Processor -- start 2023-11-06T13:28:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.481+0000 7fa24bfdc700 1 -- start start 2023-11-06T13:28:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa24bfdc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 0x7fa244191bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa24bfdc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa244179070 0x7fa244160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa24bfdc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244180310 0x7fa244160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa24bfdc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244191720 con 0x7fa244178c90 2023-11-06T13:28:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa24bfdc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440f4fc0 con 0x7fa244180310 2023-11-06T13:28:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa24bfdc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa244190830 con 0x7fa244179070 2023-11-06T13:28:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa249d78700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 0x7fa244191bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.482+0000 7fa249d78700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 0x7fa244191bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48398/0 (socket says 172.21.15.38:48398) 2023-11-06T13:28:08.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 -- 172.21.15.38:0/1864566 learned_addr learned my addr 172.21.15.38:0/1864566 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:08.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa24a579700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244180310 0x7fa244160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249577700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa244179070 0x7fa244160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 -- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa244179070 msgr2=0x7fa244160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa244179070 0x7fa244160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 -- 172.21.15.38:0/1864566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244180310 msgr2=0x7fa244160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244180310 0x7fa244160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 -- 172.21.15.38:0/1864566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380092a0 con 0x7fa244178c90 2023-11-06T13:28:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa249d78700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 0x7fa244191bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa234001eb0 tx=0x7fa234007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400ce90 con 0x7fa244178c90 2023-11-06T13:28:08.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340072e0 con 0x7fa244178c90 2023-11-06T13:28:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234007680 con 0x7fa244178c90 2023-11-06T13:28:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa244190b10 con 0x7fa244178c90 2023-11-06T13:28:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.483+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2441910d0 con 0x7fa244178c90 2023-11-06T13:28:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.484+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa244065250 con 0x7fa244178c90 2023-11-06T13:28:08.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.485+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fa2340059b0 con 0x7fa244178c90 2023-11-06T13:28:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.486+0000 7fa241ffb700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa23008cbd0 0x7fa23008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.486+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fa2340b1790 con 0x7fa244178c90 2023-11-06T13:28:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.486+0000 7fa249577700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa23008cbd0 0x7fa23008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.486+0000 7fa249577700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa23008cbd0 0x7fa23008f090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa2440ce030 tx=0x7fa238017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.490+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fa234081cd0 con 0x7fa244178c90 2023-11-06T13:28:08.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.661+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa24406c580 con 0x7fa244178c90 2023-11-06T13:28:08.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.661+0000 7fa241ffb700 1 -- 172.21.15.38:0/1864566 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa2340852f0 con 0x7fa244178c90 2023-11-06T13:28:08.669 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:28:08.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa23008cbd0 msgr2=0x7fa23008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa23008cbd0 0x7fa23008f090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa2440ce030 tx=0x7fa238017000).stop 2023-11-06T13:28:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 msgr2=0x7fa244191bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 0x7fa244191bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa234001eb0 tx=0x7fa234007e90).stop 2023-11-06T13:28:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 shutdown_connections 2023-11-06T13:28:08.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa23008cbd0 0x7fa23008f090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa244180310 0x7fa244160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa244178c90 0x7fa244191bb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 --2- 172.21.15.38:0/1864566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa244179070 0x7fa244160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 >> 172.21.15.38:0/1864566 conn(0x7fa2440f5df0 msgr2=0x7fa244177f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 shutdown_connections 2023-11-06T13:28:08.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.663+0000 7fa24bfdc700 1 -- 172.21.15.38:0/1864566 wait complete. 2023-11-06T13:28:08.679 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-06T13:28:08.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.796+0000 7eff4bdc8700 1 Processor -- start 2023-11-06T13:28:08.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.797+0000 7eff4bdc8700 1 -- start start 2023-11-06T13:28:08.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff4bdc8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff44173370 0x7eff44173750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff4bdc8700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4406ad80 con 0x7eff4417d7f0 2023-11-06T13:28:08.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff4bdc8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff44083bc0 con 0x7eff4417d3b0 2023-11-06T13:28:08.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff4bdc8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4417ab80 con 0x7eff44173370 2023-11-06T13:28:08.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff49b64700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7eff44173370 0x7eff44173750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff4a365700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7eff4417d7f0 0x7eff441834c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43798/0 (socket says 172.21.15.38:43798) 2023-11-06T13:28:08.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff4a365700 1 -- 172.21.15.38:0/1054526668 learned_addr learned my addr 172.21.15.38:0/1054526668 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:08.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff49b64700 1 -- 172.21.15.38:0/1054526668 >> v1:172.21.15.44:6789/0 conn(0x7eff4417d3b0 legacy=0x7eff4417bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff49b64700 1 -- 172.21.15.38:0/1054526668 >> v1:172.21.15.38:6789/0 conn(0x7eff4417d7f0 legacy=0x7eff441834c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff49b64700 1 -- 172.21.15.38:0/1054526668 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4417ae60 con 0x7eff44173370 2023-11-06T13:28:08.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff48b62700 1 -- 172.21.15.38:0/1054526668 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202335110 0 0) 0x7eff4406ad80 con 0x7eff4417d7f0 2023-11-06T13:28:08.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff49b64700 1 --2- 172.21.15.38:0/1054526668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff44173370 0x7eff44173750 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7eff3c009e60 tx=0x7eff3c009780).ready entity=mon.0 client_cookie=893ce9a6572dd44c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.798+0000 7eff48b62700 1 -- 172.21.15.38:0/1054526668 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00e070 con 0x7eff44173370 2023-11-06T13:28:08.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff48b62700 1 -- 172.21.15.38:0/1054526668 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c00bc30 con 0x7eff44173370 2023-11-06T13:28:08.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff48b62700 1 -- 172.21.15.38:0/1054526668 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c012410 con 0x7eff44173370 2023-11-06T13:28:08.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 -- 172.21.15.38:0/1054526668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff44173370 msgr2=0x7eff44173750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/1054526668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff44173370 0x7eff44173750 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7eff3c009e60 tx=0x7eff3c009780).stop 2023-11-06T13:28:08.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 -- 172.21.15.38:0/1054526668 shutdown_connections 2023-11-06T13:28:08.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/1054526668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff44173370 0x7eff44173750 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 -- 172.21.15.38:0/1054526668 >> 172.21.15.38:0/1054526668 conn(0x7eff440f06f0 msgr2=0x7eff4405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 -- 172.21.15.38:0/1054526668 shutdown_connections 2023-11-06T13:28:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.799+0000 7eff4bdc8700 1 -- 172.21.15.38:0/1054526668 wait complete. 2023-11-06T13:28:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.801+0000 7eff4bdc8700 1 Processor -- start 2023-11-06T13:28:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.801+0000 7eff4bdc8700 1 -- start start 2023-11-06T13:28:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff44173370 0x7eff44155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 0x7eff44190370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4417d7f0 0x7eff44190860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff44179180 con 0x7eff4417d3b0 2023-11-06T13:28:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff441560b0 con 0x7eff4417d7f0 2023-11-06T13:28:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff441788c0 con 0x7eff44173370 2023-11-06T13:28:08.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 0x7eff44190370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 0x7eff44190370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48426/0 (socket says 172.21.15.38:48426) 2023-11-06T13:28:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 -- 172.21.15.38:0/2639425837 learned_addr learned my addr 172.21.15.38:0/2639425837 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4a365700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4417d7f0 0x7eff44190860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49b64700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff44173370 0x7eff44155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 -- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff44173370 msgr2=0x7eff44155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff44173370 0x7eff44155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 -- 172.21.15.38:0/2639425837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4417d7f0 msgr2=0x7eff44190860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4417d7f0 0x7eff44190860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 -- 172.21.15.38:0/2639425837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c009a20 con 0x7eff4417d3b0 2023-11-06T13:28:08.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49b64700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff44173370 0x7eff44155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:08.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff49363700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 0x7eff44190370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7eff3800c470 tx=0x7eff38007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38007020 con 0x7eff4417d3b0 2023-11-06T13:28:08.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38007180 con 0x7eff4417d3b0 2023-11-06T13:28:08.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38007500 con 0x7eff4417d3b0 2023-11-06T13:28:08.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.802+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44190e60 con 0x7eff4417d3b0 2023-11-06T13:28:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.803+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff44178e10 con 0x7eff4417d3b0 2023-11-06T13:28:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.804+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff44179310 con 0x7eff4417d3b0 2023-11-06T13:28:08.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.804+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7eff380068b0 con 0x7eff4417d3b0 2023-11-06T13:28:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.805+0000 7eff41ffb700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7eff3008cbd0 0x7eff3008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:08.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.805+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7eff380b1430 con 0x7eff4417d3b0 2023-11-06T13:28:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.805+0000 7eff49b64700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7eff3008cbd0 0x7eff3008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.805+0000 7eff49b64700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7eff3008cbd0 0x7eff3008f090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7eff3c009e60 tx=0x7eff3c009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:08.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.809+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7eff380818f0 con 0x7eff4417d3b0 2023-11-06T13:28:08.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.980+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff4406c580 con 0x7eff4417d3b0 2023-11-06T13:28:08.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.981+0000 7eff41ffb700 1 -- 172.21.15.38:0/2639425837 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff380b0020 con 0x7eff4417d3b0 2023-11-06T13:28:08.984 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:08.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7eff3008cbd0 msgr2=0x7eff3008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7eff3008cbd0 0x7eff3008f090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7eff3c009e60 tx=0x7eff3c009780).stop 2023-11-06T13:28:08.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 msgr2=0x7eff44190370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:08.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 0x7eff44190370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7eff3800c470 tx=0x7eff38007e00).stop 2023-11-06T13:28:08.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 shutdown_connections 2023-11-06T13:28:08.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7eff3008cbd0 0x7eff3008f090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff4417d7f0 0x7eff44190860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff44173370 0x7eff44155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 --2- 172.21.15.38:0/2639425837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7eff4417d3b0 0x7eff44190370 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:08.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 >> 172.21.15.38:0/2639425837 conn(0x7eff440f06f0 msgr2=0x7eff440eda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:08.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 shutdown_connections 2023-11-06T13:28:08.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:08.982+0000 7eff4bdc8700 1 -- 172.21.15.38:0/2639425837 wait complete. 2023-11-06T13:28:08.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-06T13:28:09.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.115+0000 7fcc7f927700 1 Processor -- start 2023-11-06T13:28:09.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.116+0000 7fcc7f927700 1 -- start start 2023-11-06T13:28:09.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7f927700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcc781754c0 0x7fcc781758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7f927700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcc7817f750 0x7fcc78069a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7f927700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc78181500 con 0x7fcc7817f2f0 2023-11-06T13:28:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7f927700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc781817e0 con 0x7fcc781754c0 2023-11-06T13:28:09.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7f927700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc78181ac0 con 0x7fcc7817f750 2023-11-06T13:28:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7d6c3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fcc781754c0 0x7fcc781758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7cec2700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fcc7817f2f0 0x7fcc78069330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43814/0 (socket says 172.21.15.38:43814) 2023-11-06T13:28:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7cec2700 1 -- 172.21.15.38:0/687665974 learned_addr learned my addr 172.21.15.38:0/687665974 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:09.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7dec4700 1 --2- 172.21.15.38:0/687665974 >> v2:172.21.15.44:3300/0 conn(0x7fcc7817f750 0x7fcc78069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7d6c3700 1 -- 172.21.15.38:0/687665974 >> v2:172.21.15.44:3300/0 conn(0x7fcc7817f750 msgr2=0x7fcc78069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7d6c3700 1 --2- 172.21.15.38:0/687665974 >> v2:172.21.15.44:3300/0 conn(0x7fcc7817f750 0x7fcc78069a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7d6c3700 1 -- 172.21.15.38:0/687665974 >> v1:172.21.15.38:6789/0 conn(0x7fcc7817f2f0 legacy=0x7fcc78069330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc77fff700 1 -- 172.21.15.38:0/687665974 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881024844 0 0) 0x7fcc78181500 con 0x7fcc7817f2f0 2023-11-06T13:28:09.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7d6c3700 1 -- 172.21.15.38:0/687665974 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78181da0 con 0x7fcc781754c0 2023-11-06T13:28:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc7d6c3700 1 --2- 172.21.15.38:0/687665974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc781754c0 0x7fcc781758a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fcc78087dc0 tx=0x7fcc68009780).ready entity=mon.0 client_cookie=387ad35dadaaf068 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.117+0000 7fcc77fff700 1 -- 172.21.15.38:0/687665974 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800e070 con 0x7fcc781754c0 2023-11-06T13:28:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc77fff700 1 -- 172.21.15.38:0/687665974 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800bc30 con 0x7fcc781754c0 2023-11-06T13:28:09.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc77fff700 1 -- 172.21.15.38:0/687665974 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68012410 con 0x7fcc781754c0 2023-11-06T13:28:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 -- 172.21.15.38:0/687665974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc781754c0 msgr2=0x7fcc781758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 --2- 172.21.15.38:0/687665974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc781754c0 0x7fcc781758a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fcc78087dc0 tx=0x7fcc68009780).stop 2023-11-06T13:28:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 -- 172.21.15.38:0/687665974 shutdown_connections 2023-11-06T13:28:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 --2- 172.21.15.38:0/687665974 >> v2:172.21.15.44:3300/0 conn(0x7fcc7817f750 0x7fcc78069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 --2- 172.21.15.38:0/687665974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc781754c0 0x7fcc781758a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 -- 172.21.15.38:0/687665974 >> 172.21.15.38:0/687665974 conn(0x7fcc780f06f0 msgr2=0x7fcc7805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 -- 172.21.15.38:0/687665974 shutdown_connections 2023-11-06T13:28:09.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.118+0000 7fcc7f927700 1 -- 172.21.15.38:0/687665974 wait complete. 2023-11-06T13:28:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.119+0000 7fcc7f927700 1 Processor -- start 2023-11-06T13:28:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.120+0000 7fcc7f927700 1 -- start start 2023-11-06T13:28:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc781754c0 0x7fcc780e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc7817f2f0 0x7fcc780eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 0x7fcc780eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780eae10 con 0x7fcc7817f750 2023-11-06T13:28:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78169140 con 0x7fcc7817f2f0 2023-11-06T13:28:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780ea220 con 0x7fcc781754c0 2023-11-06T13:28:09.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 0x7fcc780eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 0x7fcc780eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48436/0 (socket says 172.21.15.38:48436) 2023-11-06T13:28:09.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 -- 172.21.15.38:0/576291921 learned_addr learned my addr 172.21.15.38:0/576291921 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:09.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7d6c3700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc781754c0 0x7fcc780e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7cec2700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc7817f2f0 0x7fcc780eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 -- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc781754c0 msgr2=0x7fcc780e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc781754c0 0x7fcc780e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 -- 172.21.15.38:0/576291921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc7817f2f0 msgr2=0x7fcc780eb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc7817f2f0 0x7fcc780eb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 -- 172.21.15.38:0/576291921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68009a20 con 0x7fcc7817f750 2023-11-06T13:28:09.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7cec2700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc7817f2f0 0x7fcc780eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7dec4700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 0x7fcc780eb790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fcc7000c650 tx=0x7fcc70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70010580 con 0x7fcc7817f750 2023-11-06T13:28:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc700106e0 con 0x7fcc7817f750 2023-11-06T13:28:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70010a60 con 0x7fcc7817f750 2023-11-06T13:28:09.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.121+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc781924c0 con 0x7fcc7817f750 2023-11-06T13:28:09.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.122+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc780ea7c0 con 0x7fcc7817f750 2023-11-06T13:28:09.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.123+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc780eafc0 con 0x7fcc7817f750 2023-11-06T13:28:09.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.123+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fcc7001b460 con 0x7fcc7817f750 2023-11-06T13:28:09.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.124+0000 7fcc757fa700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fcc6408cbd0 0x7fcc6408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.124+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fcc700b2050 con 0x7fcc7817f750 2023-11-06T13:28:09.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.124+0000 7fcc7d6c3700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fcc6408cbd0 0x7fcc6408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.125+0000 7fcc7d6c3700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fcc6408cbd0 0x7fcc6408f090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcc680097c0 tx=0x7fcc780ef630).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.128+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fcc780eafc0 con 0x7fcc7817f750 2023-11-06T13:28:09.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.302+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc7806c580 con 0x7fcc7817f750 2023-11-06T13:28:09.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.302+0000 7fcc757fa700 1 -- 172.21.15.38:0/576291921 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc70082590 con 0x7fcc7817f750 2023-11-06T13:28:09.306 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:09.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fcc6408cbd0 msgr2=0x7fcc6408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fcc6408cbd0 0x7fcc6408f090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcc680097c0 tx=0x7fcc780ef630).stop 2023-11-06T13:28:09.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 msgr2=0x7fcc780eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 0x7fcc780eb790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fcc7000c650 tx=0x7fcc70008040).stop 2023-11-06T13:28:09.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 shutdown_connections 2023-11-06T13:28:09.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fcc7817f750 0x7fcc780eb790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc781754c0 0x7fcc780e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fcc6408cbd0 0x7fcc6408f090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 --2- 172.21.15.38:0/576291921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc7817f2f0 0x7fcc780eb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 >> 172.21.15.38:0/576291921 conn(0x7fcc780f06f0 msgr2=0x7fcc78083bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 shutdown_connections 2023-11-06T13:28:09.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.304+0000 7fcc7f927700 1 -- 172.21.15.38:0/576291921 wait complete. 2023-11-06T13:28:09.319 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-06T13:28:09.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.441+0000 7f4a735be700 1 Processor -- start 2023-11-06T13:28:09.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.441+0000 7f4a735be700 1 -- start start 2023-11-06T13:28:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a735be700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4a6c17dfc0 0x7f4a6c17c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a735be700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c17db30 con 0x7f4a6c17aba0 2023-11-06T13:28:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a735be700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c0c4950 con 0x7f4a6c17a7c0 2023-11-06T13:28:09.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a735be700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c17ca40 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a71b5b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4a6c17dfc0 0x7f4a6c17c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a70b59700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f4a6c17aba0 0x7f4a6c17b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43826/0 (socket says 172.21.15.38:43826) 2023-11-06T13:28:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.442+0000 7f4a70b59700 1 -- 172.21.15.38:0/2665574416 learned_addr learned my addr 172.21.15.38:0/2665574416 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a71b5b700 1 -- 172.21.15.38:0/2665574416 >> v1:172.21.15.44:6789/0 conn(0x7f4a6c17a7c0 legacy=0x7f4a6c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a71b5b700 1 -- 172.21.15.38:0/2665574416 >> v1:172.21.15.38:6789/0 conn(0x7f4a6c17aba0 legacy=0x7f4a6c17b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a6bfff700 1 -- 172.21.15.38:0/2665574416 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351675113 0 0) 0x7f4a6c17db30 con 0x7f4a6c17aba0 2023-11-06T13:28:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a71b5b700 1 -- 172.21.15.38:0/2665574416 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c17e400 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a71b5b700 1 --2- 172.21.15.38:0/2665574416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17c550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4a64009760 tx=0x7f4a64009060).ready entity=mon.0 client_cookie=b6800212c2131ae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a6bfff700 1 -- 172.21.15.38:0/2665574416 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64009120 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.449 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a6bfff700 1 -- 172.21.15.38:0/2665574416 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6400b580 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.443+0000 7f4a6bfff700 1 -- 172.21.15.38:0/2665574416 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400b900 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 -- 172.21.15.38:0/2665574416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 msgr2=0x7f4a6c17c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 --2- 172.21.15.38:0/2665574416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17c550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4a64009760 tx=0x7f4a64009060).stop 2023-11-06T13:28:09.450 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 -- 172.21.15.38:0/2665574416 shutdown_connections 2023-11-06T13:28:09.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 --2- 172.21.15.38:0/2665574416 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17c550 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 -- 172.21.15.38:0/2665574416 >> 172.21.15.38:0/2665574416 conn(0x7f4a6c05e1b0 msgr2=0x7f4a6c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:09.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 -- 172.21.15.38:0/2665574416 shutdown_connections 2023-11-06T13:28:09.451 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.444+0000 7f4a735be700 1 -- 172.21.15.38:0/2665574416 wait complete. 2023-11-06T13:28:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.445+0000 7f4a735be700 1 Processor -- start 2023-11-06T13:28:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.445+0000 7f4a735be700 1 -- start start 2023-11-06T13:28:09.454 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a735be700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a6c17a7c0 0x7f4a6c172df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a735be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a6c17aba0 0x7f4a6c17e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a735be700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a735be700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c18b9f0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a735be700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c188b90 con 0x7f4a6c17a7c0 2023-11-06T13:28:09.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a735be700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c18ae70 con 0x7f4a6c17aba0 2023-11-06T13:28:09.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a71b5b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a71b5b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48462/0 (socket says 172.21.15.38:48462) 2023-11-06T13:28:09.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.446+0000 7f4a71b5b700 1 -- 172.21.15.38:0/1143047353 learned_addr learned my addr 172.21.15.38:0/1143047353 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:09.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a7135a700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a6c17a7c0 0x7f4a6c172df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a70b59700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a6c17aba0 0x7f4a6c17e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a71b5b700 1 -- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a6c17aba0 msgr2=0x7f4a6c17e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a71b5b700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a6c17aba0 0x7f4a6c17e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a71b5b700 1 -- 172.21.15.38:0/1143047353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a6c17a7c0 msgr2=0x7f4a6c172df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a71b5b700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a6c17a7c0 0x7f4a6c172df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a71b5b700 1 -- 172.21.15.38:0/1143047353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640092a0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a70b59700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a6c17aba0 0x7f4a6c17e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:09.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a7135a700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a6c17a7c0 0x7f4a6c172df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:09.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a71b5b700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17eb20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f4a64011f60 tx=0x7f4a64017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400bed0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64006950 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6401b650 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c18b150 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.447+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c18b710 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.448+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c1889f0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.449+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f4a6401ba00 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.449+0000 7f4a697fa700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4a5808cba0 0x7f4a5808f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.450+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4a640b3ad0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.450+0000 7f4a7135a700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4a5808cba0 0x7f4a5808f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.450+0000 7f4a7135a700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4a5808cba0 0x7f4a5808f060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4a6c17d080 tx=0x7f4a5c009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.454+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4a6c1889f0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.625+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4a6c1889f0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.626+0000 7f4a697fa700 1 -- 172.21.15.38:0/1143047353 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4a6c1889f0 con 0x7f4a6c17dfc0 2023-11-06T13:28:09.629 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-11-06T13:28:09.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4a5808cba0 msgr2=0x7f4a5808f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4a5808cba0 0x7f4a5808f060 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4a6c17d080 tx=0x7f4a5c009040).stop 2023-11-06T13:28:09.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 msgr2=0x7f4a6c17eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17eb20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f4a64011f60 tx=0x7f4a64017000).stop 2023-11-06T13:28:09.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 shutdown_connections 2023-11-06T13:28:09.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4a6c17dfc0 0x7f4a6c17eb20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4a5808cba0 0x7f4a5808f060 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a6c17a7c0 0x7f4a6c172df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 --2- 172.21.15.38:0/1143047353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a6c17aba0 0x7f4a6c17e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 >> 172.21.15.38:0/1143047353 conn(0x7f4a6c05e1b0 msgr2=0x7f4a6c0c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:09.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 shutdown_connections 2023-11-06T13:28:09.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.627+0000 7f4a735be700 1 -- 172.21.15.38:0/1143047353 wait complete. 2023-11-06T13:28:09.642 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:28:09.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.758+0000 7fddcd5ac700 1 Processor -- start 2023-11-06T13:28:09.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.758+0000 7fddcd5ac700 1 -- start start 2023-11-06T13:28:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddcd5ac700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fddc817e570 0x7fddc8186590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddcd5ac700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc817d9d0 con 0x7fddc81756e0 2023-11-06T13:28:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddcd5ac700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc817c800 con 0x7fddc80647f0 2023-11-06T13:28:09.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddcd5ac700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc80c8560 con 0x7fddc817e570 2023-11-06T13:28:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddc6ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fddc81756e0 0x7fddc80640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43830/0 (socket says 172.21.15.38:43830) 2023-11-06T13:28:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddc6ffd700 1 -- 172.21.15.38:0/565195635 learned_addr learned my addr 172.21.15.38:0/565195635 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddc77fe700 1 --2- 172.21.15.38:0/565195635 >> v2:172.21.15.163:3300/0 conn(0x7fddc817e570 0x7fddc8186590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820975879 0 0) 0x7fddc817d9d0 con 0x7fddc81756e0 2023-11-06T13:28:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.759+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb00033f0 con 0x7fddc81756e0 2023-11-06T13:28:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099102677 0 0) 0x7fddb00033f0 con 0x7fddc81756e0 2023-11-06T13:28:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 >> v2:172.21.15.163:3300/0 conn(0x7fddc817e570 msgr2=0x7fddc8186590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 --2- 172.21.15.38:0/565195635 >> v2:172.21.15.163:3300/0 conn(0x7fddc817e570 0x7fddc8186590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 >> v1:172.21.15.44:6789/0 conn(0x7fddc80647f0 legacy=0x7fddc817de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc817cae0 con 0x7fddc81756e0 2023-11-06T13:28:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7fddb8001470 con 0x7fddc81756e0 2023-11-06T13:28:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 >> v1:172.21.15.38:6789/0 conn(0x7fddc81756e0 legacy=0x7fddc80640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0003930 0x7fddb0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddb0004690 0x7fddb0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddb0005000 0x7fddb000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb000bf00 con 0x7fddb0005000 2023-11-06T13:28:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb000c070 con 0x7fddb0003930 2023-11-06T13:28:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb000c230 con 0x7fddb0004690 2023-11-06T13:28:09.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddb0005000 0x7fddb000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc6ffd700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0003930 0x7fddb0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc67fc700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddb0004690 0x7fddb0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 -- 172.21.15.38:0/565195635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddb0004690 msgr2=0x7fddb0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddb0004690 0x7fddb0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 -- 172.21.15.38:0/565195635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0003930 msgr2=0x7fddb0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0003930 0x7fddb0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 -- 172.21.15.38:0/565195635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00033f0 con 0x7fddb0005000 2023-11-06T13:28:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 -- 172.21.15.38:0/565195635 reap_dead start 2023-11-06T13:28:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc77fe700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddb0005000 0x7fddb000b8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fddc000e1c0 tx=0x7fddc000b040).ready entity=mon.0 client_cookie=a3e2276a998d9994 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0017070 con 0x7fddb0005000 2023-11-06T13:28:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc000f040 con 0x7fddb0005000 2023-11-06T13:28:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.760+0000 7fddc5ffb700 1 -- 172.21.15.38:0/565195635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000eca0 con 0x7fddb0005000 2023-11-06T13:28:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 -- 172.21.15.38:0/565195635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddb0005000 msgr2=0x7fddb000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddb0005000 0x7fddb000b8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fddc000e1c0 tx=0x7fddc000b040).stop 2023-11-06T13:28:09.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 -- 172.21.15.38:0/565195635 shutdown_connections 2023-11-06T13:28:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/565195635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddb0005000 0x7fddb000b8e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 -- 172.21.15.38:0/565195635 >> 172.21.15.38:0/565195635 conn(0x7fddc8069ea0 msgr2=0x7fddc806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 -- 172.21.15.38:0/565195635 shutdown_connections 2023-11-06T13:28:09.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.761+0000 7fddcd5ac700 1 -- 172.21.15.38:0/565195635 wait complete. 2023-11-06T13:28:09.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.762+0000 7fddcd5ac700 1 Processor -- start 2023-11-06T13:28:09.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 -- start start 2023-11-06T13:28:09.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0005000 0x7fddc816c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddc80ee800 0x7fddc80eec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 0x7fddc80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80cade0 con 0x7fddc80ef170 2023-11-06T13:28:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80cb960 con 0x7fddb0005000 2023-11-06T13:28:09.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.763+0000 7fddcd5ac700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80ef6d0 con 0x7fddc80ee800 2023-11-06T13:28:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 0x7fddc80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 0x7fddc80cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48482/0 (socket says 172.21.15.38:48482) 2023-11-06T13:28:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 -- 172.21.15.38:0/2955347151 learned_addr learned my addr 172.21.15.38:0/2955347151 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc6ffd700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0005000 0x7fddc816c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc67fc700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddc80ee800 0x7fddc80eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 -- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddc80ee800 msgr2=0x7fddc80eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddc80ee800 0x7fddc80eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 -- 172.21.15.38:0/2955347151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0005000 msgr2=0x7fddc816c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0005000 0x7fddc816c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 -- 172.21.15.38:0/2955347151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80cb030 con 0x7fddc80ef170 2023-11-06T13:28:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc67fc700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddc80ee800 0x7fddc80eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddc77fe700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 0x7fddc80cbdf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fddc0000f80 tx=0x7fddc0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0009ac0 con 0x7fddc80ef170 2023-11-06T13:28:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0013e10 con 0x7fddc80ef170 2023-11-06T13:28:09.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc80cb310 con 0x7fddc80ef170 2023-11-06T13:28:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc001e870 con 0x7fddc80ef170 2023-11-06T13:28:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.764+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc80cc2e0 con 0x7fddc80ef170 2023-11-06T13:28:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.765+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc80cb7b0 con 0x7fddc80ef170 2023-11-06T13:28:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.766+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fddc0003040 con 0x7fddc80ef170 2023-11-06T13:28:09.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.766+0000 7fddaeffd700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fddb408cbd0 0x7fddb408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.767+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fddc00b4090 con 0x7fddc80ef170 2023-11-06T13:28:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.767+0000 7fddc6ffd700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fddb408cbd0 0x7fddb408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.767+0000 7fddc6ffd700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fddb408cbd0 0x7fddb408f090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fddb8001ce0 tx=0x7fddb8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.771+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fddc00845d0 con 0x7fddc80ef170 2023-11-06T13:28:09.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.990+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddc806c580 con 0x7fddc80ef170 2023-11-06T13:28:09.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.991+0000 7fddaeffd700 1 -- 172.21.15.38:0/2955347151 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10635 (secure 0 0 0) 0x7fddc0022020 con 0x7fddc80ef170 2023-11-06T13:28:09.995 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:09.995 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:58.254004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4361,"mds_1":4355,"mds_2":4352,"mds_3":4349,"mds_4":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4315":{"gid":4315,"name":"e","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4321":{"gid":4321,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4323":{"gid":4323,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4326":{"gid":4326,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4349":{"gid":4349,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4352":{"gid":4352,"name":"c","rank":2,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4355":{"gid":4355,"name":"i","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-06T13:28:09.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fddb408cbd0 msgr2=0x7fddb408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fddb408cbd0 0x7fddb408f090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fddb8001ce0 tx=0x7fddb8009040).stop 2023-11-06T13:28:09.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 msgr2=0x7fddc80cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:09.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 0x7fddc80cbdf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fddc0000f80 tx=0x7fddc0019000).stop 2023-11-06T13:28:09.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 shutdown_connections 2023-11-06T13:28:09.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fddc80ef170 0x7fddc80cbdf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fddb408cbd0 0x7fddb408f090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fddb0005000 0x7fddc816c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 --2- 172.21.15.38:0/2955347151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fddc80ee800 0x7fddc80eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:09.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 >> 172.21.15.38:0/2955347151 conn(0x7fddc8069ea0 msgr2=0x7fddc80c9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:09.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 shutdown_connections 2023-11-06T13:28:09.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:09.993+0000 7fddcd5ac700 1 -- 172.21.15.38:0/2955347151 wait complete. 2023-11-06T13:28:09.999 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2023-11-06T13:28:10.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:10.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.124+0000 7f8e533e1700 1 Processor -- start 2023-11-06T13:28:10.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.124+0000 7f8e533e1700 1 -- start start 2023-11-06T13:28:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e533e1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e4c1756e0 0x7f8e4c0640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e533e1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e4c0645d0 0x7f8e4c17de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e533e1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c17d9d0 con 0x7f8e4c17e350 2023-11-06T13:28:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e533e1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c8560 con 0x7f8e4c1756e0 2023-11-06T13:28:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e533e1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c064a50 con 0x7f8e4c0645d0 2023-11-06T13:28:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e5117d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e4c1756e0 0x7f8e4c0640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e5197e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8e4c17e350 0x7f8e4c0f1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43846/0 (socket says 172.21.15.38:43846) 2023-11-06T13:28:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e5197e700 1 -- 172.21.15.38:0/2598195896 learned_addr learned my addr 172.21.15.38:0/2598195896 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:10.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.125+0000 7f8e5097c700 1 --2- 172.21.15.38:0/2598195896 >> v2:172.21.15.44:3300/0 conn(0x7f8e4c0645d0 0x7f8e4c17de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e5117d700 1 -- 172.21.15.38:0/2598195896 >> v2:172.21.15.44:3300/0 conn(0x7f8e4c0645d0 msgr2=0x7f8e4c17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:10.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e5117d700 1 --2- 172.21.15.38:0/2598195896 >> v2:172.21.15.44:3300/0 conn(0x7f8e4c0645d0 0x7f8e4c17de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e5117d700 1 -- 172.21.15.38:0/2598195896 >> v1:172.21.15.38:6789/0 conn(0x7f8e4c17e350 legacy=0x7f8e4c0f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e4bfff700 1 -- 172.21.15.38:0/2598195896 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489239687 0 0) 0x7f8e4c17d9d0 con 0x7f8e4c17e350 2023-11-06T13:28:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e5117d700 1 -- 172.21.15.38:0/2598195896 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c17c800 con 0x7f8e4c1756e0 2023-11-06T13:28:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e5117d700 1 --2- 172.21.15.38:0/2598195896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c0640e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f8e4c0cab80 tx=0x7f8e3c009060).ready entity=mon.0 client_cookie=b240f89545ff1fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e4bfff700 1 -- 172.21.15.38:0/2598195896 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00b580 con 0x7f8e4c1756e0 2023-11-06T13:28:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e4bfff700 1 -- 172.21.15.38:0/2598195896 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00b6e0 con 0x7f8e4c1756e0 2023-11-06T13:28:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e4bfff700 1 -- 172.21.15.38:0/2598195896 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00ba60 con 0x7f8e4c1756e0 2023-11-06T13:28:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 -- 172.21.15.38:0/2598195896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c1756e0 msgr2=0x7f8e4c0640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 --2- 172.21.15.38:0/2598195896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c0640e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f8e4c0cab80 tx=0x7f8e3c009060).stop 2023-11-06T13:28:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 -- 172.21.15.38:0/2598195896 shutdown_connections 2023-11-06T13:28:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 --2- 172.21.15.38:0/2598195896 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c0640e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 --2- 172.21.15.38:0/2598195896 >> v2:172.21.15.44:3300/0 conn(0x7f8e4c0645d0 0x7f8e4c17de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 -- 172.21.15.38:0/2598195896 >> 172.21.15.38:0/2598195896 conn(0x7f8e4c069ea0 msgr2=0x7f8e4c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 -- 172.21.15.38:0/2598195896 shutdown_connections 2023-11-06T13:28:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.126+0000 7f8e533e1700 1 -- 172.21.15.38:0/2598195896 wait complete. 2023-11-06T13:28:10.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.128+0000 7f8e533e1700 1 Processor -- start 2023-11-06T13:28:10.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.128+0000 7f8e533e1700 1 -- start start 2023-11-06T13:28:10.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e533e1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 0x7f8e4c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e533e1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c17bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e533e1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e4c17e350 0x7f8e4c17a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e533e1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c74b0 con 0x7f8e4c0645d0 2023-11-06T13:28:10.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e533e1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0cb2d0 con 0x7f8e4c1756e0 2023-11-06T13:28:10.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e533e1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c17b960 con 0x7f8e4c17e350 2023-11-06T13:28:10.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 0x7f8e4c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 0x7f8e4c0cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48500/0 (socket says 172.21.15.38:48500) 2023-11-06T13:28:10.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 -- 172.21.15.38:0/1838411523 learned_addr learned my addr 172.21.15.38:0/1838411523 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:10.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5197e700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e4c17e350 0x7f8e4c17a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5097c700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c17bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 -- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e4c17e350 msgr2=0x7f8e4c17a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e4c17e350 0x7f8e4c17a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 -- 172.21.15.38:0/1838411523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c1756e0 msgr2=0x7f8e4c17bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c17bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5117d700 1 -- 172.21.15.38:0/1838411523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0092a0 con 0x7f8e4c0645d0 2023-11-06T13:28:10.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.129+0000 7f8e5097c700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c17bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:10.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.130+0000 7f8e5117d700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 0x7f8e4c0cade0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f8e3c009fd0 tx=0x7f8e3c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.130+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00b850 con 0x7f8e4c0645d0 2023-11-06T13:28:10.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.130+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00b9b0 con 0x7f8e4c0645d0 2023-11-06T13:28:10.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.130+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c17aa70 con 0x7f8e4c0645d0 2023-11-06T13:28:10.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.130+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c01b690 con 0x7f8e4c0645d0 2023-11-06T13:28:10.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.130+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c17b030 con 0x7f8e4c0645d0 2023-11-06T13:28:10.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.131+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c17bc40 con 0x7f8e4c0645d0 2023-11-06T13:28:10.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.132+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f8e3c01bb10 con 0x7f8e4c0645d0 2023-11-06T13:28:10.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.132+0000 7f8e497fa700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3808cbd0 0x7f8e3808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.132+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f8e3c0b3b00 con 0x7f8e4c0645d0 2023-11-06T13:28:10.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.132+0000 7f8e5097c700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3808cbd0 0x7f8e3808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.133+0000 7f8e5097c700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3808cbd0 0x7f8e3808f090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8e4c063d90 tx=0x7f8e40008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.136+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f8e3c084040 con 0x7f8e4c0645d0 2023-11-06T13:28:10.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.311+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e4c06c580 con 0x7f8e4c0645d0 2023-11-06T13:28:10.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.312+0000 7f8e497fa700 1 -- 172.21.15.38:0/1838411523 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f8e3c0b3e60 con 0x7f8e4c0645d0 2023-11-06T13:28:10.315 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:10.316 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:10.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3808cbd0 msgr2=0x7f8e3808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3808cbd0 0x7f8e3808f090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8e4c063d90 tx=0x7f8e40008040).stop 2023-11-06T13:28:10.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 msgr2=0x7f8e4c0cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 0x7f8e4c0cade0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f8e3c009fd0 tx=0x7f8e3c017000).stop 2023-11-06T13:28:10.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 shutdown_connections 2023-11-06T13:28:10.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e4c17e350 0x7f8e4c17a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e4c0645d0 0x7f8e4c0cade0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3808cbd0 0x7f8e3808f090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 --2- 172.21.15.38:0/1838411523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c1756e0 0x7f8e4c17bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 >> 172.21.15.38:0/1838411523 conn(0x7f8e4c069ea0 msgr2=0x7f8e4c0f4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:10.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 shutdown_connections 2023-11-06T13:28:10.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.314+0000 7f8e533e1700 1 -- 172.21.15.38:0/1838411523 wait complete. 2023-11-06T13:28:10.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-06T13:27:40.368418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-06T13:27:40.848313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-06T13:27:43.934481+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-06T13:28:10.330 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:28:10.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.450+0000 7f3453517700 1 Processor -- start 2023-11-06T13:28:10.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.450+0000 7f3453517700 1 -- start start 2023-11-06T13:28:10.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.451+0000 7f3453517700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f344c084bd0 0x7f344c084ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.451+0000 7f3453517700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344c17d550 con 0x7f344c175970 2023-11-06T13:28:10.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.451+0000 7f3453517700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344c17fad0 con 0x7f344c175590 2023-11-06T13:28:10.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.451+0000 7f3453517700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344c085ad0 con 0x7f344c084bd0 2023-11-06T13:28:10.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.451+0000 7f3451d14700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f344c175970 0x7f344c17e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43854/0 (socket says 172.21.15.38:43854) 2023-11-06T13:28:10.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.451+0000 7f3451d14700 1 -- 172.21.15.38:0/784087170 learned_addr learned my addr 172.21.15.38:0/784087170 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:10.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118214046 0 0) 0x7f344c17d550 con 0x7f344c175970 2023-11-06T13:28:10.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34340033f0 con 0x7f344c175970 2023-11-06T13:28:10.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452d16700 1 --2- 172.21.15.38:0/784087170 >> v2:172.21.15.44:3300/0 conn(0x7f344c084bd0 0x7f344c084ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075247185 0 0) 0x7f344c17fad0 con 0x7f344c175590 2023-11-06T13:28:10.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f344c17d550 con 0x7f344c175590 2023-11-06T13:28:10.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958199498 0 0) 0x7f34340033f0 con 0x7f344c175970 2023-11-06T13:28:10.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 >> v2:172.21.15.44:3300/0 conn(0x7f344c084bd0 msgr2=0x7f344c084ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:10.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 --2- 172.21.15.38:0/784087170 >> v2:172.21.15.44:3300/0 conn(0x7f344c084bd0 0x7f344c084ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 >> v1:172.21.15.163:6789/0 conn(0x7f344c175590 legacy=0x7f344c17d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c17c940 con 0x7f344c175970 2023-11-06T13:28:10.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f3440001470 con 0x7f344c175970 2023-11-06T13:28:10.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 >> v1:172.21.15.38:6789/0 conn(0x7f344c175970 legacy=0x7f344c17e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3434003ac0 0x7f3434003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434004690 0x7f3434004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3434005000 0x7f343400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c085ad0 con 0x7f3434003ac0 2023-11-06T13:28:10.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343400bf60 con 0x7f3434005000 2023-11-06T13:28:10.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343400c120 con 0x7f3434004690 2023-11-06T13:28:10.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452515700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3434003ac0 0x7f3434003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3451d14700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434004690 0x7f3434004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452d16700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3434005000 0x7f343400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452515700 1 -- 172.21.15.38:0/784087170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434004690 msgr2=0x7f3434004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452515700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434004690 0x7f3434004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452515700 1 -- 172.21.15.38:0/784087170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3434005000 msgr2=0x7f343400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452515700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3434005000 0x7f343400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452d16700 1 -- 172.21.15.38:0/784087170 reap_dead start 2023-11-06T13:28:10.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.452+0000 7f3452515700 1 -- 172.21.15.38:0/784087170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340033f0 con 0x7f3434003ac0 2023-11-06T13:28:10.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3452515700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3434003ac0 0x7f3434003ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f3444001fd0 tx=0x7f3444007f30).ready entity=mon.0 client_cookie=969c91b2a7d31cc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444003030 con 0x7f3434003ac0 2023-11-06T13:28:10.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3444006a20 con 0x7f3434003ac0 2023-11-06T13:28:10.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3451513700 1 -- 172.21.15.38:0/784087170 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444006dc0 con 0x7f3434003ac0 2023-11-06T13:28:10.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 -- 172.21.15.38:0/784087170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3434003ac0 msgr2=0x7f3434003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3434003ac0 0x7f3434003ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f3444001fd0 tx=0x7f3444007f30).stop 2023-11-06T13:28:10.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 -- 172.21.15.38:0/784087170 shutdown_connections 2023-11-06T13:28:10.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 --2- 172.21.15.38:0/784087170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3434003ac0 0x7f3434003ec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 -- 172.21.15.38:0/784087170 >> 172.21.15.38:0/784087170 conn(0x7f344c0f5d10 msgr2=0x7f344c0f1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 -- 172.21.15.38:0/784087170 shutdown_connections 2023-11-06T13:28:10.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.453+0000 7f3453517700 1 -- 172.21.15.38:0/784087170 wait complete. 2023-11-06T13:28:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.455+0000 7f3453517700 1 Processor -- start 2023-11-06T13:28:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.455+0000 7f3453517700 1 -- start start 2023-11-06T13:28:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3453517700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434003ac0 0x7f344c0f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3453517700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 0x7f344c17dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3453517700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f344c17e3b0 0x7f344c1709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3453517700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c190870 con 0x7f344c0f0d20 2023-11-06T13:28:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3453517700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c17bb90 con 0x7f344c17e3b0 2023-11-06T13:28:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3453517700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c17be70 con 0x7f3434003ac0 2023-11-06T13:28:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 0x7f344c17dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 0x7f344c17dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48512/0 (socket says 172.21.15.38:48512) 2023-11-06T13:28:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 -- 172.21.15.38:0/545792925 learned_addr learned my addr 172.21.15.38:0/545792925 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3452515700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434003ac0 0x7f344c0f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3452d16700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f344c17e3b0 0x7f344c1709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 -- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434003ac0 msgr2=0x7f344c0f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434003ac0 0x7f344c0f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 -- 172.21.15.38:0/545792925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f344c17e3b0 msgr2=0x7f344c1709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f344c17e3b0 0x7f344c1709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 -- 172.21.15.38:0/545792925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c17c150 con 0x7f344c0f0d20 2023-11-06T13:28:10.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3452d16700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f344c17e3b0 0x7f344c1709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:10.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f3451d14700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 0x7f344c17dec0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3440001620 tx=0x7f344c17d4c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440011590 con 0x7f344c0f0d20 2023-11-06T13:28:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.456+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34400116f0 con 0x7f344c0f0d20 2023-11-06T13:28:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.457+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440011a90 con 0x7f344c0f0d20 2023-11-06T13:28:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.457+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344c18ff40 con 0x7f344c0f0d20 2023-11-06T13:28:10.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.457+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c190500 con 0x7f344c0f0d20 2023-11-06T13:28:10.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.457+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c1909e0 con 0x7f344c0f0d20 2023-11-06T13:28:10.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.458+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f344001d3b0 con 0x7f344c0f0d20 2023-11-06T13:28:10.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.459+0000 7f344a7fc700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f343808cbd0 0x7f343808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.459+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f34400b19e0 con 0x7f344c0f0d20 2023-11-06T13:28:10.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.459+0000 7f3452515700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f343808cbd0 0x7f343808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.460+0000 7f3452515700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f343808cbd0 0x7f343808f090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f34440017a0 tx=0x7f3444015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.463+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3440081f20 con 0x7f344c0f0d20 2023-11-06T13:28:10.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.634+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f344c1712d0 con 0x7f344c0f0d20 2023-11-06T13:28:10.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.635+0000 7f344a7fc700 1 -- 172.21.15.38:0/545792925 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3440085540 con 0x7f344c0f0d20 2023-11-06T13:28:10.639 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:28:10.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f343808cbd0 msgr2=0x7f343808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f343808cbd0 0x7f343808f090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f34440017a0 tx=0x7f3444015000).stop 2023-11-06T13:28:10.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 msgr2=0x7f344c17dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 0x7f344c17dec0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f3440001620 tx=0x7f344c17d4c0).stop 2023-11-06T13:28:10.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 shutdown_connections 2023-11-06T13:28:10.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f343808cbd0 0x7f343808f090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f344c17e3b0 0x7f344c1709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3434003ac0 0x7f344c0f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 --2- 172.21.15.38:0/545792925 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f344c0f0d20 0x7f344c17dec0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 >> 172.21.15.38:0/545792925 conn(0x7f344c0f5d10 msgr2=0x7f344c174880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:10.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 shutdown_connections 2023-11-06T13:28:10.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.637+0000 7f3453517700 1 -- 172.21.15.38:0/545792925 wait complete. 2023-11-06T13:28:10.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:28:10.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.770+0000 7fdb35f97700 1 Processor -- start 2023-11-06T13:28:10.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.770+0000 7fdb35f97700 1 -- start start 2023-11-06T13:28:10.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb35f97700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb30175a40 0x7fdb3017f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb35f97700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdb3017fb80 0x7fdb3017e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb35f97700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3017ddd0 con 0x7fdb3017e750 2023-11-06T13:28:10.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb35f97700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb30064780 con 0x7fdb30175a40 2023-11-06T13:28:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb35f97700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb300c4c20 con 0x7fdb3017fb80 2023-11-06T13:28:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb2f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb30175a40 0x7fdb3017f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb2f7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fdb30175a40 0x7fdb3017f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48526/0 (socket says 172.21.15.38:48526) 2023-11-06T13:28:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb2f7fe700 1 -- 172.21.15.38:0/3585282142 learned_addr learned my addr 172.21.15.38:0/3585282142 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:10.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.771+0000 7fdb2effd700 1 --2- 172.21.15.38:0/3585282142 >> v2:172.21.15.163:3300/0 conn(0x7fdb3017fb80 0x7fdb3017e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2f7fe700 1 -- 172.21.15.38:0/3585282142 >> v2:172.21.15.163:3300/0 conn(0x7fdb3017fb80 msgr2=0x7fdb3017e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2f7fe700 1 --2- 172.21.15.38:0/3585282142 >> v2:172.21.15.163:3300/0 conn(0x7fdb3017fb80 0x7fdb3017e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2f7fe700 1 -- 172.21.15.38:0/3585282142 >> v1:172.21.15.44:6789/0 conn(0x7fdb3017e750 legacy=0x7fdb300efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2f7fe700 1 -- 172.21.15.38:0/3585282142 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3017cee0 con 0x7fdb30175a40 2023-11-06T13:28:10.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2f7fe700 1 --2- 172.21.15.38:0/3585282142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb30175a40 0x7fdb3017f690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fdb30065190 tx=0x7fdb200090f0).ready entity=mon.0 client_cookie=c303b9cf472bfb5c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2e7fc700 1 -- 172.21.15.38:0/3585282142 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000f510 con 0x7fdb30175a40 2023-11-06T13:28:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2e7fc700 1 -- 172.21.15.38:0/3585282142 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2000f670 con 0x7fdb30175a40 2023-11-06T13:28:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb2e7fc700 1 -- 172.21.15.38:0/3585282142 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2000f9f0 con 0x7fdb30175a40 2023-11-06T13:28:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 -- 172.21.15.38:0/3585282142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb30175a40 msgr2=0x7fdb3017f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3585282142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb30175a40 0x7fdb3017f690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fdb30065190 tx=0x7fdb200090f0).stop 2023-11-06T13:28:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 -- 172.21.15.38:0/3585282142 shutdown_connections 2023-11-06T13:28:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3585282142 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb30175a40 0x7fdb3017f690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3585282142 >> v2:172.21.15.163:3300/0 conn(0x7fdb3017fb80 0x7fdb3017e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 -- 172.21.15.38:0/3585282142 >> 172.21.15.38:0/3585282142 conn(0x7fdb3006a970 msgr2=0x7fdb300f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:10.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 -- 172.21.15.38:0/3585282142 shutdown_connections 2023-11-06T13:28:10.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.772+0000 7fdb35f97700 1 -- 172.21.15.38:0/3585282142 wait complete. 2023-11-06T13:28:10.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.774+0000 7fdb35f97700 1 Processor -- start 2023-11-06T13:28:10.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.774+0000 7fdb35f97700 1 -- start start 2023-11-06T13:28:10.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb35f97700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb30175a40 0x7fdb301700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb35f97700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 0x7fdb3017c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb35f97700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb3017fb80 0x7fdb3018d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb35f97700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300f51b0 con 0x7fdb3017e750 2023-11-06T13:28:10.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb35f97700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300cce30 con 0x7fdb30175a40 2023-11-06T13:28:10.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb35f97700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb300cd2c0 con 0x7fdb3017fb80 2023-11-06T13:28:10.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 0x7fdb3017c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 0x7fdb3017c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48528/0 (socket says 172.21.15.38:48528) 2023-11-06T13:28:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 -- 172.21.15.38:0/3863737345 learned_addr learned my addr 172.21.15.38:0/3863737345 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2ffff700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb3017fb80 0x7fdb3018d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2f7fe700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb30175a40 0x7fdb301700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 -- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb3017fb80 msgr2=0x7fdb3018d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb3017fb80 0x7fdb3018d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 -- 172.21.15.38:0/3863737345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb30175a40 msgr2=0x7fdb301700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb30175a40 0x7fdb301700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.775+0000 7fdb2effd700 1 -- 172.21.15.38:0/3863737345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb20009370 con 0x7fdb3017e750 2023-11-06T13:28:10.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.776+0000 7fdb2effd700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 0x7fdb3017c100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fdb2400e900 tx=0x7fdb24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.776+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb240094d0 con 0x7fdb3017e750 2023-11-06T13:28:10.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.776+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2400c670 con 0x7fdb3017e750 2023-11-06T13:28:10.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.776+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb300cbf40 con 0x7fdb3017e750 2023-11-06T13:28:10.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.776+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400c9f0 con 0x7fdb3017e750 2023-11-06T13:28:10.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.776+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb300cc500 con 0x7fdb3017e750 2023-11-06T13:28:10.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.777+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb300ccfa0 con 0x7fdb3017e750 2023-11-06T13:28:10.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.778+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fdb2401b400 con 0x7fdb3017e750 2023-11-06T13:28:10.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.778+0000 7fdb177fe700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb1c08cbd0 0x7fdb1c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:10.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.778+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fdb240b2540 con 0x7fdb3017e750 2023-11-06T13:28:10.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.778+0000 7fdb2f7fe700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb1c08cbd0 0x7fdb1c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:10.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.779+0000 7fdb2f7fe700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb1c08cbd0 0x7fdb1c08f090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fdb20009130 tx=0x7fdb20017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:10.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.782+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fdb24082a80 con 0x7fdb3017e750 2023-11-06T13:28:10.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.955+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb3017d1c0 con 0x7fdb3017e750 2023-11-06T13:28:10.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.956+0000 7fdb177fe700 1 -- 172.21.15.38:0/3863737345 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb240860a0 con 0x7fdb3017e750 2023-11-06T13:28:10.960 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:28:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb1c08cbd0 msgr2=0x7fdb1c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb1c08cbd0 0x7fdb1c08f090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fdb20009130 tx=0x7fdb20017000).stop 2023-11-06T13:28:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 msgr2=0x7fdb3017c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 0x7fdb3017c100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fdb2400e900 tx=0x7fdb24009060).stop 2023-11-06T13:28:10.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 shutdown_connections 2023-11-06T13:28:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdb3017fb80 0x7fdb3018d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdb1c08cbd0 0x7fdb1c08f090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb30175a40 0x7fdb301700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 --2- 172.21.15.38:0/3863737345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdb3017e750 0x7fdb3017c100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:10.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 >> 172.21.15.38:0/3863737345 conn(0x7fdb3006a970 msgr2=0x7fdb300c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 shutdown_connections 2023-11-06T13:28:10.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:10.958+0000 7fdb35f97700 1 -- 172.21.15.38:0/3863737345 wait complete. 2023-11-06T13:28:10.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-06T13:28:11.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.092+0000 7f128d3d2700 1 Processor -- start 2023-11-06T13:28:11.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.092+0000 7f128d3d2700 1 -- start start 2023-11-06T13:28:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f128d3d2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1288175a40 0x7f128817f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f128d3d2700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f128817e970 0x7f1288185840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f128d3d2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128817ddd0 con 0x7f128817fb80 2023-11-06T13:28:11.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f128d3d2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1288064780 con 0x7f1288175a40 2023-11-06T13:28:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f128d3d2700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880c4c20 con 0x7f128817e970 2023-11-06T13:28:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1288175a40 0x7f128817f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1288175a40 0x7f128817f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48544/0 (socket says 172.21.15.38:48544) 2023-11-06T13:28:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 -- 172.21.15.38:0/728073168 learned_addr learned my addr 172.21.15.38:0/728073168 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:11.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f12877fe700 1 --2- 172.21.15.38:0/728073168 >> v2:172.21.15.44:3300/0 conn(0x7f128817e970 0x7f1288185840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 -- 172.21.15.38:0/728073168 >> v2:172.21.15.44:3300/0 conn(0x7f128817e970 msgr2=0x7f1288185840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 --2- 172.21.15.38:0/728073168 >> v2:172.21.15.44:3300/0 conn(0x7f128817e970 0x7f1288185840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 -- 172.21.15.38:0/728073168 >> v1:172.21.15.44:6789/0 conn(0x7f128817fb80 legacy=0x7f128817e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.093+0000 7f1286ffd700 1 -- 172.21.15.38:0/728073168 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128817cee0 con 0x7f1288175a40 2023-11-06T13:28:11.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f1286ffd700 1 --2- 172.21.15.38:0/728073168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1288175a40 0x7f128817f690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f1288157d50 tx=0x7f12780090f0).ready entity=mon.0 client_cookie=cb42e4d07c7036c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f1285ffb700 1 -- 172.21.15.38:0/728073168 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800b520 con 0x7f1288175a40 2023-11-06T13:28:11.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f1285ffb700 1 -- 172.21.15.38:0/728073168 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127800b680 con 0x7f1288175a40 2023-11-06T13:28:11.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f1285ffb700 1 -- 172.21.15.38:0/728073168 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800ba00 con 0x7f1288175a40 2023-11-06T13:28:11.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 -- 172.21.15.38:0/728073168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1288175a40 msgr2=0x7f128817f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 --2- 172.21.15.38:0/728073168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1288175a40 0x7f128817f690 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f1288157d50 tx=0x7f12780090f0).stop 2023-11-06T13:28:11.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 -- 172.21.15.38:0/728073168 shutdown_connections 2023-11-06T13:28:11.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 --2- 172.21.15.38:0/728073168 >> v2:172.21.15.44:3300/0 conn(0x7f128817e970 0x7f1288185840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 --2- 172.21.15.38:0/728073168 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1288175a40 0x7f128817f690 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 -- 172.21.15.38:0/728073168 >> 172.21.15.38:0/728073168 conn(0x7f128806a970 msgr2=0x7f12880f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:11.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 -- 172.21.15.38:0/728073168 shutdown_connections 2023-11-06T13:28:11.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.094+0000 7f128d3d2700 1 -- 172.21.15.38:0/728073168 wait complete. 2023-11-06T13:28:11.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.096+0000 7f128d3d2700 1 Processor -- start 2023-11-06T13:28:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.096+0000 7f128d3d2700 1 -- start start 2023-11-06T13:28:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f128d3d2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1288175a40 0x7f12880cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f128d3d2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 0x7f1288157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f128d3d2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f128817fb80 0x7f1288157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f128d3d2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288181280 con 0x7f128817e970 2023-11-06T13:28:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f128d3d2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288180390 con 0x7f128817fb80 2023-11-06T13:28:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f128d3d2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288180670 con 0x7f1288175a40 2023-11-06T13:28:11.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 0x7f1288157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 0x7f1288157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48546/0 (socket says 172.21.15.38:48546) 2023-11-06T13:28:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 -- 172.21.15.38:0/2002728728 learned_addr learned my addr 172.21.15.38:0/2002728728 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f1286ffd700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1288175a40 0x7f12880cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12877fe700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f128817fb80 0x7f1288157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 -- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1288175a40 msgr2=0x7f12880cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1288175a40 0x7f12880cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 -- 172.21.15.38:0/2002728728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f128817fb80 msgr2=0x7f1288157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f128817fb80 0x7f1288157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 -- 172.21.15.38:0/2002728728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009370 con 0x7f128817e970 2023-11-06T13:28:11.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12877fe700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f128817fb80 0x7f1288157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f12867fc700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 0x7f1288157370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f127000c440 tx=0x7f1270007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000ce90 con 0x7f128817e970 2023-11-06T13:28:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.097+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000f470 con 0x7f128817e970 2023-11-06T13:28:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.098+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000f810 con 0x7f128817e970 2023-11-06T13:28:11.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.098+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1288180950 con 0x7f128817e970 2023-11-06T13:28:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.098+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1288180f10 con 0x7f128817e970 2023-11-06T13:28:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.098+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12880cdb30 con 0x7f128817e970 2023-11-06T13:28:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.099+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f127000fb80 con 0x7f128817e970 2023-11-06T13:28:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.100+0000 7f127effd700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f126808cba0 0x7f126808f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.100+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f12700b1650 con 0x7f128817e970 2023-11-06T13:28:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.100+0000 7f1286ffd700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f126808cba0 0x7f126808f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.101+0000 7f1286ffd700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f126808cba0 0x7f126808f060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f1278006dd0 tx=0x7f1278017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.104+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1270081b10 con 0x7f128817e970 2023-11-06T13:28:11.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.281+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f128806c580 con 0x7f128817e970 2023-11-06T13:28:11.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.281+0000 7f127effd700 1 -- 172.21.15.38:0/2002728728 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1270085130 con 0x7f128817e970 2023-11-06T13:28:11.285 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:11.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f126808cba0 msgr2=0x7f126808f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f126808cba0 0x7f126808f060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f1278006dd0 tx=0x7f1278017000).stop 2023-11-06T13:28:11.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 msgr2=0x7f1288157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 0x7f1288157370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f127000c440 tx=0x7f1270007d80).stop 2023-11-06T13:28:11.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 shutdown_connections 2023-11-06T13:28:11.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f126808cba0 0x7f126808f060 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f128817fb80 0x7f1288157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1288175a40 0x7f12880cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 --2- 172.21.15.38:0/2002728728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f128817e970 0x7f1288157370 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 >> 172.21.15.38:0/2002728728 conn(0x7f128806a970 msgr2=0x7f12880f32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 shutdown_connections 2023-11-06T13:28:11.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.283+0000 7f128d3d2700 1 -- 172.21.15.38:0/2002728728 wait complete. 2023-11-06T13:28:11.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-06T13:28:11.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.416+0000 7fb77641d700 1 Processor -- start 2023-11-06T13:28:11.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.416+0000 7fb77641d700 1 -- start start 2023-11-06T13:28:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.417+0000 7fb77641d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77017d550 con 0x7fb770175590 2023-11-06T13:28:11.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.417+0000 7fb77641d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77017fad0 con 0x7fb770084bd0 2023-11-06T13:28:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.417+0000 7fb77641d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb770085ad0 con 0x7fb770175970 2023-11-06T13:28:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.417+0000 7fb77541b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb770175590 0x7fb77017d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43864/0 (socket says 172.21.15.38:43864) 2023-11-06T13:28:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.417+0000 7fb77541b700 1 -- 172.21.15.38:0/3365646982 learned_addr learned my addr 172.21.15.38:0/3365646982 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216078008 0 0) 0x7fb77017d550 con 0x7fb770175590 2023-11-06T13:28:11.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7580033f0 con 0x7fb770175590 2023-11-06T13:28:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162134359 0 0) 0x7fb770085ad0 con 0x7fb770175970 2023-11-06T13:28:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77017d550 con 0x7fb770175970 2023-11-06T13:28:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3860815062 0 0) 0x7fb7580033f0 con 0x7fb770175590 2023-11-06T13:28:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 >> v1:172.21.15.163:6789/0 conn(0x7fb770175970 legacy=0x7fb77017e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 >> v1:172.21.15.44:6789/0 conn(0x7fb770084bd0 legacy=0x7fb770084ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77017c940 con 0x7fb770175590 2023-11-06T13:28:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7fb768001470 con 0x7fb770175590 2023-11-06T13:28:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 >> v1:172.21.15.38:6789/0 conn(0x7fb770175590 legacy=0x7fb77017d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb758003aa0 0x7fb758003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb758004690 0x7fb758004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758005120 0x7fb75800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75800c080 con 0x7fb758003aa0 2023-11-06T13:28:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75800c1f0 con 0x7fb758005120 2023-11-06T13:28:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75800c3b0 con 0x7fb758004690 2023-11-06T13:28:11.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb77541b700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb758003aa0 0x7fb758003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb775c1c700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758005120 0x7fb75800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb774c1a700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb758004690 0x7fb758004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb77541b700 1 -- 172.21.15.38:0/3365646982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb758004690 msgr2=0x7fb758004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb77541b700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb758004690 0x7fb758004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.418+0000 7fb77541b700 1 -- 172.21.15.38:0/3365646982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758005120 msgr2=0x7fb75800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77541b700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758005120 0x7fb75800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb775c1c700 1 -- 172.21.15.38:0/3365646982 reap_dead start 2023-11-06T13:28:11.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77541b700 1 -- 172.21.15.38:0/3365646982 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580033f0 con 0x7fb758003aa0 2023-11-06T13:28:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77541b700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb758003aa0 0x7fb758003e80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb76800c190 tx=0x7fb768001e10).ready entity=mon.0 client_cookie=6bd2504fc9e59c52 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76800ca00 con 0x7fb758003aa0 2023-11-06T13:28:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76800cb60 con 0x7fb758003aa0 2023-11-06T13:28:11.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb76ffff700 1 -- 172.21.15.38:0/3365646982 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680070d0 con 0x7fb758003aa0 2023-11-06T13:28:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 -- 172.21.15.38:0/3365646982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb758003aa0 msgr2=0x7fb758003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb758003aa0 0x7fb758003e80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb76800c190 tx=0x7fb768001e10).stop 2023-11-06T13:28:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 -- 172.21.15.38:0/3365646982 shutdown_connections 2023-11-06T13:28:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 --2- 172.21.15.38:0/3365646982 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb758003aa0 0x7fb758003e80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 -- 172.21.15.38:0/3365646982 >> 172.21.15.38:0/3365646982 conn(0x7fb7700f5d10 msgr2=0x7fb7700f1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 -- 172.21.15.38:0/3365646982 shutdown_connections 2023-11-06T13:28:11.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.419+0000 7fb77641d700 1 -- 172.21.15.38:0/3365646982 wait complete. 2023-11-06T13:28:11.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.421+0000 7fb77641d700 1 Processor -- start 2023-11-06T13:28:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.421+0000 7fb77641d700 1 -- start start 2023-11-06T13:28:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77641d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758003aa0 0x7fb77016e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77641d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 0x7fb770172420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77641d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77016e800 0x7fb770172910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77641d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770063410 con 0x7fb770062ea0 2023-11-06T13:28:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77641d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770064230 con 0x7fb758003aa0 2023-11-06T13:28:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77641d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770063620 con 0x7fb77016e800 2023-11-06T13:28:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 0x7fb770172420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 0x7fb770172420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48558/0 (socket says 172.21.15.38:48558) 2023-11-06T13:28:11.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 -- 172.21.15.38:0/4165289235 learned_addr learned my addr 172.21.15.38:0/4165289235 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:11.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb77541b700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758003aa0 0x7fb77016e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb775c1c700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77016e800 0x7fb770172910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 -- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77016e800 msgr2=0x7fb770172910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77016e800 0x7fb770172910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 -- 172.21.15.38:0/4165289235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758003aa0 msgr2=0x7fb77016e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758003aa0 0x7fb77016e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.422+0000 7fb774c1a700 1 -- 172.21.15.38:0/4165289235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770063900 con 0x7fb770062ea0 2023-11-06T13:28:11.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.423+0000 7fb774c1a700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 0x7fb770172420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fb7640010e0 tx=0x7fb764007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.423+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400f8d0 con 0x7fb770062ea0 2023-11-06T13:28:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.423+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76400fa30 con 0x7fb770062ea0 2023-11-06T13:28:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.423+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb770063be0 con 0x7fb770062ea0 2023-11-06T13:28:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.423+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400fdf0 con 0x7fb770062ea0 2023-11-06T13:28:11.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.423+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700efaf0 con 0x7fb770062ea0 2023-11-06T13:28:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.424+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700643a0 con 0x7fb770062ea0 2023-11-06T13:28:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.425+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fb76401d3b0 con 0x7fb770062ea0 2023-11-06T13:28:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.425+0000 7fb76d7fa700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb75c08cbd0 0x7fb75c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.425+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb7640b2140 con 0x7fb770062ea0 2023-11-06T13:28:11.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.426+0000 7fb77541b700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb75c08cbd0 0x7fb75c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.426+0000 7fb77541b700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb75c08cbd0 0x7fb75c08f090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb768001e70 tx=0x7fb768015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.429+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb764082680 con 0x7fb770062ea0 2023-11-06T13:28:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.600+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7700475a0 con 0x7fb770062ea0 2023-11-06T13:28:11.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.601+0000 7fb76d7fa700 1 -- 172.21.15.38:0/4165289235 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb764019070 con 0x7fb770062ea0 2023-11-06T13:28:11.604 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:11.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb75c08cbd0 msgr2=0x7fb75c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb75c08cbd0 0x7fb75c08f090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb768001e70 tx=0x7fb768015000).stop 2023-11-06T13:28:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 msgr2=0x7fb770172420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 0x7fb770172420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fb7640010e0 tx=0x7fb764007b90).stop 2023-11-06T13:28:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 shutdown_connections 2023-11-06T13:28:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb77016e800 0x7fb770172910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb75c08cbd0 0x7fb75c08f090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb758003aa0 0x7fb77016e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 --2- 172.21.15.38:0/4165289235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb770062ea0 0x7fb770172420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 >> 172.21.15.38:0/4165289235 conn(0x7fb7700f5d10 msgr2=0x7fb770064b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 shutdown_connections 2023-11-06T13:28:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.603+0000 7fb77641d700 1 -- 172.21.15.38:0/4165289235 wait complete. 2023-11-06T13:28:11.618 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-06T13:28:11.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.736+0000 7fd5cc6f2700 1 Processor -- start 2023-11-06T13:28:11.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.737+0000 7fd5cc6f2700 1 -- start start 2023-11-06T13:28:11.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cc6f2700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fd5c417b6a0 0x7fd5c417d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cc6f2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd5c417d8c0 0x7fd5c417f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cc6f2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c40844c0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cc6f2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40842d0 con 0x7fd5c417d8c0 2023-11-06T13:28:11.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cc6f2700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40847a0 con 0x7fd5c417b6a0 2023-11-06T13:28:11.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd5c417d8c0 0x7fd5c417f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd5c417d8c0 0x7fd5c417f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48568/0 (socket says 172.21.15.38:48568) 2023-11-06T13:28:11.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 -- 172.21.15.38:0/773068737 learned_addr learned my addr 172.21.15.38:0/773068737 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:11.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5c9c8d700 1 --2- 172.21.15.38:0/773068737 >> v2:172.21.15.163:3300/0 conn(0x7fd5c417b6a0 0x7fd5c417d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 -- 172.21.15.38:0/773068737 >> v2:172.21.15.163:3300/0 conn(0x7fd5c417b6a0 msgr2=0x7fd5c417d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:11.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 --2- 172.21.15.38:0/773068737 >> v2:172.21.15.163:3300/0 conn(0x7fd5c417b6a0 0x7fd5c417d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 -- 172.21.15.38:0/773068737 >> v1:172.21.15.44:6789/0 conn(0x7fd5c417b2c0 legacy=0x7fd5c4083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 -- 172.21.15.38:0/773068737 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4084a80 con 0x7fd5c417d8c0 2023-11-06T13:28:11.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.738+0000 7fd5cac8f700 1 --2- 172.21.15.38:0/773068737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417d8c0 0x7fd5c417f160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd5c4154ab0 tx=0x7fd5b40090f0).ready entity=mon.0 client_cookie=a76823952e5240fa server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5c948c700 1 -- 172.21.15.38:0/773068737 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400b600 con 0x7fd5c417d8c0 2023-11-06T13:28:11.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5c948c700 1 -- 172.21.15.38:0/773068737 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b400b760 con 0x7fd5c417d8c0 2023-11-06T13:28:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5c948c700 1 -- 172.21.15.38:0/773068737 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400bb00 con 0x7fd5c417d8c0 2023-11-06T13:28:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/773068737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417d8c0 msgr2=0x7fd5c417f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/773068737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417d8c0 0x7fd5c417f160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd5c4154ab0 tx=0x7fd5b40090f0).stop 2023-11-06T13:28:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/773068737 shutdown_connections 2023-11-06T13:28:11.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/773068737 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417d8c0 0x7fd5c417f160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/773068737 >> v2:172.21.15.163:3300/0 conn(0x7fd5c417b6a0 0x7fd5c417d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/773068737 >> 172.21.15.38:0/773068737 conn(0x7fd5c40ef600 msgr2=0x7fd5c405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:11.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/773068737 shutdown_connections 2023-11-06T13:28:11.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.739+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/773068737 wait complete. 2023-11-06T13:28:11.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.741+0000 7fd5cc6f2700 1 Processor -- start 2023-11-06T13:28:11.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.741+0000 7fd5cc6f2700 1 -- start start 2023-11-06T13:28:11.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 0x7fd5c417a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5c417b6a0 0x7fd5c416d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c417d8c0 0x7fd5c4177760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4173ec0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c41741a0 con 0x7fd5c417d8c0 2023-11-06T13:28:11.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4174480 con 0x7fd5c417b6a0 2023-11-06T13:28:11.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 0x7fd5c417a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 0x7fd5c417a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48580/0 (socket says 172.21.15.38:48580) 2023-11-06T13:28:11.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 -- 172.21.15.38:0/690986781 learned_addr learned my addr 172.21.15.38:0/690986781 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:11.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cac8f700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c417d8c0 0x7fd5c4177760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5c9c8d700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5c417b6a0 0x7fd5c416d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 -- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5c417b6a0 msgr2=0x7fd5c416d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5c417b6a0 0x7fd5c416d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 -- 172.21.15.38:0/690986781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c417d8c0 msgr2=0x7fd5c4177760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c417d8c0 0x7fd5c4177760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 -- 172.21.15.38:0/690986781 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4009370 con 0x7fd5c417b2c0 2023-11-06T13:28:11.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5c9c8d700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5c417b6a0 0x7fd5c416d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:11.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5ca48e700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 0x7fd5c417a880 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd5bc00c710 tx=0x7fd5bc001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc010510 con 0x7fd5c417b2c0 2023-11-06T13:28:11.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc010670 con 0x7fd5c417b2c0 2023-11-06T13:28:11.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c4176f60 con 0x7fd5c417b2c0 2023-11-06T13:28:11.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0109f0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.742+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c416db10 con 0x7fd5c417b2c0 2023-11-06T13:28:11.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.743+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c41746c0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.744+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fd5bc01b400 con 0x7fd5c417b2c0 2023-11-06T13:28:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.745+0000 7fd5c27fc700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5b008cba0 0x7fd5b008f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.745+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd5bc0b1df0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.745+0000 7fd5c9c8d700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5b008cba0 0x7fd5b008f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.746+0000 7fd5c9c8d700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5b008cba0 0x7fd5b008f060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd5c417ad70 tx=0x7fd5b8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:11.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.749+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd5c41746c0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.922+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd5c4176dc0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.923+0000 7fd5c27fc700 1 -- 172.21.15.38:0/690986781 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd5c4176dc0 con 0x7fd5c417b2c0 2023-11-06T13:28:11.927 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-11-06T13:28:11.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5b008cba0 msgr2=0x7fd5b008f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5b008cba0 0x7fd5b008f060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd5c417ad70 tx=0x7fd5b8008040).stop 2023-11-06T13:28:11.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 msgr2=0x7fd5c417a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:11.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 0x7fd5c417a880 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd5bc00c710 tx=0x7fd5bc001540).stop 2023-11-06T13:28:11.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 shutdown_connections 2023-11-06T13:28:11.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd5b008cba0 0x7fd5b008f060 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5c417d8c0 0x7fd5c4177760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd5c417b2c0 0x7fd5c417a880 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 --2- 172.21.15.38:0/690986781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd5c417b6a0 0x7fd5c416d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:11.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 >> 172.21.15.38:0/690986781 conn(0x7fd5c40ef600 msgr2=0x7fd5c405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:11.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 shutdown_connections 2023-11-06T13:28:11.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:11.925+0000 7fd5cc6f2700 1 -- 172.21.15.38:0/690986781 wait complete. 2023-11-06T13:28:11.941 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:28:12.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.056+0000 7f577ecc1700 1 Processor -- start 2023-11-06T13:28:12.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.056+0000 7f577ecc1700 1 -- start start 2023-11-06T13:28:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577ecc1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f577817e2b0 0x7f5778182750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577ecc1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5778182c40 0x7f57781802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577ecc1700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780e8a90 con 0x7f57781807c0 2023-11-06T13:28:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577ecc1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57780e8ce0 con 0x7f5778182c40 2023-11-06T13:28:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577ecc1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57780e8fc0 con 0x7f577817e2b0 2023-11-06T13:28:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577d4be700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5778182c40 0x7f57781802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577d4be700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5778182c40 0x7f57781802d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48592/0 (socket says 172.21.15.38:48592) 2023-11-06T13:28:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.057+0000 7f577d4be700 1 -- 172.21.15.38:0/2489852980 learned_addr learned my addr 172.21.15.38:0/2489852980 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577dcbf700 1 --2- 172.21.15.38:0/2489852980 >> v2:172.21.15.163:3300/0 conn(0x7f577817e2b0 0x7f5778182750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577d4be700 1 -- 172.21.15.38:0/2489852980 >> v2:172.21.15.163:3300/0 conn(0x7f577817e2b0 msgr2=0x7f5778182750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577d4be700 1 --2- 172.21.15.38:0/2489852980 >> v2:172.21.15.163:3300/0 conn(0x7f577817e2b0 0x7f5778182750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577d4be700 1 -- 172.21.15.38:0/2489852980 >> v1:172.21.15.44:6789/0 conn(0x7f57781807c0 legacy=0x7f5778065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577d4be700 1 -- 172.21.15.38:0/2489852980 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57780e92a0 con 0x7f5778182c40 2023-11-06T13:28:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577d4be700 1 --2- 172.21.15.38:0/2489852980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5778182c40 0x7f57781802d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f5778066600 tx=0x7f57740090f0).ready entity=mon.0 client_cookie=1e17aab5cf32db21 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577ccbd700 1 -- 172.21.15.38:0/2489852980 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400b600 con 0x7f5778182c40 2023-11-06T13:28:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577ccbd700 1 -- 172.21.15.38:0/2489852980 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577400b760 con 0x7f5778182c40 2023-11-06T13:28:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.058+0000 7f577ccbd700 1 -- 172.21.15.38:0/2489852980 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400bae0 con 0x7f5778182c40 2023-11-06T13:28:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 -- 172.21.15.38:0/2489852980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5778182c40 msgr2=0x7f57781802d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 --2- 172.21.15.38:0/2489852980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5778182c40 0x7f57781802d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f5778066600 tx=0x7f57740090f0).stop 2023-11-06T13:28:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 -- 172.21.15.38:0/2489852980 shutdown_connections 2023-11-06T13:28:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 --2- 172.21.15.38:0/2489852980 >> v2:172.21.15.163:3300/0 conn(0x7f577817e2b0 0x7f5778182750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 --2- 172.21.15.38:0/2489852980 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5778182c40 0x7f57781802d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 -- 172.21.15.38:0/2489852980 >> 172.21.15.38:0/2489852980 conn(0x7f57780ee0f0 msgr2=0x7f57780ee500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 -- 172.21.15.38:0/2489852980 shutdown_connections 2023-11-06T13:28:12.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.059+0000 7f577ecc1700 1 -- 172.21.15.38:0/2489852980 wait complete. 2023-11-06T13:28:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.060+0000 7f577ecc1700 1 Processor -- start 2023-11-06T13:28:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.060+0000 7f577ecc1700 1 -- start start 2023-11-06T13:28:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577ecc1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 0x7f57781586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577ecc1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57781807c0 0x7f5778067cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577ecc1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5778182c40 0x7f57780681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577ecc1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577818d820 con 0x7f577817e2b0 2023-11-06T13:28:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577ecc1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577818db00 con 0x7f5778182c40 2023-11-06T13:28:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577ecc1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577818dde0 con 0x7f57781807c0 2023-11-06T13:28:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577dcbf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 0x7f57781586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577dcbf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 0x7f57781586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48598/0 (socket says 172.21.15.38:48598) 2023-11-06T13:28:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577dcbf700 1 -- 172.21.15.38:0/463791995 learned_addr learned my addr 172.21.15.38:0/463791995 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.061+0000 7f577d4be700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57781807c0 0x7f5778067cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577e4c0700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5778182c40 0x7f57780681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577dcbf700 1 -- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57781807c0 msgr2=0x7f5778067cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577dcbf700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57781807c0 0x7f5778067cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577dcbf700 1 -- 172.21.15.38:0/463791995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5778182c40 msgr2=0x7f57780681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577dcbf700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5778182c40 0x7f57780681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577dcbf700 1 -- 172.21.15.38:0/463791995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774009370 con 0x7f577817e2b0 2023-11-06T13:28:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577e4c0700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5778182c40 0x7f57780681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577dcbf700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 0x7f57781586d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f576800d890 tx=0x7f5768008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680125f0 con 0x7f577817e2b0 2023-11-06T13:28:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768012750 con 0x7f577817e2b0 2023-11-06T13:28:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577818e0c0 con 0x7f577817e2b0 2023-11-06T13:28:12.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768012ad0 con 0x7f577817e2b0 2023-11-06T13:28:12.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.062+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577818e680 con 0x7f577817e2b0 2023-11-06T13:28:12.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.063+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577818e9f0 con 0x7f577817e2b0 2023-11-06T13:28:12.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.064+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f5768013480 con 0x7f577817e2b0 2023-11-06T13:28:12.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.064+0000 7f576dffb700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f575c08cbd0 0x7f575c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.064+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f57680b21c0 con 0x7f577817e2b0 2023-11-06T13:28:12.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.065+0000 7f577d4be700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f575c08cbd0 0x7f575c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.065+0000 7f577d4be700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f575c08cbd0 0x7f575c08f090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f5774009130 tx=0x7f5774017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.068+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5768082700 con 0x7f577817e2b0 2023-11-06T13:28:12.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.285+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57780eba90 con 0x7f577817e2b0 2023-11-06T13:28:12.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.285+0000 7f576dffb700 1 -- 172.21.15.38:0/463791995 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10635 (secure 0 0 0) 0x7f5768085d20 con 0x7f577817e2b0 2023-11-06T13:28:12.289 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:12.289 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:58.254004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4361,"mds_1":4355,"mds_2":4352,"mds_3":4349,"mds_4":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4315":{"gid":4315,"name":"e","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4321":{"gid":4321,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4323":{"gid":4323,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4326":{"gid":4326,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4349":{"gid":4349,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4352":{"gid":4352,"name":"c","rank":2,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4355":{"gid":4355,"name":"i","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-06T13:28:12.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f575c08cbd0 msgr2=0x7f575c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f575c08cbd0 0x7f575c08f090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f5774009130 tx=0x7f5774017000).stop 2023-11-06T13:28:12.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 msgr2=0x7f57781586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 0x7f57781586d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f576800d890 tx=0x7f5768008040).stop 2023-11-06T13:28:12.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 shutdown_connections 2023-11-06T13:28:12.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f575c08cbd0 0x7f575c08f090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5778182c40 0x7f57780681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f577817e2b0 0x7f57781586d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 --2- 172.21.15.38:0/463791995 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57781807c0 0x7f5778067cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 >> 172.21.15.38:0/463791995 conn(0x7f57780ee0f0 msgr2=0x7f57780ee4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:12.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 shutdown_connections 2023-11-06T13:28:12.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.287+0000 7f577ecc1700 1 -- 172.21.15.38:0/463791995 wait complete. 2023-11-06T13:28:12.293 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2023-11-06T13:28:12.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:12.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.418+0000 7f7234811700 1 Processor -- start 2023-11-06T13:28:12.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.418+0000 7f7234811700 1 -- start start 2023-11-06T13:28:12.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.419+0000 7f7234811700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7230173950 0x7f72300c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.419+0000 7f7234811700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723017bd50 con 0x7f723017a930 2023-11-06T13:28:12.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.419+0000 7f7234811700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723017ae60 con 0x7f723017c8f0 2023-11-06T13:28:12.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.419+0000 7f7234811700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723017b140 con 0x7f7230173950 2023-11-06T13:28:12.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.419+0000 7f722dd9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f723017a930 0x7f723017c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43868/0 (socket says 172.21.15.38:43868) 2023-11-06T13:28:12.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.419+0000 7f722dd9b700 1 -- 172.21.15.38:0/1697958194 learned_addr learned my addr 172.21.15.38:0/1697958194 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:12.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722e59c700 1 --2- 172.21.15.38:0/1697958194 >> v2:172.21.15.44:3300/0 conn(0x7f7230173950 0x7f72300c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244970539 0 0) 0x7f723017bd50 con 0x7f723017a930 2023-11-06T13:28:12.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f721c0033f0 con 0x7f723017a930 2023-11-06T13:28:12.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423451409 0 0) 0x7f723017ae60 con 0x7f723017c8f0 2023-11-06T13:28:12.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723017bd50 con 0x7f723017c8f0 2023-11-06T13:28:12.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163152778 0 0) 0x7f721c0033f0 con 0x7f723017a930 2023-11-06T13:28:12.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 >> v2:172.21.15.44:3300/0 conn(0x7f7230173950 msgr2=0x7f72300c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 --2- 172.21.15.38:0/1697958194 >> v2:172.21.15.44:3300/0 conn(0x7f7230173950 0x7f72300c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 >> v1:172.21.15.163:6789/0 conn(0x7f723017c8f0 legacy=0x7f723017e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723017b420 con 0x7f723017a930 2023-11-06T13:28:12.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f7218001470 con 0x7f723017a930 2023-11-06T13:28:12.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 >> v1:172.21.15.38:6789/0 conn(0x7f723017a930 legacy=0x7f723017c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f721c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f721c004690 0x7f721c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f721c005000 0x7f721c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723017b140 con 0x7f721c003ac0 2023-11-06T13:28:12.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c00beb0 con 0x7f721c004690 2023-11-06T13:28:12.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c00c070 con 0x7f721c005000 2023-11-06T13:28:12.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722e59c700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f721c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722dd9b700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f721c004690 0x7f721c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.420+0000 7f722ed9d700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f721c005000 0x7f721c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722e59c700 1 -- 172.21.15.38:0/1697958194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f721c005000 msgr2=0x7f721c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722e59c700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f721c005000 0x7f721c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722e59c700 1 -- 172.21.15.38:0/1697958194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f721c004690 msgr2=0x7f721c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722e59c700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f721c004690 0x7f721c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722ed9d700 1 -- 172.21.15.38:0/1697958194 reap_dead start 2023-11-06T13:28:12.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722e59c700 1 -- 172.21.15.38:0/1697958194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0033f0 con 0x7f721c003ac0 2023-11-06T13:28:12.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722e59c700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f721c003ec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f722800e210 tx=0x7f722800b040).ready entity=mon.0 client_cookie=4c8e5ae079a87b85 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228009ac0 con 0x7f721c003ac0 2023-11-06T13:28:12.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722800f040 con 0x7f721c003ac0 2023-11-06T13:28:12.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f722d59a700 1 -- 172.21.15.38:0/1697958194 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722800ecd0 con 0x7f721c003ac0 2023-11-06T13:28:12.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 -- 172.21.15.38:0/1697958194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 msgr2=0x7f721c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f721c003ec0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f722800e210 tx=0x7f722800b040).stop 2023-11-06T13:28:12.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 -- 172.21.15.38:0/1697958194 shutdown_connections 2023-11-06T13:28:12.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 --2- 172.21.15.38:0/1697958194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f721c003ec0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 -- 172.21.15.38:0/1697958194 >> 172.21.15.38:0/1697958194 conn(0x7f72300f3cf0 msgr2=0x7f72300efc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:12.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 -- 172.21.15.38:0/1697958194 shutdown_connections 2023-11-06T13:28:12.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.421+0000 7f7234811700 1 -- 172.21.15.38:0/1697958194 wait complete. 2023-11-06T13:28:12.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.423+0000 7f7234811700 1 Processor -- start 2023-11-06T13:28:12.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.423+0000 7f7234811700 1 -- start start 2023-11-06T13:28:12.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f7234811700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f723016d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f7234811700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7230170240 0x7f723016d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f7234811700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7230174f90 0x7f7230175410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f7234811700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230174b00 con 0x7f721c003ac0 2023-11-06T13:28:12.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f7234811700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230173ef0 con 0x7f7230174f90 2023-11-06T13:28:12.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f7234811700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72301741d0 con 0x7f7230170240 2023-11-06T13:28:12.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f723016d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f723016d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48622/0 (socket says 172.21.15.38:48622) 2023-11-06T13:28:12.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 -- 172.21.15.38:0/3067030885 learned_addr learned my addr 172.21.15.38:0/3067030885 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:12.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722dd9b700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7230170240 0x7f723016d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722ed9d700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7230174f90 0x7f7230175410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 -- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7230170240 msgr2=0x7f723016d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7230170240 0x7f723016d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 -- 172.21.15.38:0/3067030885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7230174f90 msgr2=0x7f7230175410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7230174f90 0x7f7230175410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722e59c700 1 -- 172.21.15.38:0/3067030885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72301744b0 con 0x7f721c003ac0 2023-11-06T13:28:12.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.424+0000 7f722ed9d700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7230174f90 0x7f7230175410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:12.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.425+0000 7f722e59c700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f723016d320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f721c00be80 tx=0x7f722801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.425+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228013cc0 con 0x7f721c003ac0 2023-11-06T13:28:12.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.425+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228013e20 con 0x7f721c003ac0 2023-11-06T13:28:12.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.425+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7230174790 con 0x7f721c003ac0 2023-11-06T13:28:12.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.425+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228027420 con 0x7f721c003ac0 2023-11-06T13:28:12.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.425+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7230175900 con 0x7f721c003ac0 2023-11-06T13:28:12.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.426+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7230174de0 con 0x7f721c003ac0 2023-11-06T13:28:12.443 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.426+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f7228024020 con 0x7f721c003ac0 2023-11-06T13:28:12.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.427+0000 7f72267fc700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f721008cbd0 0x7f721008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.427+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f72280b3eb0 con 0x7f721c003ac0 2023-11-06T13:28:12.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.427+0000 7f722dd9b700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f721008cbd0 0x7f721008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.428+0000 7f722dd9b700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f721008cbd0 0x7f721008f090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f7230170680 tx=0x7f7218001e10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.444 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.431+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f72280843f0 con 0x7f721c003ac0 2023-11-06T13:28:12.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.605+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f723006c580 con 0x7f721c003ac0 2023-11-06T13:28:12.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.607+0000 7f72267fc700 1 -- 172.21.15.38:0/3067030885 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f722802c030 con 0x7f721c003ac0 2023-11-06T13:28:12.610 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:12.610 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:12.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.608+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f721008cbd0 msgr2=0x7f721008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.608+0000 7f7234811700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f721008cbd0 0x7f721008f090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f7230170680 tx=0x7f7218001e10).stop 2023-11-06T13:28:12.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.608+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 msgr2=0x7f723016d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.608+0000 7f7234811700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f723016d320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f721c00be80 tx=0x7f722801a000).stop 2023-11-06T13:28:12.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 shutdown_connections 2023-11-06T13:28:12.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f721008cbd0 0x7f721008f090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7230174f90 0x7f7230175410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f721c003ac0 0x7f723016d320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 --2- 172.21.15.38:0/3067030885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7230170240 0x7f723016d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 >> 172.21.15.38:0/3067030885 conn(0x7f72300f3cf0 msgr2=0x7f7230069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:12.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 shutdown_connections 2023-11-06T13:28:12.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.609+0000 7f7234811700 1 -- 172.21.15.38:0/3067030885 wait complete. 2023-11-06T13:28:12.625 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:28:12.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.740+0000 7f1efff0e700 1 Processor -- start 2023-11-06T13:28:12.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.740+0000 7f1efff0e700 1 -- start start 2023-11-06T13:28:12.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efff0e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1ef81756e0 0x7f1ef80640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efff0e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef817d9d0 con 0x7f1ef817e570 2023-11-06T13:28:12.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efff0e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef8064a50 con 0x7f1ef80645d0 2023-11-06T13:28:12.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efff0e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef80c8560 con 0x7f1ef81756e0 2023-11-06T13:28:12.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efe4ab700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f1ef817e570 0x7f1ef8185580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43874/0 (socket says 172.21.15.38:43874) 2023-11-06T13:28:12.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efe4ab700 1 -- 172.21.15.38:0/565943345 learned_addr learned my addr 172.21.15.38:0/565943345 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:12.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efdcaa700 1 --2- 172.21.15.38:0/565943345 >> v2:172.21.15.163:3300/0 conn(0x7f1ef81756e0 0x7f1ef80640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364554189 0 0) 0x7f1ef817d9d0 con 0x7f1ef817e570 2023-11-06T13:28:12.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ee00033f0 con 0x7f1ef817e570 2023-11-06T13:28:12.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.741+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484403638 0 0) 0x7f1ef8064a50 con 0x7f1ef80645d0 2023-11-06T13:28:12.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef817d9d0 con 0x7f1ef80645d0 2023-11-06T13:28:12.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219681947 0 0) 0x7f1ee00033f0 con 0x7f1ef817e570 2023-11-06T13:28:12.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 >> v2:172.21.15.163:3300/0 conn(0x7f1ef81756e0 msgr2=0x7f1ef80640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 --2- 172.21.15.38:0/565943345 >> v2:172.21.15.163:3300/0 conn(0x7f1ef81756e0 0x7f1ef80640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 >> v1:172.21.15.44:6789/0 conn(0x7f1ef80645d0 legacy=0x7f1ef817de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef817c800 con 0x7f1ef817e570 2023-11-06T13:28:12.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f1ef0001470 con 0x7f1ef817e570 2023-11-06T13:28:12.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 >> v1:172.21.15.38:6789/0 conn(0x7f1ef817e570 legacy=0x7f1ef8185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee0003ac0 0x7f1ee0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0005000 0x7f1ee000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee000be80 con 0x7f1ee0004690 2023-11-06T13:28:12.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee000bff0 con 0x7f1ee0003ac0 2023-11-06T13:28:12.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee000c1b0 con 0x7f1ee0005000 2023-11-06T13:28:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efdcaa700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee0003ac0 0x7f1ee0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efe4ab700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0005000 0x7f1ee000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 -- 172.21.15.38:0/565943345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0005000 msgr2=0x7f1ee000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0005000 0x7f1ee000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 -- 172.21.15.38:0/565943345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee0003ac0 msgr2=0x7f1ee0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ee0003ac0 0x7f1ee0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 -- 172.21.15.38:0/565943345 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee00033f0 con 0x7f1ee0004690 2023-11-06T13:28:12.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efe4ab700 1 -- 172.21.15.38:0/565943345 reap_dead start 2023-11-06T13:28:12.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.742+0000 7f1efd4a9700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1eec0018d0 tx=0x7f1eec007bb0).ready entity=mon.0 client_cookie=813240960f95bd6d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec007020 con 0x7f1ee0004690 2023-11-06T13:28:12.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec007180 con 0x7f1ee0004690 2023-11-06T13:28:12.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efcca8700 1 -- 172.21.15.38:0/565943345 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec007500 con 0x7f1ee0004690 2023-11-06T13:28:12.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 -- 172.21.15.38:0/565943345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ee0004690 msgr2=0x7f1ee0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f1eec0018d0 tx=0x7f1eec007bb0).stop 2023-11-06T13:28:12.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 -- 172.21.15.38:0/565943345 shutdown_connections 2023-11-06T13:28:12.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 --2- 172.21.15.38:0/565943345 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ee0004690 0x7f1ee0004b10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 -- 172.21.15.38:0/565943345 >> 172.21.15.38:0/565943345 conn(0x7f1ef8069ea0 msgr2=0x7f1ef806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 -- 172.21.15.38:0/565943345 shutdown_connections 2023-11-06T13:28:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.743+0000 7f1efff0e700 1 -- 172.21.15.38:0/565943345 wait complete. 2023-11-06T13:28:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.744+0000 7f1efff0e700 1 Processor -- start 2023-11-06T13:28:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.745+0000 7f1efff0e700 1 -- start start 2023-11-06T13:28:12.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.745+0000 7f1efff0e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0004690 0x7f1ef8190330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.745+0000 7f1efff0e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef81843c0 0x7f1ef8192830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.745+0000 7f1efff0e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 0x7f1ef8192d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efff0e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8183f30 con 0x7f1ef8190820 2023-11-06T13:28:12.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efff0e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8183360 con 0x7f1ef81843c0 2023-11-06T13:28:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efff0e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8183600 con 0x7f1ee0004690 2023-11-06T13:28:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 0x7f1ef8192d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 0x7f1ef8192d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48634/0 (socket says 172.21.15.38:48634) 2023-11-06T13:28:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 -- 172.21.15.38:0/1642466874 learned_addr learned my addr 172.21.15.38:0/1642466874 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:12.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efd4a9700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef81843c0 0x7f1ef8192830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efdcaa700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0004690 0x7f1ef8190330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 -- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0004690 msgr2=0x7f1ef8190330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0004690 0x7f1ef8190330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 -- 172.21.15.38:0/1642466874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef81843c0 msgr2=0x7f1ef8192830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef81843c0 0x7f1ef8192830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 -- 172.21.15.38:0/1642466874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef81838e0 con 0x7f1ef8190820 2023-11-06T13:28:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efdcaa700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0004690 0x7f1ef8190330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efe4ab700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 0x7f1ef8192d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f1ef80c47d0 tx=0x7f1ef0001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0011590 con 0x7f1ef8190820 2023-11-06T13:28:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0011710 con 0x7f1ef8190820 2023-11-06T13:28:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef8183bc0 con 0x7f1ef8190820 2023-11-06T13:28:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0011ad0 con 0x7f1ef8190820 2023-11-06T13:28:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.746+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef80c96e0 con 0x7f1ef8190820 2023-11-06T13:28:12.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.747+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef806c580 con 0x7f1ef8190820 2023-11-06T13:28:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.748+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f1ef001d3b0 con 0x7f1ef8190820 2023-11-06T13:28:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.749+0000 7f1ef5ffb700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1ee408cbd0 0x7f1ee408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.749+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1ef00b1a10 con 0x7f1ef8190820 2023-11-06T13:28:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.749+0000 7f1efdcaa700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1ee408cbd0 0x7f1ee408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:12.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.749+0000 7f1efdcaa700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1ee408cbd0 0x7f1ee408f090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1ef80604d0 tx=0x7f1ee800b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:12.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.753+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1ef0081ed0 con 0x7f1ef8190820 2023-11-06T13:28:12.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.967+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ef817cae0 con 0x7f1ef8190820 2023-11-06T13:28:12.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.968+0000 7f1ef5ffb700 1 -- 172.21.15.38:0/1642466874 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10635 (secure 0 0 0) 0x7f1ef00854f0 con 0x7f1ef8190820 2023-11-06T13:28:12.972 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:12.972 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:58.254004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4361,"mds_1":4355,"mds_2":4352,"mds_3":4349,"mds_4":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4315":{"gid":4315,"name":"e","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4321":{"gid":4321,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4323":{"gid":4323,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4326":{"gid":4326,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4349":{"gid":4349,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4352":{"gid":4352,"name":"c","rank":2,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4355":{"gid":4355,"name":"i","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-06T13:28:12.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1ee408cbd0 msgr2=0x7f1ee408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1ee408cbd0 0x7f1ee408f090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1ef80604d0 tx=0x7f1ee800b040).stop 2023-11-06T13:28:12.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 msgr2=0x7f1ef8192d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:12.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 0x7f1ef8192d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f1ef80c47d0 tx=0x7f1ef0001df0).stop 2023-11-06T13:28:12.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 shutdown_connections 2023-11-06T13:28:12.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1ef8190820 0x7f1ef8192d20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ee0004690 0x7f1ef8190330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1ee408cbd0 0x7f1ee408f090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 --2- 172.21.15.38:0/1642466874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef81843c0 0x7f1ef8192830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:12.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 >> 172.21.15.38:0/1642466874 conn(0x7f1ef8069ea0 msgr2=0x7f1ef80cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:12.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 shutdown_connections 2023-11-06T13:28:12.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:12.970+0000 7f1efff0e700 1 -- 172.21.15.38:0/1642466874 wait complete. 2023-11-06T13:28:12.979 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2023-11-06T13:28:14.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 50, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-11-06T13:27:41.889379+0000', 'modified': '2023-11-06T13:27:58.254004+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4361, 'mds_1': 4355, 'mds_2': 4352, 'mds_3': 4349, 'mds_4': 4312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6837/1353911715', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6836', 'nonce': 1353911715}, {'type': 'v1', 'addr': '172.21.15.38:6837', 'nonce': 1353911715}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4312': {'gid': 4312, 'name': 'b', 'rank': 4, 'incarnation': 15, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.44:6833/2545049944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2545049944}, {'type': 'v1', 'addr': '172.21.15.44:6833', 'nonce': 2545049944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4315': {'gid': 4315, 'name': 'e', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/2658188248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2658188248}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2658188248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4321': {'gid': 4321, 'name': 'h', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6837/2388946102', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6836', 'nonce': 2388946102}, {'type': 'v1', 'addr': '172.21.15.44:6837', 'nonce': 2388946102}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4323': {'gid': 4323, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.38:6839/749779916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.38:6838', 'nonce': 749779916}, {'type': 'v1', 'addr': '172.21.15.38:6839', 'nonce': 749779916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4326': {'gid': 4326, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6839/2634383348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 2634383348}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 2634383348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4349': {'gid': 4349, 'name': 'f', 'rank': 3, 'incarnation': 13, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.163:6836/657311284', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6834', 'nonce': 657311284}, {'type': 'v1', 'addr': '172.21.15.163:6836', 'nonce': 657311284}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4352': {'gid': 4352, 'name': 'c', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.163:6837/2986446701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6835', 'nonce': 2986446701}, {'type': 'v1', 'addr': '172.21.15.163:6837', 'nonce': 2986446701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4355': {'gid': 4355, 'name': 'i', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.163:6839/3927893034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6838', 'nonce': 3927893034}, {'type': 'v1', 'addr': '172.21.15.163:6839', 'nonce': 3927893034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4361': {'gid': 4361, 'name': 'l', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.163:6841/2794564975', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6840', 'nonce': 2794564975}, {'type': 'v1', 'addr': '172.21.15.163:6841', 'nonce': 2794564975}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-11-06T13:28:14.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-11-06T13:28:14.198 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-06T13:28:14.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.328+0000 7efe5b4fc700 1 Processor -- start 2023-11-06T13:28:14.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.328+0000 7efe5b4fc700 1 -- start start 2023-11-06T13:28:14.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe5b4fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe54175510 0x7efe541758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe5b4fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efe540cada0 0x7efe540cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe5b4fc700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5417e680 con 0x7efe5417c950 2023-11-06T13:28:14.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe5b4fc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5417d4f0 con 0x7efe540cada0 2023-11-06T13:28:14.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe5b4fc700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5417d790 con 0x7efe54175510 2023-11-06T13:28:14.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe58a97700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efe540cada0 0x7efe540cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe59a99700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7efe5417c950 0x7efe5417cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43876/0 (socket says 172.21.15.38:43876) 2023-11-06T13:28:14.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe59a99700 1 -- 172.21.15.38:0/2963861730 learned_addr learned my addr 172.21.15.38:0/2963861730 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe59298700 1 --2- 172.21.15.38:0/2963861730 >> v2:172.21.15.44:3300/0 conn(0x7efe54175510 0x7efe541758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe53fff700 1 -- 172.21.15.38:0/2963861730 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561031138 0 0) 0x7efe5417e680 con 0x7efe5417c950 2023-11-06T13:28:14.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe53fff700 1 -- 172.21.15.38:0/2963861730 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe3c0033f0 con 0x7efe5417c950 2023-11-06T13:28:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe58a97700 1 -- 172.21.15.38:0/2963861730 >> v2:172.21.15.44:3300/0 conn(0x7efe54175510 msgr2=0x7efe541758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.329+0000 7efe58a97700 1 --2- 172.21.15.38:0/2963861730 >> v2:172.21.15.44:3300/0 conn(0x7efe54175510 0x7efe541758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe58a97700 1 -- 172.21.15.38:0/2963861730 >> v1:172.21.15.38:6789/0 conn(0x7efe5417c950 legacy=0x7efe5417cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe58a97700 1 -- 172.21.15.38:0/2963861730 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5417da70 con 0x7efe540cada0 2023-11-06T13:28:14.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe58a97700 1 --2- 172.21.15.38:0/2963861730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe540cada0 0x7efe540cb200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7efe48009760 tx=0x7efe48009060).ready entity=mon.0 client_cookie=c47cdc67b0e40674 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe53fff700 1 -- 172.21.15.38:0/2963861730 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800d4a0 con 0x7efe540cada0 2023-11-06T13:28:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe53fff700 1 -- 172.21.15.38:0/2963861730 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800d600 con 0x7efe540cada0 2023-11-06T13:28:14.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe53fff700 1 -- 172.21.15.38:0/2963861730 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800d980 con 0x7efe540cada0 2023-11-06T13:28:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 -- 172.21.15.38:0/2963861730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe540cada0 msgr2=0x7efe540cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/2963861730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe540cada0 0x7efe540cb200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7efe48009760 tx=0x7efe48009060).stop 2023-11-06T13:28:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 -- 172.21.15.38:0/2963861730 shutdown_connections 2023-11-06T13:28:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/2963861730 >> v2:172.21.15.44:3300/0 conn(0x7efe54175510 0x7efe541758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/2963861730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe540cada0 0x7efe540cb200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 -- 172.21.15.38:0/2963861730 >> 172.21.15.38:0/2963861730 conn(0x7efe540f28b0 msgr2=0x7efe54069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 -- 172.21.15.38:0/2963861730 shutdown_connections 2023-11-06T13:28:14.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.330+0000 7efe5b4fc700 1 -- 172.21.15.38:0/2963861730 wait complete. 2023-11-06T13:28:14.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.332+0000 7efe5b4fc700 1 Processor -- start 2023-11-06T13:28:14.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.332+0000 7efe5b4fc700 1 -- start start 2023-11-06T13:28:14.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe5b4fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe540cada0 0x7efe5417ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe5b4fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 0x7efe5416ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe5b4fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe5417c950 0x7efe541799b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe5b4fc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5417c2d0 con 0x7efe54175510 2023-11-06T13:28:14.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe5b4fc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5417b750 con 0x7efe540cada0 2023-11-06T13:28:14.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe5b4fc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5417ba30 con 0x7efe5417c950 2023-11-06T13:28:14.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 0x7efe5416ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 0x7efe5416ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48644/0 (socket says 172.21.15.38:48644) 2023-11-06T13:28:14.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 -- 172.21.15.38:0/223550360 learned_addr learned my addr 172.21.15.38:0/223550360 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe59298700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe540cada0 0x7efe5417ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe59a99700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe5417c950 0x7efe541799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 -- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe5417c950 msgr2=0x7efe541799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe5417c950 0x7efe541799b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 -- 172.21.15.38:0/223550360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe540cada0 msgr2=0x7efe5417ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe540cada0 0x7efe5417ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe58a97700 1 -- 172.21.15.38:0/223550360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe480092a0 con 0x7efe54175510 2023-11-06T13:28:14.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.333+0000 7efe59a99700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe5417c950 0x7efe541799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.334+0000 7efe58a97700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 0x7efe5416ee90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7efe54089720 tx=0x7efe48016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.334+0000 7efe517fa700 1 -- 172.21.15.38:0/223550360 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48000c90 con 0x7efe54175510 2023-11-06T13:28:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.334+0000 7efe517fa700 1 -- 172.21.15.38:0/223550360 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800d770 con 0x7efe54175510 2023-11-06T13:28:14.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.334+0000 7efe517fa700 1 -- 172.21.15.38:0/223550360 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4801d430 con 0x7efe54175510 2023-11-06T13:28:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.334+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5417bd10 con 0x7efe54175510 2023-11-06T13:28:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.334+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe54179490 con 0x7efe54175510 2023-11-06T13:28:14.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.336+0000 7efe517fa700 1 -- 172.21.15.38:0/223550360 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7efe4801d7e0 con 0x7efe54175510 2023-11-06T13:28:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.336+0000 7efe517fa700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe4008cbd0 0x7efe4008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.337+0000 7efe517fa700 1 -- 172.21.15.38:0/223550360 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efe480b37f0 con 0x7efe54175510 2023-11-06T13:28:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.337+0000 7efe59298700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe4008cbd0 0x7efe4008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.337+0000 7efe59298700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe4008cbd0 0x7efe4008f090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7efe4c009c30 tx=0x7efe4c009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.338+0000 7efe6ce94b80 1 Processor -- start 2023-11-06T13:28:14.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.338+0000 7efe6ce94b80 1 -- start start 2023-11-06T13:28:14.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e760bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e726f80 con 0x55762e51de40 2023-11-06T13:28:14.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e69e1f0 con 0x55762e7a48a0 2023-11-06T13:28:14.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e6b3440 con 0x55762e7610c0 2023-11-06T13:28:14.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe59298700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe59298700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48648/0 (socket says 172.21.15.38:48648) 2023-11-06T13:28:14.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe59298700 1 -- 172.21.15.38:0/1348508965 learned_addr learned my addr 172.21.15.38:0/1348508965 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe58a97700 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e760bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.339+0000 7efe59a99700 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe59298700 1 -- 172.21.15.38:0/1348508965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 msgr2=0x55762e7a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe59298700 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.387 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe59298700 1 -- 172.21.15.38:0/1348508965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 msgr2=0x55762e760bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe59298700 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e760bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe59298700 1 -- 172.21.15.38:0/1348508965 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762e6ac620 con 0x55762e51de40 2023-11-06T13:28:14.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe59298700 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7a43b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7efe4c011d70 tx=0x7efe4c017000).ready entity=mon.0 client_cookie=a1679eccae393f5d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe3a7fc700 1 -- 172.21.15.38:0/1348508965 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c011e70 con 0x55762e51de40 2023-11-06T13:28:14.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe3a7fc700 1 -- 172.21.15.38:0/1348508965 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c014bb0 con 0x55762e51de40 2023-11-06T13:28:14.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.340+0000 7efe3a7fc700 1 -- 172.21.15.38:0/1348508965 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c01e3f0 con 0x55762e51de40 2023-11-06T13:28:14.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 -- 172.21.15.38:0/1348508965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 msgr2=0x55762e7a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7a43b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7efe4c011d70 tx=0x7efe4c017000).stop 2023-11-06T13:28:14.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 -- 172.21.15.38:0/1348508965 shutdown_connections 2023-11-06T13:28:14.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7a43b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/1348508965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e760bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 -- 172.21.15.38:0/1348508965 >> 172.21.15.38:0/1348508965 conn(0x55762e5cb4a0 msgr2=0x55762e761d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 -- 172.21.15.38:0/1348508965 shutdown_connections 2023-11-06T13:28:14.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 -- 172.21.15.38:0/1348508965 wait complete. 2023-11-06T13:28:14.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.341+0000 7efe6ce94b80 1 -- start start 2023-11-06T13:28:14.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.342+0000 7efe6ce94b80 1 Processor -- start 2023-11-06T13:28:14.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e78ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7e0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e7903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e6b3580 con 0x55762e51de40 2023-11-06T13:28:14.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e6b3800 con 0x55762e7a48a0 2023-11-06T13:28:14.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e67ee10 con 0x55762e7610c0 2023-11-06T13:28:14.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe6ce94b80 10 client.0 ll_register_callbacks cb 0x55762e721380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e78ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e78ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48658/0 (socket says 172.21.15.38:48658) 2023-11-06T13:28:14.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 -- 172.21.15.38:0/3157885753 learned_addr learned my addr 172.21.15.38:0/3157885753 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe58a97700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59a99700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e7903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 -- 172.21.15.38:0/3157885753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 msgr2=0x55762e7e0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7e0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 -- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 msgr2=0x55762e7903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e7903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 -- 172.21.15.38:0/3157885753 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c011990 con 0x55762e51de40 2023-11-06T13:28:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59a99700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e7903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe59298700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e78ef60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7efe4c01e470 tx=0x7efe4c024000).ready entity=mon.0 client_cookie=c06bef57dab04ba8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.343+0000 7efe337fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe337fe700 1 -- 172.21.15.38:0/3157885753 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c01e970 con 0x55762e51de40 2023-11-06T13:28:14.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe337fe700 1 -- 172.21.15.38:0/3157885753 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efe4c01ead0 con 0x55762e51de40 2023-11-06T13:28:14.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55762e755640 con 0x55762e51de40 2023-11-06T13:28:14.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe337fe700 1 -- 172.21.15.38:0/3157885753 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe4c01eea0 con 0x55762e51de40 2023-11-06T13:28:14.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 10 client.4881 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55762e6a79c0 con 0x55762e51de40 2023-11-06T13:28:14.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe337fe700 1 -- 172.21.15.38:0/3157885753 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55762e755640 con 0x55762e51de40 2023-11-06T13:28:14.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe337fe700 1 -- 172.21.15.38:0/3157885753 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7efe4c027450 con 0x55762e51de40 2023-11-06T13:28:14.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 10 client.4881 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 10 client.4881 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-06T13:28:14.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 20 client.4881 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e7687e0 0x55762e78f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 4 client.4881 mds_command: new command op to 4312 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:14.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 --> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55762e519ca0 con 0x55762e7687e0 2023-11-06T13:28:14.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.344+0000 7efe58a97700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e7687e0 0x55762e78f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.345+0000 7efe337fe700 10 client.4881 ms_handle_connect on v2:172.21.15.44:6832/2545049944 2023-11-06T13:28:14.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.345+0000 7efe58a97700 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e7687e0 0x55762e78f690 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.4 client_cookie=bd5c6b09877f9cac server_cookie=15f886bc86cb4a2 in_seq=0 out_seq=0 2023-11-06T13:28:14.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.345+0000 7efe337fe700 1 -- 172.21.15.38:0/3157885753 <== mds.4 v2:172.21.15.44:6832/2545049944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55762e519ca0 con 0x55762e7687e0 2023-11-06T13:28:14.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.345+0000 7efe337fe700 10 client.4881 handle_command_reply: tid=0 2023-11-06T13:28:14.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.345+0000 7efe6ce94b80 1 client.4881 shutdown 2023-11-06T13:28:14.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 msgr2=0x55762e78ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e78ef60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7efe4c01e470 tx=0x7efe4c024000).stop 2023-11-06T13:28:14.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 shutdown_connections 2023-11-06T13:28:14.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e7687e0 0x55762e78f690 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e7903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e78ef60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe337fe700 0 client.4881 ms_handle_reset on v2:172.21.15.44:6832/2545049944 2023-11-06T13:28:14.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3157885753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e7e0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 >> 172.21.15.38:0/3157885753 conn(0x55762e5cb4a0 msgr2=0x55762e7d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 shutdown_connections 2023-11-06T13:28:14.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3157885753 wait complete. 2023-11-06T13:28:14.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.346+0000 7efe6ce94b80 20 client.4881 trim_cache size 0 max 16384 2023-11-06T13:28:14.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.363+0000 7efe6ce94b80 1 Processor -- start 2023-11-06T13:28:14.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.363+0000 7efe6ce94b80 1 -- start start 2023-11-06T13:28:14.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7e0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e78ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e75c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e7a36f0 con 0x55762e51de40 2023-11-06T13:28:14.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e82d130 con 0x55762e7a48a0 2023-11-06T13:28:14.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e761e90 con 0x55762e7610c0 2023-11-06T13:28:14.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7e0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48670/0 (socket says 172.21.15.38:48670) 2023-11-06T13:28:14.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 -- 172.21.15.38:0/2780168619 learned_addr learned my addr 172.21.15.38:0/2780168619 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe58a97700 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e78ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59a99700 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e75c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 -- 172.21.15.38:0/2780168619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 msgr2=0x55762e78ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e78ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 -- 172.21.15.38:0/2780168619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 msgr2=0x55762e75c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e75c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 -- 172.21.15.38:0/2780168619 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762e755260 con 0x55762e51de40 2023-11-06T13:28:14.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59a99700 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e75c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:14.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe59298700 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7e0170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7efe4c00b010 tx=0x7efe4c02c040).ready entity=mon.0 client_cookie=e274af8d2b93a02e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe3affd700 1 -- 172.21.15.38:0/2780168619 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c027520 con 0x55762e51de40 2023-11-06T13:28:14.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe3affd700 1 -- 172.21.15.38:0/2780168619 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c027910 con 0x55762e51de40 2023-11-06T13:28:14.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.364+0000 7efe3affd700 1 -- 172.21.15.38:0/2780168619 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c027a80 con 0x55762e51de40 2023-11-06T13:28:14.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 -- 172.21.15.38:0/2780168619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 msgr2=0x55762e7e0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7e0170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7efe4c00b010 tx=0x7efe4c02c040).stop 2023-11-06T13:28:14.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 -- 172.21.15.38:0/2780168619 shutdown_connections 2023-11-06T13:28:14.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e7a48a0 0x55762e75c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e51de40 0x55762e7e0170 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/2780168619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7610c0 0x55762e78ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 -- 172.21.15.38:0/2780168619 >> 172.21.15.38:0/2780168619 conn(0x55762e5cb4a0 msgr2=0x55762e7d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 -- 172.21.15.38:0/2780168619 shutdown_connections 2023-11-06T13:28:14.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.365+0000 7efe6ce94b80 1 -- 172.21.15.38:0/2780168619 wait complete. 2023-11-06T13:28:14.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.366+0000 7efe6ce94b80 1 -- start start 2023-11-06T13:28:14.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.366+0000 7efe6ce94b80 1 Processor -- start 2023-11-06T13:28:14.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e51de40 0x55762e839a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 0x55762e7902f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7a48a0 0x55762e7680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e795050 con 0x55762e7610c0 2023-11-06T13:28:14.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e8395a0 con 0x55762e51de40 2023-11-06T13:28:14.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762e7948c0 con 0x55762e7a48a0 2023-11-06T13:28:14.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe6ce94b80 10 client.0 ll_register_callbacks cb 0x55762e721380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 0x55762e7902f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 0x55762e7902f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48682/0 (socket says 172.21.15.38:48682) 2023-11-06T13:28:14.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 -- 172.21.15.38:0/3874827222 learned_addr learned my addr 172.21.15.38:0/3874827222 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe59298700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e51de40 0x55762e839a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe59a99700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7a48a0 0x55762e7680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 -- 172.21.15.38:0/3874827222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7a48a0 msgr2=0x55762e7680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7a48a0 0x55762e7680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 -- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e51de40 msgr2=0x55762e839a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e51de40 0x55762e839a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.367+0000 7efe58a97700 1 -- 172.21.15.38:0/3874827222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55762e6a79c0 con 0x55762e7610c0 2023-11-06T13:28:14.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe58a97700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 0x55762e7902f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efe48089010 tx=0x7efe4801f040).ready entity=mon.0 client_cookie=c9247cef507dc8e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe337fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe337fe700 1 -- 172.21.15.38:0/3874827222 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48085d90 con 0x55762e7610c0 2023-11-06T13:28:14.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe4c014bb0 con 0x55762e7610c0 2023-11-06T13:28:14.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe337fe700 1 -- 172.21.15.38:0/3874827222 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efe480b0a30 con 0x55762e7610c0 2023-11-06T13:28:14.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe337fe700 1 -- 172.21.15.38:0/3874827222 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe480b0bf0 con 0x55762e7610c0 2023-11-06T13:28:14.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 10 client.4887 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55762e6a7710 con 0x55762e7610c0 2023-11-06T13:28:14.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe337fe700 1 -- 172.21.15.38:0/3874827222 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c014bb0 con 0x55762e7610c0 2023-11-06T13:28:14.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe337fe700 1 -- 172.21.15.38:0/3874827222 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7efe48084100 con 0x55762e7610c0 2023-11-06T13:28:14.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 10 client.4887 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 10 client.4887 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-06T13:28:14.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 20 client.4887 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e78f530 0x55762e7df3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 4 client.4887 mds_command: new command op to 4312 tid=0[{"prefix": "status"}] 2023-11-06T13:28:14.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 --> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55762e550ca0 con 0x55762e78f530 2023-11-06T13:28:14.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.368+0000 7efe59298700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e78f530 0x55762e7df3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe59298700 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e78f530 0x55762e7df3a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.4 client_cookie=ddb0925e6ff41eb4 server_cookie=8a6fc3d73587fab1 in_seq=0 out_seq=0 2023-11-06T13:28:14.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe337fe700 10 client.4887 ms_handle_connect on v2:172.21.15.44:6832/2545049944 2023-11-06T13:28:14.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe337fe700 1 -- 172.21.15.38:0/3874827222 <== mds.4 v2:172.21.15.44:6832/2545049944 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55762e550ca0 con 0x55762e78f530 2023-11-06T13:28:14.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe337fe700 10 client.4887 handle_command_reply: tid=0 2023-11-06T13:28:14.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 client.4887 shutdown 2023-11-06T13:28:14.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 msgr2=0x55762e7902f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 0x55762e7902f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efe48089010 tx=0x7efe4801f040).stop 2023-11-06T13:28:14.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 shutdown_connections 2023-11-06T13:28:14.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:6832/2545049944,v1:172.21.15.44:6833/2545049944] conn(0x55762e78f530 0x55762e7df3a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55762e7a48a0 0x55762e7680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55762e51de40 0x55762e839a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe337fe700 0 client.4887 ms_handle_reset on v2:172.21.15.44:6832/2545049944 2023-11-06T13:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 --2- 172.21.15.38:0/3874827222 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55762e7610c0 0x55762e7902f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 >> 172.21.15.38:0/3874827222 conn(0x55762e5cb4a0 msgr2=0x55762e79e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 shutdown_connections 2023-11-06T13:28:14.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 1 -- 172.21.15.38:0/3874827222 wait complete. 2023-11-06T13:28:14.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.369+0000 7efe6ce94b80 20 client.4887 trim_cache size 0 max 16384 2023-11-06T13:28:14.424 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:14.425 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "678c2a34-c65e-414a-9c54-b10698be691f", 2023-11-06T13:28:14.425 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 4, 2023-11-06T13:28:14.425 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4312, 2023-11-06T13:28:14.425 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-11-06T13:28:14.425 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-11-06T13:28:14.426 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-11-06T13:28:14.426 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 17.121439469999999, 2023-11-06T13:28:14.426 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 17, 2023-11-06T13:28:14.426 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-11-06T13:28:14.427 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 31, 2023-11-06T13:28:14.427 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 36.902294142000002 2023-11-06T13:28:14.427 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:14.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe4008cbd0 msgr2=0x7efe4008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe4008cbd0 0x7efe4008f090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7efe4c009c30 tx=0x7efe4c009060).stop 2023-11-06T13:28:14.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 msgr2=0x7efe5416ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 0x7efe5416ee90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7efe54089720 tx=0x7efe48016000).stop 2023-11-06T13:28:14.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 shutdown_connections 2023-11-06T13:28:14.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe5417c950 0x7efe541799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efe4008cbd0 0x7efe4008f090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe540cada0 0x7efe5417ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 --2- 172.21.15.38:0/223550360 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efe54175510 0x7efe5416ee90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 >> 172.21.15.38:0/223550360 conn(0x7efe540f28b0 msgr2=0x7efe540f4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 shutdown_connections 2023-11-06T13:28:14.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.370+0000 7efe5b4fc700 1 -- 172.21.15.38:0/223550360 wait complete. 2023-11-06T13:28:14.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-11-06T13:28:14.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.548+0000 7f7ee4397700 1 Processor -- start 2023-11-06T13:28:14.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.548+0000 7f7ee4397700 1 -- start start 2023-11-06T13:28:14.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.549+0000 7f7ee4397700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7edc0cac60 0x7f7edc182a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.549+0000 7f7ee4397700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7edc0cb750 0x7f7edc069250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.549+0000 7f7ee4397700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc068dc0 con 0x7f7edc182f00 2023-11-06T13:28:14.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.549+0000 7f7ee4397700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc181460 con 0x7f7edc0cb750 2023-11-06T13:28:14.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.549+0000 7f7ee4397700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc181720 con 0x7f7edc0cac60 2023-11-06T13:28:14.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7edc0cb750 0x7f7edc069250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f7edc0cb750 0x7f7edc069250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48696/0 (socket says 172.21.15.38:48696) 2023-11-06T13:28:14.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 -- 172.21.15.38:0/3114799387 learned_addr learned my addr 172.21.15.38:0/3114799387 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3114799387 >> v2:172.21.15.163:3300/0 conn(0x7f7edc0cac60 0x7f7edc182a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 -- 172.21.15.38:0/3114799387 >> v2:172.21.15.163:3300/0 conn(0x7f7edc0cac60 msgr2=0x7f7edc182a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 --2- 172.21.15.38:0/3114799387 >> v2:172.21.15.163:3300/0 conn(0x7f7edc0cac60 0x7f7edc182a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 -- 172.21.15.38:0/3114799387 >> v1:172.21.15.44:6789/0 conn(0x7f7edc182f00 legacy=0x7f7edc0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 -- 172.21.15.38:0/3114799387 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc181a00 con 0x7f7edc0cb750 2023-11-06T13:28:14.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3114799387 >> v2:172.21.15.163:3300/0 conn(0x7f7edc0cac60 0x7f7edc182a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee2934700 1 --2- 172.21.15.38:0/3114799387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cb750 0x7f7edc069250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7edc0f0590 tx=0x7f7ed40090f0).ready entity=mon.0 client_cookie=68cf0056b9041041 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee1131700 1 -- 172.21.15.38:0/3114799387 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400b5a0 con 0x7f7edc0cb750 2023-11-06T13:28:14.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee1131700 1 -- 172.21.15.38:0/3114799387 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed400b700 con 0x7f7edc0cb750 2023-11-06T13:28:14.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.550+0000 7f7ee1131700 1 -- 172.21.15.38:0/3114799387 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400ba80 con 0x7f7edc0cb750 2023-11-06T13:28:14.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 -- 172.21.15.38:0/3114799387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cb750 msgr2=0x7f7edc069250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3114799387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cb750 0x7f7edc069250 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f7edc0f0590 tx=0x7f7ed40090f0).stop 2023-11-06T13:28:14.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 -- 172.21.15.38:0/3114799387 shutdown_connections 2023-11-06T13:28:14.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3114799387 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cb750 0x7f7edc069250 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3114799387 >> v2:172.21.15.163:3300/0 conn(0x7f7edc0cac60 0x7f7edc182a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 -- 172.21.15.38:0/3114799387 >> 172.21.15.38:0/3114799387 conn(0x7f7edc0f3cf0 msgr2=0x7f7edc0efc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 -- 172.21.15.38:0/3114799387 shutdown_connections 2023-11-06T13:28:14.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.551+0000 7f7ee4397700 1 -- 172.21.15.38:0/3114799387 wait complete. 2023-11-06T13:28:14.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.552+0000 7f7ee4397700 1 Processor -- start 2023-11-06T13:28:14.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.552+0000 7f7ee4397700 1 -- start start 2023-11-06T13:28:14.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee4397700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 0x7f7edc17f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee4397700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7edc0cb750 0x7f7edc17f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee4397700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7edc182f00 0x7f7edc0c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee4397700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc17db50 con 0x7f7edc0cac60 2023-11-06T13:28:14.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee4397700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc17cc60 con 0x7f7edc0cb750 2023-11-06T13:28:14.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee4397700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc17cf40 con 0x7f7edc182f00 2023-11-06T13:28:14.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee2133700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 0x7f7edc17f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee2133700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 0x7f7edc17f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48702/0 (socket says 172.21.15.38:48702) 2023-11-06T13:28:14.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.553+0000 7f7ee2133700 1 -- 172.21.15.38:0/3980135588 learned_addr learned my addr 172.21.15.38:0/3980135588 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2934700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7edc182f00 0x7f7edc0c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7edc0cb750 0x7f7edc17f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2133700 1 -- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7edc182f00 msgr2=0x7f7edc0c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7edc182f00 0x7f7edc0c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2133700 1 -- 172.21.15.38:0/3980135588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7edc0cb750 msgr2=0x7f7edc17f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7edc0cb750 0x7f7edc17f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2133700 1 -- 172.21.15.38:0/3980135588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4009370 con 0x7f7edc0cac60 2023-11-06T13:28:14.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7edc0cb750 0x7f7edc17f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:14.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 0x7f7edc17f320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7ecc00d180 tx=0x7f7ecc0099f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7eda7fc700 1 -- 172.21.15.38:0/3980135588 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc00de20 con 0x7f7edc0cac60 2023-11-06T13:28:14.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7eda7fc700 1 -- 172.21.15.38:0/3980135588 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc00f040 con 0x7f7edc0cac60 2023-11-06T13:28:14.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc17d220 con 0x7f7edc0cac60 2023-11-06T13:28:14.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7eda7fc700 1 -- 172.21.15.38:0/3980135588 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc013600 con 0x7f7edc0cac60 2023-11-06T13:28:14.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.554+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc17d7e0 con 0x7f7edc0cac60 2023-11-06T13:28:14.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.556+0000 7f7eda7fc700 1 -- 172.21.15.38:0/3980135588 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f7ecc0139b0 con 0x7f7edc0cac60 2023-11-06T13:28:14.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.556+0000 7f7eda7fc700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7ec808cbd0 0x7f7ec808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.557+0000 7f7eda7fc700 1 -- 172.21.15.38:0/3980135588 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7ecc0b27e0 con 0x7f7edc0cac60 2023-11-06T13:28:14.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.557+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7ec808cbd0 0x7f7ec808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.557+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7ec808cbd0 0x7f7ec808f090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7edc17c510 tx=0x7f7ed0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.558+0000 7f7ef5d2fb80 1 Processor -- start 2023-11-06T13:28:14.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.558+0000 7f7ef5d2fb80 1 -- start start 2023-11-06T13:28:14.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05666e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05662abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e05666bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0565f0f80 con 0x55e05666e8a0 2023-11-06T13:28:14.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0565681f0 con 0x55e0563e7e40 2023-11-06T13:28:14.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05657d440 con 0x55e05662b0c0 2023-11-06T13:28:14.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ee1932700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05662abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ee1932700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05662abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48708/0 (socket says 172.21.15.38:48708) 2023-11-06T13:28:14.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ee1932700 1 -- 172.21.15.38:0/3128072481 learned_addr learned my addr 172.21.15.38:0/3128072481 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.559+0000 7f7ee2934700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e05666bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05666e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee1932700 1 -- 172.21.15.38:0/3128072481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 msgr2=0x55e05666bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e05666bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee1932700 1 -- 172.21.15.38:0/3128072481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 msgr2=0x55e05666e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05666e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee1932700 1 -- 172.21.15.38:0/3128072481 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e056576620 con 0x55e05666e8a0 2023-11-06T13:28:14.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee2934700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e05666bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:14.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee2133700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05666e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ee1932700 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05662abd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7ed0012950 tx=0x7f7ed0012000).ready entity=mon.0 client_cookie=c6f425f6f203baf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ec37fe700 1 -- 172.21.15.38:0/3128072481 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011800 con 0x55e05666e8a0 2023-11-06T13:28:14.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ec37fe700 1 -- 172.21.15.38:0/3128072481 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0011960 con 0x55e05666e8a0 2023-11-06T13:28:14.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.560+0000 7f7ec37fe700 1 -- 172.21.15.38:0/3128072481 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011ce0 con 0x55e05666e8a0 2023-11-06T13:28:14.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/3128072481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 msgr2=0x55e05662abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05662abd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7ed0012950 tx=0x7f7ed0012000).stop 2023-11-06T13:28:14.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/3128072481 shutdown_connections 2023-11-06T13:28:14.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e05666bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05666e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/3128072481 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05662abd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/3128072481 >> 172.21.15.38:0/3128072481 conn(0x55e0564954a0 msgr2=0x55e05662bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/3128072481 shutdown_connections 2023-11-06T13:28:14.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/3128072481 wait complete. 2023-11-06T13:28:14.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.561+0000 7f7ef5d2fb80 1 -- start start 2023-11-06T13:28:14.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.562+0000 7f7ef5d2fb80 1 Processor -- start 2023-11-06T13:28:14.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e0566ab150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e0566acb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05666e8a0 0x55e056673190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05657d580 con 0x55e05662b0c0 2023-11-06T13:28:14.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05657d800 con 0x55e0563e7e40 2023-11-06T13:28:14.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e056548e10 con 0x55e05666e8a0 2023-11-06T13:28:14.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 10 client.0 ll_register_callbacks cb 0x55e0565eb380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e0566acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e0566acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48718/0 (socket says 172.21.15.38:48718) 2023-11-06T13:28:14.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 -- 172.21.15.38:0/4146354490 learned_addr learned my addr 172.21.15.38:0/4146354490 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee2133700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e0566ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 -- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05666e8a0 msgr2=0x55e056673190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee2934700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05666e8a0 0x55e056673190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05666e8a0 0x55e056673190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 -- 172.21.15.38:0/4146354490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 msgr2=0x55e0566ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e0566ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 -- 172.21.15.38:0/4146354490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc181a00 con 0x55e05662b0c0 2023-11-06T13:28:14.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee2934700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05666e8a0 0x55e056673190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:14.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ee1932700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e0566acb30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7ed00024a0 tx=0x7f7ed0015000).ready entity=mon.0 client_cookie=9b6d4798d93c6833 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ec0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/4146354490 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0011800 con 0x55e05662b0c0 2023-11-06T13:28:14.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/4146354490 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7ed00066a0 con 0x55e05662b0c0 2023-11-06T13:28:14.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.563+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e05661f640 con 0x55e05662b0c0 2023-11-06T13:28:14.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/4146354490 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ed00024f0 con 0x55e05662b0c0 2023-11-06T13:28:14.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 10 client.4899 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f7ed00125a0 con 0x55e05662b0c0 2023-11-06T13:28:14.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/4146354490 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0032020 con 0x55e05662b0c0 2023-11-06T13:28:14.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/4146354490 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f7ed0006ab0 con 0x55e05662b0c0 2023-11-06T13:28:14.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 10 client.4899 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 10 client.4899 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-06T13:28:14.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 20 client.4899 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e0566ad590 0x55e0566aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 4 client.4899 mds_command: new command op to 4349 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:14.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 --> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0563e3ca0 con 0x55e0566ad590 2023-11-06T13:28:14.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.564+0000 7f7ee2133700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e0566ad590 0x55e0566aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.565+0000 7f7ec0ff9700 10 client.4899 ms_handle_connect on v2:172.21.15.163:6834/657311284 2023-11-06T13:28:14.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.565+0000 7f7ee2133700 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e0566ad590 0x55e0566aa890 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.3 client_cookie=b58025098a01589c server_cookie=90fb81d01c235662 in_seq=0 out_seq=0 2023-11-06T13:28:14.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.565+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/4146354490 <== mds.3 v2:172.21.15.163:6834/657311284 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55e0563e3ca0 con 0x55e0566ad590 2023-11-06T13:28:14.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.565+0000 7f7ec0ff9700 10 client.4899 handle_command_reply: tid=0 2023-11-06T13:28:14.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.565+0000 7f7ef5d2fb80 1 client.4899 shutdown 2023-11-06T13:28:14.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 msgr2=0x55e0566acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e0566acb30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7ed00024a0 tx=0x7f7ed0015000).stop 2023-11-06T13:28:14.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 shutdown_connections 2023-11-06T13:28:14.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05666e8a0 0x55e056673190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e0566ad590 0x55e0566aa890 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e0566ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/4146354490 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e0566acb30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ec0ff9700 0 client.4899 ms_handle_reset on v2:172.21.15.163:6834/657311284 2023-11-06T13:28:14.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 >> 172.21.15.38:0/4146354490 conn(0x55e0564954a0 msgr2=0x55e05666ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 shutdown_connections 2023-11-06T13:28:14.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/4146354490 wait complete. 2023-11-06T13:28:14.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.566+0000 7f7ef5d2fb80 20 client.4899 trim_cache size 0 max 16384 2023-11-06T13:28:14.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.582+0000 7f7ef5d2fb80 1 Processor -- start 2023-11-06T13:28:14.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 -- start start 2023-11-06T13:28:14.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e0563e7e40 0x55e05666e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e05669a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e05666e8a0 0x55e0566f6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05666e6c0 con 0x55e05662b0c0 2023-11-06T13:28:14.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05669acf0 con 0x55e05666e8a0 2023-11-06T13:28:14.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.583+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e056670270 con 0x55e0563e7e40 2023-11-06T13:28:14.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e05669a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e05669a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48732/0 (socket says 172.21.15.38:48732) 2023-11-06T13:28:14.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 -- 172.21.15.38:0/2943216793 learned_addr learned my addr 172.21.15.38:0/2943216793 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee2133700 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e0563e7e40 0x55e05666e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 -- 172.21.15.38:0/2943216793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e0563e7e40 msgr2=0x55e05666e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e0563e7e40 0x55e05666e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 -- 172.21.15.38:0/2943216793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e05666e8a0 msgr2=0x55e0566f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e05666e8a0 0x55e0566f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:28:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 -- 172.21.15.38:0/2943216793 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e05661f260 con 0x55e05662b0c0 2023-11-06T13:28:14.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ee1932700 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e05669a800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7ed0012950 tx=0x7f7ed0026000).ready entity=mon.0 client_cookie=aa0e71b18c5d6d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ec3fff700 1 -- 172.21.15.38:0/2943216793 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00066a0 con 0x55e05662b0c0 2023-11-06T13:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ec3fff700 1 -- 172.21.15.38:0/2943216793 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0032040 con 0x55e05662b0c0 2023-11-06T13:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.584+0000 7f7ec3fff700 1 -- 172.21.15.38:0/2943216793 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0006ab0 con 0x55e05662b0c0 2023-11-06T13:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/2943216793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 msgr2=0x55e05669a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e05669a800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7ed0012950 tx=0x7f7ed0026000).stop 2023-11-06T13:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/2943216793 shutdown_connections 2023-11-06T13:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e05666e8a0 0x55e0566f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e0563e7e40 0x55e05666e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/2943216793 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05662b0c0 0x55e05669a800 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/2943216793 >> 172.21.15.38:0/2943216793 conn(0x55e0564954a0 msgr2=0x55e05662bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/2943216793 shutdown_connections 2023-11-06T13:28:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/2943216793 wait complete. 2023-11-06T13:28:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 -- start start 2023-11-06T13:28:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.585+0000 7f7ef5d2fb80 1 Processor -- start 2023-11-06T13:28:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05665b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e0566550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05669b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05669b7a0 con 0x55e05666e8a0 2023-11-06T13:28:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05665bce0 con 0x55e0563e7e40 2023-11-06T13:28:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e056662e90 con 0x55e05662b0c0 2023-11-06T13:28:14.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 10 client.0 ll_register_callbacks cb 0x55e0565eb380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05669b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05669b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48738/0 (socket says 172.21.15.38:48738) 2023-11-06T13:28:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 -- 172.21.15.38:0/1831672281 learned_addr learned my addr 172.21.15.38:0/1831672281 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee1932700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e0566550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2133700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05665b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 -- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 msgr2=0x55e0566550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e0566550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 -- 172.21.15.38:0/1831672281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 msgr2=0x55e05665b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05665b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 -- 172.21.15.38:0/1831672281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed00125a0 con 0x55e05666e8a0 2023-11-06T13:28:14.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2133700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05665b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ee2934700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05669b2b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7edc086fe0 tx=0x7f7ed4015000).ready entity=mon.0 client_cookie=db6060143b09b4f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ec0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/1831672281 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4023070 con 0x55e05666e8a0 2023-11-06T13:28:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/1831672281 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f7ed401e950 con 0x55e05666e8a0 2023-11-06T13:28:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ed0011960 con 0x55e05666e8a0 2023-11-06T13:28:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.587+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/1831672281 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ed401ed70 con 0x55e05666e8a0 2023-11-06T13:28:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 10 client.4905 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e0565719c0 con 0x55e05666e8a0 2023-11-06T13:28:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/1831672281 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4032020 con 0x55e05666e8a0 2023-11-06T13:28:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/1831672281 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f7ed4018030 con 0x55e05666e8a0 2023-11-06T13:28:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 10 client.4905 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 10 client.4905 resolve_mds: resolved name 'f' to daemon mds.f 2023-11-06T13:28:14.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 20 client.4905 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e056666d40 0x55e056667120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 4 client.4905 mds_command: new command op to 4349 tid=0[{"prefix": "status"}] 2023-11-06T13:28:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 --> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e05641aca0 con 0x55e056666d40 2023-11-06T13:28:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ee2133700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e056666d40 0x55e056667120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ec0ff9700 10 client.4905 ms_handle_connect on v2:172.21.15.163:6834/657311284 2023-11-06T13:28:14.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.588+0000 7f7ee2133700 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e056666d40 0x55e056667120 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.3 client_cookie=484f888719dbdccb server_cookie=2c285300e62231e2 in_seq=0 out_seq=0 2023-11-06T13:28:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ec0ff9700 1 -- 172.21.15.38:0/1831672281 <== mds.3 v2:172.21.15.163:6834/657311284 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e05641aca0 con 0x55e056666d40 2023-11-06T13:28:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ec0ff9700 10 client.4905 handle_command_reply: tid=0 2023-11-06T13:28:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 client.4905 shutdown 2023-11-06T13:28:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 msgr2=0x55e05669b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05669b2b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7edc086fe0 tx=0x7f7ed4015000).stop 2023-11-06T13:28:14.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 shutdown_connections 2023-11-06T13:28:14.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e05666e8a0 0x55e05669b2b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:6834/657311284,v1:172.21.15.163:6836/657311284] conn(0x55e056666d40 0x55e056667120 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0563e7e40 0x55e05665b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 --2- 172.21.15.38:0/1831672281 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e05662b0c0 0x55e0566550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ec0ff9700 0 client.4905 ms_handle_reset on v2:172.21.15.163:6834/657311284 2023-11-06T13:28:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 >> 172.21.15.38:0/1831672281 conn(0x55e0564954a0 msgr2=0x55e05669a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 shutdown_connections 2023-11-06T13:28:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 1 -- 172.21.15.38:0/1831672281 wait complete. 2023-11-06T13:28:14.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ef5d2fb80 20 client.4905 trim_cache size 0 max 16384 2023-11-06T13:28:14.615 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:14.615 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "678c2a34-c65e-414a-9c54-b10698be691f", 2023-11-06T13:28:14.615 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 3, 2023-11-06T13:28:14.616 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4349, 2023-11-06T13:28:14.616 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-11-06T13:28:14.616 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-11-06T13:28:14.616 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-11-06T13:28:14.616 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 18.236637956999999, 2023-11-06T13:28:14.616 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 17, 2023-11-06T13:28:14.617 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-11-06T13:28:14.617 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 31, 2023-11-06T13:28:14.617 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 37.110130951999999 2023-11-06T13:28:14.617 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7ec808cbd0 msgr2=0x7f7ec808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7ec808cbd0 0x7f7ec808f090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f7edc17c510 tx=0x7f7ed0009040).stop 2023-11-06T13:28:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 msgr2=0x7f7edc17f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 0x7f7edc17f320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7ecc00d180 tx=0x7f7ecc0099f0).stop 2023-11-06T13:28:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.589+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 shutdown_connections 2023-11-06T13:28:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7edc182f00 0x7f7edc0c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7edc0cac60 0x7f7edc17f320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f7ec808cbd0 0x7f7ec808f090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 --2- 172.21.15.38:0/3980135588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7edc0cb750 0x7f7edc17f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 >> 172.21.15.38:0/3980135588 conn(0x7f7edc0f3cf0 msgr2=0x7f7edc083bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 shutdown_connections 2023-11-06T13:28:14.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.590+0000 7f7ee4397700 1 -- 172.21.15.38:0/3980135588 wait complete. 2023-11-06T13:28:14.621 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-06T13:28:14.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.737+0000 7f37dfca1700 1 Processor -- start 2023-11-06T13:28:14.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.738+0000 7f37dfca1700 1 -- start start 2023-11-06T13:28:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dfca1700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f37d81756e0 0x7f37d80640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dfca1700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37d80645d0 0x7f37d817de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dfca1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d817d9d0 con 0x7f37d817e350 2023-11-06T13:28:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dfca1700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d80c8560 con 0x7f37d81756e0 2023-11-06T13:28:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dfca1700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d8064a50 con 0x7f37d80645d0 2023-11-06T13:28:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dda3d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f37d81756e0 0x7f37d80640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37de23e700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f37d817e350 0x7f37d80f1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43892/0 (socket says 172.21.15.38:43892) 2023-11-06T13:28:14.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37de23e700 1 -- 172.21.15.38:0/2554440458 learned_addr learned my addr 172.21.15.38:0/2554440458 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dd23c700 1 --2- 172.21.15.38:0/2554440458 >> v2:172.21.15.44:3300/0 conn(0x7f37d80645d0 0x7f37d817de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dda3d700 1 -- 172.21.15.38:0/2554440458 >> v2:172.21.15.44:3300/0 conn(0x7f37d80645d0 msgr2=0x7f37d817de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dda3d700 1 --2- 172.21.15.38:0/2554440458 >> v2:172.21.15.44:3300/0 conn(0x7f37d80645d0 0x7f37d817de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dda3d700 1 -- 172.21.15.38:0/2554440458 >> v1:172.21.15.38:6789/0 conn(0x7f37d817e350 legacy=0x7f37d80f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dda3d700 1 -- 172.21.15.38:0/2554440458 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d817c800 con 0x7f37d81756e0 2023-11-06T13:28:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dca3b700 1 -- 172.21.15.38:0/2554440458 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072445759 0 0) 0x7f37d817d9d0 con 0x7f37d817e350 2023-11-06T13:28:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dd23c700 1 --2- 172.21.15.38:0/2554440458 >> v2:172.21.15.44:3300/0 conn(0x7f37d80645d0 0x7f37d817de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dda3d700 1 --2- 172.21.15.38:0/2554440458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d81756e0 0x7f37d80640e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f37d80cab80 tx=0x7f37d0009060).ready entity=mon.0 client_cookie=bbb7e5825d9cecf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dca3b700 1 -- 172.21.15.38:0/2554440458 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000b580 con 0x7f37d81756e0 2023-11-06T13:28:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dca3b700 1 -- 172.21.15.38:0/2554440458 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000b6e0 con 0x7f37d81756e0 2023-11-06T13:28:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.739+0000 7f37dca3b700 1 -- 172.21.15.38:0/2554440458 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000ba60 con 0x7f37d81756e0 2023-11-06T13:28:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 -- 172.21.15.38:0/2554440458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d81756e0 msgr2=0x7f37d80640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2554440458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d81756e0 0x7f37d80640e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f37d80cab80 tx=0x7f37d0009060).stop 2023-11-06T13:28:14.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 -- 172.21.15.38:0/2554440458 shutdown_connections 2023-11-06T13:28:14.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2554440458 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d81756e0 0x7f37d80640e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2554440458 >> v2:172.21.15.44:3300/0 conn(0x7f37d80645d0 0x7f37d817de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 -- 172.21.15.38:0/2554440458 >> 172.21.15.38:0/2554440458 conn(0x7f37d8069ea0 msgr2=0x7f37d806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 -- 172.21.15.38:0/2554440458 shutdown_connections 2023-11-06T13:28:14.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.740+0000 7f37dfca1700 1 -- 172.21.15.38:0/2554440458 wait complete. 2023-11-06T13:28:14.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.741+0000 7f37dfca1700 1 Processor -- start 2023-11-06T13:28:14.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.741+0000 7f37dfca1700 1 -- start start 2023-11-06T13:28:14.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.742+0000 7f37dfca1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37d80645d0 0x7f37d816f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.742+0000 7f37dfca1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d81756e0 0x7f37d80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.742+0000 7f37dfca1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 0x7f37d80cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.742+0000 7f37dfca1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80c6370 con 0x7f37d817e350 2023-11-06T13:28:14.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.742+0000 7f37dfca1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80c5480 con 0x7f37d81756e0 2023-11-06T13:28:14.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.742+0000 7f37dfca1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80c5760 con 0x7f37d80645d0 2023-11-06T13:28:14.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 0x7f37d80cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 0x7f37d80cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48756/0 (socket says 172.21.15.38:48756) 2023-11-06T13:28:14.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 -- 172.21.15.38:0/2042316473 learned_addr learned my addr 172.21.15.38:0/2042316473 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37dda3d700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37d80645d0 0x7f37d816f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37dd23c700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d81756e0 0x7f37d80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 -- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37d80645d0 msgr2=0x7f37d816f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37d80645d0 0x7f37d816f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 -- 172.21.15.38:0/2042316473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d81756e0 msgr2=0x7f37d80c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d81756e0 0x7f37d80c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 -- 172.21.15.38:0/2042316473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00092a0 con 0x7f37d817e350 2023-11-06T13:28:14.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37dd23c700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d81756e0 0x7f37d80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:14.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37de23e700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 0x7f37d80cb130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f37c800c810 tx=0x7f37c80014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37d5ffb700 1 -- 172.21.15.38:0/2042316473 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8005d30 con 0x7f37d817e350 2023-11-06T13:28:14.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37d5ffb700 1 -- 172.21.15.38:0/2042316473 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c8005e90 con 0x7f37d817e350 2023-11-06T13:28:14.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37d5ffb700 1 -- 172.21.15.38:0/2042316473 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8007320 con 0x7f37d817e350 2023-11-06T13:28:14.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d80c5a40 con 0x7f37d817e350 2023-11-06T13:28:14.764 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.743+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d80c6000 con 0x7f37d817e350 2023-11-06T13:28:14.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.745+0000 7f37d5ffb700 1 -- 172.21.15.38:0/2042316473 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f37c8007710 con 0x7f37d817e350 2023-11-06T13:28:14.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.746+0000 7f37d5ffb700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f37c408cbd0 0x7f37c408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.746+0000 7f37d5ffb700 1 -- 172.21.15.38:0/2042316473 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f37c80b1fb0 con 0x7f37d817e350 2023-11-06T13:28:14.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.746+0000 7f37dda3d700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f37c408cbd0 0x7f37c408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.765 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.746+0000 7f37dda3d700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f37c408cbd0 0x7f37c408f090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f37d80c7660 tx=0x7f37d0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.748+0000 7f37f1639b80 1 Processor -- start 2023-11-06T13:28:14.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.748+0000 7f37f1639b80 1 -- start start 2023-11-06T13:28:14.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.766 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f465bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f4a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37f1639b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f42bf80 con 0x558e5f222e40 2023-11-06T13:28:14.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37f1639b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f3a31f0 con 0x558e5f4660c0 2023-11-06T13:28:14.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37f1639b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f3b8440 con 0x558e5f4a98a0 2023-11-06T13:28:14.767 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48770/0 (socket says 172.21.15.38:48770) 2023-11-06T13:28:14.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 -- 172.21.15.38:0/3779491617 learned_addr learned my addr 172.21.15.38:0/3779491617 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dd23c700 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f465bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37de23e700 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f4a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 -- 172.21.15.38:0/3779491617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 msgr2=0x558e5f465bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f465bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 -- 172.21.15.38:0/3779491617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 msgr2=0x558e5f4a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f4a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 -- 172.21.15.38:0/3779491617 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5f3b1620 con 0x558e5f222e40 2023-11-06T13:28:14.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a93b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f37d0000e50 tx=0x7f37d001d000).ready entity=mon.0 client_cookie=6584ad1bbcf0ccd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37beffd700 1 -- 172.21.15.38:0/3779491617 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d001c880 con 0x558e5f222e40 2023-11-06T13:28:14.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37beffd700 1 -- 172.21.15.38:0/3779491617 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d001c9e0 con 0x558e5f222e40 2023-11-06T13:28:14.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.749+0000 7f37beffd700 1 -- 172.21.15.38:0/3779491617 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d001cd60 con 0x558e5f222e40 2023-11-06T13:28:14.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 -- 172.21.15.38:0/3779491617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 msgr2=0x558e5f4a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a93b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f37d0000e50 tx=0x7f37d001d000).stop 2023-11-06T13:28:14.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 -- 172.21.15.38:0/3779491617 shutdown_connections 2023-11-06T13:28:14.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f4a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a93b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3779491617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f465bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 -- 172.21.15.38:0/3779491617 >> 172.21.15.38:0/3779491617 conn(0x558e5f2d04a0 msgr2=0x558e5f466d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 -- 172.21.15.38:0/3779491617 shutdown_connections 2023-11-06T13:28:14.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.750+0000 7f37f1639b80 1 -- 172.21.15.38:0/3779491617 wait complete. 2023-11-06T13:28:14.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.751+0000 7f37f1639b80 1 -- start start 2023-11-06T13:28:14.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.751+0000 7f37f1639b80 1 Processor -- start 2023-11-06T13:28:14.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f49b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 0x558e5f4e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f4a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f3b8580 con 0x558e5f4660c0 2023-11-06T13:28:14.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f3b8800 con 0x558e5f222e40 2023-11-06T13:28:14.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f383e10 con 0x558e5f4a98a0 2023-11-06T13:28:14.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37f1639b80 10 client.0 ll_register_callbacks cb 0x558e5f426380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37dd23c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 0x558e5f4e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37dd23c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 0x558e5f4e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48786/0 (socket says 172.21.15.38:48786) 2023-11-06T13:28:14.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37dd23c700 1 -- 172.21.15.38:0/1567440063 learned_addr learned my addr 172.21.15.38:0/1567440063 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37dda3d700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f49b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.752+0000 7f37de23e700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f4a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37dd23c700 1 -- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 msgr2=0x558e5f4a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37dd23c700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f4a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37dd23c700 1 -- 172.21.15.38:0/1567440063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 msgr2=0x558e5f49b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37dd23c700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f49b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37dd23c700 1 -- 172.21.15.38:0/1567440063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d817c800 con 0x558e5f4660c0 2023-11-06T13:28:14.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37dd23c700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 0x558e5f4e81a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f37d8063010 tx=0x7f37cc008040).ready entity=mon.0 client_cookie=7c4499f3069da0f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37b3fff700 1 -- 172.21.15.38:0/1567440063 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc009520 con 0x558e5f4660c0 2023-11-06T13:28:14.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37b3fff700 1 -- 172.21.15.38:0/1567440063 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f37cc011d90 con 0x558e5f4660c0 2023-11-06T13:28:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e5f45a640 con 0x558e5f4660c0 2023-11-06T13:28:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37b3fff700 1 -- 172.21.15.38:0/1567440063 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37cc015650 con 0x558e5f4660c0 2023-11-06T13:28:14.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37f1639b80 10 client.4920 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558e5f3ac9c0 con 0x558e5f4660c0 2023-11-06T13:28:14.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37b3fff700 1 -- 172.21.15.38:0/1567440063 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e5f45a640 con 0x558e5f4660c0 2023-11-06T13:28:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37b3fff700 1 -- 172.21.15.38:0/1567440063 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f37cc0157b0 con 0x558e5f4660c0 2023-11-06T13:28:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37f1639b80 10 client.4920 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37f1639b80 10 client.4920 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-06T13:28:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.753+0000 7f37f1639b80 20 client.4920 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.754+0000 7f37f1639b80 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f4e7870 0x558e5f4f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.754+0000 7f37f1639b80 4 client.4920 mds_command: new command op to 4352 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:14.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.754+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 --> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e5f21eca0 con 0x558e5f4e7870 2023-11-06T13:28:14.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.754+0000 7f37dda3d700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f4e7870 0x558e5f4f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.754+0000 7f37dda3d700 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f4e7870 0x558e5f4f17c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.2 client_cookie=987a9d5a51f9339c server_cookie=40501aec94f0166e in_seq=0 out_seq=0 2023-11-06T13:28:14.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.754+0000 7f37b3fff700 10 client.4920 ms_handle_connect on v2:172.21.15.163:6835/2986446701 2023-11-06T13:28:14.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37b3fff700 1 -- 172.21.15.38:0/1567440063 <== mds.2 v2:172.21.15.163:6835/2986446701 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x558e5f21eca0 con 0x558e5f4e7870 2023-11-06T13:28:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37b3fff700 10 client.4920 handle_command_reply: tid=0 2023-11-06T13:28:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 client.4920 shutdown 2023-11-06T13:28:14.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 msgr2=0x558e5f4e81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 0x558e5f4e81a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f37d8063010 tx=0x7f37cc008040).stop 2023-11-06T13:28:14.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 shutdown_connections 2023-11-06T13:28:14.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f4e7870 0x558e5f4f17c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f4a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f49b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 --2- 172.21.15.38:0/1567440063 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4660c0 0x558e5f4e81a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37b3fff700 0 client.4920 ms_handle_reset on v2:172.21.15.163:6835/2986446701 2023-11-06T13:28:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 >> 172.21.15.38:0/1567440063 conn(0x558e5f2d04a0 msgr2=0x558e5f4d61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 shutdown_connections 2023-11-06T13:28:14.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 1 -- 172.21.15.38:0/1567440063 wait complete. 2023-11-06T13:28:14.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.755+0000 7f37f1639b80 20 client.4920 trim_cache size 0 max 16384 2023-11-06T13:28:14.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.772+0000 7f37f1639b80 1 Processor -- start 2023-11-06T13:28:14.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.772+0000 7f37f1639b80 1 -- start start 2023-11-06T13:28:14.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f4a3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4660c0 0x558e5f4a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 0x558e5f4a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37f1639b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f4a5550 con 0x558e5f4a98a0 2023-11-06T13:28:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37f1639b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f464bb0 con 0x558e5f222e40 2023-11-06T13:28:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37f1639b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f4a5200 con 0x558e5f4660c0 2023-11-06T13:28:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37de23e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 0x558e5f4a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37de23e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 0x558e5f4a2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48802/0 (socket says 172.21.15.38:48802) 2023-11-06T13:28:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37de23e700 1 -- 172.21.15.38:0/3296990694 learned_addr learned my addr 172.21.15.38:0/3296990694 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f4a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.773+0000 7f37dd23c700 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4660c0 0x558e5f4a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37de23e700 1 -- 172.21.15.38:0/3296990694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4660c0 msgr2=0x558e5f4a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37de23e700 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4660c0 0x558e5f4a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37de23e700 1 -- 172.21.15.38:0/3296990694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 msgr2=0x558e5f4a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37de23e700 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f4a3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37de23e700 1 -- 172.21.15.38:0/3296990694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e5f3ac710 con 0x558e5f4a98a0 2023-11-06T13:28:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37dd23c700 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4660c0 0x558e5f4a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37de23e700 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 0x558e5f4a2d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f37c80af9d0 tx=0x7f37c8089040).ready entity=mon.0 client_cookie=68d3ea3bbe1fdb78 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37bf7fe700 1 -- 172.21.15.38:0/3296990694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c8058310 con 0x558e5f4a98a0 2023-11-06T13:28:14.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37bf7fe700 1 -- 172.21.15.38:0/3296990694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c80861b0 con 0x558e5f4a98a0 2023-11-06T13:28:14.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37bf7fe700 1 -- 172.21.15.38:0/3296990694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c808ba90 con 0x558e5f4a98a0 2023-11-06T13:28:14.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 -- 172.21.15.38:0/3296990694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 msgr2=0x558e5f4a2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 0x558e5f4a2d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f37c80af9d0 tx=0x7f37c8089040).stop 2023-11-06T13:28:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 -- 172.21.15.38:0/3296990694 shutdown_connections 2023-11-06T13:28:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f4a98a0 0x558e5f4a2d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f222e40 0x558e5f4a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3296990694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4660c0 0x558e5f4a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 -- 172.21.15.38:0/3296990694 >> 172.21.15.38:0/3296990694 conn(0x558e5f2d04a0 msgr2=0x558e5f4a6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 -- 172.21.15.38:0/3296990694 shutdown_connections 2023-11-06T13:28:14.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.774+0000 7f37f1639b80 1 -- 172.21.15.38:0/3296990694 wait complete. 2023-11-06T13:28:14.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.775+0000 7f37f1639b80 1 -- start start 2023-11-06T13:28:14.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.775+0000 7f37f1639b80 1 Processor -- start 2023-11-06T13:28:14.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f49b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f53ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f4d5010 con 0x558e5f222e40 2023-11-06T13:28:14.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f4a2830 con 0x558e5f4660c0 2023-11-06T13:28:14.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e5f53eaa0 con 0x558e5f4a98a0 2023-11-06T13:28:14.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37f1639b80 10 client.0 ll_register_callbacks cb 0x558e5f4631b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37dda3d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37dda3d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48804/0 (socket says 172.21.15.38:48804) 2023-11-06T13:28:14.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.776+0000 7f37dda3d700 1 -- 172.21.15.38:0/3918088227 learned_addr learned my addr 172.21.15.38:0/3918088227 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dd23c700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f49b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37de23e700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f53ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dda3d700 1 -- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 msgr2=0x558e5f53ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f53ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dda3d700 1 -- 172.21.15.38:0/3918088227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 msgr2=0x558e5f49b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f49b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dda3d700 1 -- 172.21.15.38:0/3918088227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d80c6000 con 0x558e5f222e40 2023-11-06T13:28:14.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37de23e700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f53ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37dda3d700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a6470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f37d0006e00 tx=0x7f37d0031040).ready entity=mon.0 client_cookie=97f914e463b35efb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37b3fff700 1 -- 172.21.15.38:0/3918088227 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0034040 con 0x558e5f222e40 2023-11-06T13:28:14.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37b3fff700 1 -- 172.21.15.38:0/3918088227 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f37d000bb50 con 0x558e5f222e40 2023-11-06T13:28:14.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37d001c9e0 con 0x558e5f222e40 2023-11-06T13:28:14.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37b3fff700 1 -- 172.21.15.38:0/3918088227 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37d001ce50 con 0x558e5f222e40 2023-11-06T13:28:14.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37f1639b80 10 client.4926 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558e5f223f80 con 0x558e5f222e40 2023-11-06T13:28:14.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37b3fff700 1 -- 172.21.15.38:0/3918088227 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d001c9e0 con 0x558e5f222e40 2023-11-06T13:28:14.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.777+0000 7f37b3fff700 1 -- 172.21.15.38:0/3918088227 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f37d0011820 con 0x558e5f222e40 2023-11-06T13:28:14.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 10 client.4926 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 10 client.4926 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-06T13:28:14.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 20 client.4926 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f53ba40 0x558e5f53be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 4 client.4926 mds_command: new command op to 4352 tid=0[{"prefix": "status"}] 2023-11-06T13:28:14.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 --> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558e5f255ca0 con 0x558e5f53ba40 2023-11-06T13:28:14.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37dd23c700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f53ba40 0x558e5f53be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37b3fff700 10 client.4926 ms_handle_connect on v2:172.21.15.163:6835/2986446701 2023-11-06T13:28:14.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37dd23c700 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f53ba40 0x558e5f53be20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.2 client_cookie=51aa001599306114 server_cookie=b714efb7a2bafa87 in_seq=0 out_seq=0 2023-11-06T13:28:14.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37b3fff700 1 -- 172.21.15.38:0/3918088227 <== mds.2 v2:172.21.15.163:6835/2986446701 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558e5f255ca0 con 0x558e5f53ba40 2023-11-06T13:28:14.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37b3fff700 10 client.4926 handle_command_reply: tid=0 2023-11-06T13:28:14.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 1 client.4926 shutdown 2023-11-06T13:28:14.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 msgr2=0x558e5f4a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.778+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a6470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f37d0006e00 tx=0x7f37d0031040).stop 2023-11-06T13:28:14.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 shutdown_connections 2023-11-06T13:28:14.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:6835/2986446701,v1:172.21.15.163:6837/2986446701] conn(0x558e5f53ba40 0x558e5f53be20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.811 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558e5f4a98a0 0x558e5f53ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x558e5f222e40 0x558e5f4a6470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37b3fff700 0 client.4926 ms_handle_reset on v2:172.21.15.163:6835/2986446701 2023-11-06T13:28:14.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 --2- 172.21.15.38:0/3918088227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558e5f4660c0 0x558e5f49b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 >> 172.21.15.38:0/3918088227 conn(0x558e5f2d04a0 msgr2=0x558e5f4650e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 shutdown_connections 2023-11-06T13:28:14.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 1 -- 172.21.15.38:0/3918088227 wait complete. 2023-11-06T13:28:14.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37f1639b80 20 client.4926 trim_cache size 0 max 16384 2023-11-06T13:28:14.813 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:14.814 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "678c2a34-c65e-414a-9c54-b10698be691f", 2023-11-06T13:28:14.814 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 2, 2023-11-06T13:28:14.814 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4352, 2023-11-06T13:28:14.814 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-11-06T13:28:14.815 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-11-06T13:28:14.815 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-11-06T13:28:14.815 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 19.435944085999999, 2023-11-06T13:28:14.815 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 17, 2023-11-06T13:28:14.815 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-11-06T13:28:14.816 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 31, 2023-11-06T13:28:14.816 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 37.299479234000003 2023-11-06T13:28:14.816 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:14.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f37c408cbd0 msgr2=0x7f37c408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f37c408cbd0 0x7f37c408f090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f37d80c7660 tx=0x7f37d0017000).stop 2023-11-06T13:28:14.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 msgr2=0x7f37d80cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 0x7f37d80cb130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f37c800c810 tx=0x7f37c80014d0).stop 2023-11-06T13:28:14.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 shutdown_connections 2023-11-06T13:28:14.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f37d817e350 0x7f37d80cb130 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37d80645d0 0x7f37d816f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f37c408cbd0 0x7f37c408f090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 --2- 172.21.15.38:0/2042316473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37d81756e0 0x7f37d80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 >> 172.21.15.38:0/2042316473 conn(0x7f37d8069ea0 msgr2=0x7f37d817f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 shutdown_connections 2023-11-06T13:28:14.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.779+0000 7f37dfca1700 1 -- 172.21.15.38:0/2042316473 wait complete. 2023-11-06T13:28:14.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-11-06T13:28:14.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.937+0000 7f4460a73700 1 Processor -- start 2023-11-06T13:28:14.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.937+0000 7f4460a73700 1 -- start start 2023-11-06T13:28:14.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f4460a73700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f445c17e570 0x7f445c186590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f4460a73700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c17d9d0 con 0x7f445c1756e0 2023-11-06T13:28:14.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f4460a73700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445c17c800 con 0x7f445c0647f0 2023-11-06T13:28:14.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f4460a73700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445c0c8560 con 0x7f445c17e570 2023-11-06T13:28:14.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f445a59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f445c1756e0 0x7f445c0640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43894/0 (socket says 172.21.15.38:43894) 2023-11-06T13:28:14.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f445a59c700 1 -- 172.21.15.38:0/1422321877 learned_addr learned my addr 172.21.15.38:0/1422321877 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:14.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f445ad9d700 1 --2- 172.21.15.38:0/1422321877 >> v2:172.21.15.163:3300/0 conn(0x7f445c17e570 0x7f445c186590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f445959a700 1 -- 172.21.15.38:0/1422321877 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389571362 0 0) 0x7f445c17d9d0 con 0x7f445c1756e0 2023-11-06T13:28:14.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.938+0000 7f445959a700 1 -- 172.21.15.38:0/1422321877 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44480033f0 con 0x7f445c1756e0 2023-11-06T13:28:14.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445ad9d700 1 -- 172.21.15.38:0/1422321877 >> v1:172.21.15.44:6789/0 conn(0x7f445c0647f0 legacy=0x7f445c17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445ad9d700 1 -- 172.21.15.38:0/1422321877 >> v1:172.21.15.38:6789/0 conn(0x7f445c1756e0 legacy=0x7f445c0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445ad9d700 1 -- 172.21.15.38:0/1422321877 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c17cae0 con 0x7f445c17e570 2023-11-06T13:28:14.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445ad9d700 1 --2- 172.21.15.38:0/1422321877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c17e570 0x7f445c186590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f444c009760 tx=0x7f444c009060).ready entity=mon.2 client_cookie=df6e5b548ea65b3f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445959a700 1 -- 172.21.15.38:0/1422321877 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00f510 con 0x7f445c17e570 2023-11-06T13:28:14.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445959a700 1 -- 172.21.15.38:0/1422321877 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00f670 con 0x7f445c17e570 2023-11-06T13:28:14.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f445959a700 1 -- 172.21.15.38:0/1422321877 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00f9f0 con 0x7f445c17e570 2023-11-06T13:28:14.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f4460a73700 1 -- 172.21.15.38:0/1422321877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c17e570 msgr2=0x7f445c186590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f4460a73700 1 --2- 172.21.15.38:0/1422321877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c17e570 0x7f445c186590 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f444c009760 tx=0x7f444c009060).stop 2023-11-06T13:28:14.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.939+0000 7f4460a73700 1 -- 172.21.15.38:0/1422321877 shutdown_connections 2023-11-06T13:28:14.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.940+0000 7f4460a73700 1 --2- 172.21.15.38:0/1422321877 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c17e570 0x7f445c186590 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.940+0000 7f4460a73700 1 -- 172.21.15.38:0/1422321877 >> 172.21.15.38:0/1422321877 conn(0x7f445c069ea0 msgr2=0x7f445c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.940+0000 7f4460a73700 1 -- 172.21.15.38:0/1422321877 shutdown_connections 2023-11-06T13:28:14.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.940+0000 7f4460a73700 1 -- 172.21.15.38:0/1422321877 wait complete. 2023-11-06T13:28:14.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.941+0000 7f4460a73700 1 Processor -- start 2023-11-06T13:28:14.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.941+0000 7f4460a73700 1 -- start start 2023-11-06T13:28:14.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4460a73700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0647f0 0x7f445c18f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4460a73700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c1756e0 0x7f445c18fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4460a73700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 0x7f445c150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4460a73700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c16e480 con 0x7f445c17e570 2023-11-06T13:28:14.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4460a73700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c16e6d0 con 0x7f445c1756e0 2023-11-06T13:28:14.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4460a73700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c16e9b0 con 0x7f445c0647f0 2023-11-06T13:28:14.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 0x7f445c150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 0x7f445c150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48810/0 (socket says 172.21.15.38:48810) 2023-11-06T13:28:14.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 -- 172.21.15.38:0/816095545 learned_addr learned my addr 172.21.15.38:0/816095545 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f4459d9b700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c1756e0 0x7f445c18fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445a59c700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0647f0 0x7f445c18f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 -- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0647f0 msgr2=0x7f445c18f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0647f0 0x7f445c18f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 -- 172.21.15.38:0/816095545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c1756e0 msgr2=0x7f445c18fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c1756e0 0x7f445c18fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445ad9d700 1 -- 172.21.15.38:0/816095545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0092a0 con 0x7f445c17e570 2023-11-06T13:28:14.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.942+0000 7f445a59c700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0647f0 0x7f445c18f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:14.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.943+0000 7f445ad9d700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 0x7f445c150800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f444c009e00 tx=0x7f444c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.943+0000 7f44527fc700 1 -- 172.21.15.38:0/816095545 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00f9f0 con 0x7f445c17e570 2023-11-06T13:28:14.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.943+0000 7f44527fc700 1 -- 172.21.15.38:0/816095545 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c01b410 con 0x7f445c17e570 2023-11-06T13:28:14.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.943+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c16ec90 con 0x7f445c17e570 2023-11-06T13:28:14.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.943+0000 7f44527fc700 1 -- 172.21.15.38:0/816095545 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c01b7d0 con 0x7f445c17e570 2023-11-06T13:28:14.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.943+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c16f250 con 0x7f445c17e570 2023-11-06T13:28:14.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.945+0000 7f44527fc700 1 -- 172.21.15.38:0/816095545 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f444c01bbc0 con 0x7f445c17e570 2023-11-06T13:28:14.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.946+0000 7f44527fc700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f443c08cbd0 0x7f443c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.946+0000 7f44527fc700 1 -- 172.21.15.38:0/816095545 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f444c0b3b50 con 0x7f445c17e570 2023-11-06T13:28:14.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.946+0000 7f445a59c700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f443c08cbd0 0x7f443c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.946+0000 7f445a59c700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f443c08cbd0 0x7f443c08f090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4454005ad0 tx=0x7f4454009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.947+0000 7f447240bb80 1 Processor -- start 2023-11-06T13:28:14.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.947+0000 7f447240bb80 1 -- start start 2023-11-06T13:28:14.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.948+0000 7f447240bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cc88e40 0x56000cf0f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.948+0000 7f447240bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cecbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.948+0000 7f447240bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 0x56000cf0cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.948+0000 7f447240bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000ce91f80 con 0x56000cecc0c0 2023-11-06T13:28:14.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.948+0000 7f447240bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000ce091f0 con 0x56000cc88e40 2023-11-06T13:28:14.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.948+0000 7f447240bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000ce1e440 con 0x56000cf0f8a0 2023-11-06T13:28:14.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 0x56000cf0cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 0x56000cf0cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48826/0 (socket says 172.21.15.38:48826) 2023-11-06T13:28:14.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 -- 172.21.15.38:0/4252179673 learned_addr learned my addr 172.21.15.38:0/4252179673 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445a59c700 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cc88e40 0x56000cf0f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f4459d9b700 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cecbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 -- 172.21.15.38:0/4252179673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 msgr2=0x56000cecbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cecbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 -- 172.21.15.38:0/4252179673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cc88e40 msgr2=0x56000cf0f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cc88e40 0x56000cf0f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 -- 172.21.15.38:0/4252179673 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56000ce17620 con 0x56000cecc0c0 2023-11-06T13:28:14.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f445ad9d700 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 0x56000cf0cbb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f444c006aa0 tx=0x7f444c0091a0).ready entity=mon.0 client_cookie=992f5db884a8e981 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f443b7fe700 1 -- 172.21.15.38:0/4252179673 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0876b0 con 0x56000cecc0c0 2023-11-06T13:28:14.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f443b7fe700 1 -- 172.21.15.38:0/4252179673 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c087d50 con 0x56000cecc0c0 2023-11-06T13:28:14.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.949+0000 7f443b7fe700 1 -- 172.21.15.38:0/4252179673 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c08d630 con 0x56000cecc0c0 2023-11-06T13:28:14.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 -- 172.21.15.38:0/4252179673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 msgr2=0x56000cf0cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 0x56000cf0cbb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f444c006aa0 tx=0x7f444c0091a0).stop 2023-11-06T13:28:14.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 -- 172.21.15.38:0/4252179673 shutdown_connections 2023-11-06T13:28:14.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cecc0c0 0x56000cf0cbb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cc88e40 0x56000cf0f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 --2- 172.21.15.38:0/4252179673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cecbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 -- 172.21.15.38:0/4252179673 >> 172.21.15.38:0/4252179673 conn(0x56000cd364a0 msgr2=0x56000ceccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 -- 172.21.15.38:0/4252179673 shutdown_connections 2023-11-06T13:28:14.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.950+0000 7f447240bb80 1 -- 172.21.15.38:0/4252179673 wait complete. 2023-11-06T13:28:14.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.951+0000 7f447240bb80 1 -- start start 2023-11-06T13:28:14.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.951+0000 7f447240bb80 1 Processor -- start 2023-11-06T13:28:14.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 0x56000cf4ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cf4ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cefcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000ce1e580 con 0x56000cc88e40 2023-11-06T13:28:14.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000ce1e800 con 0x56000cecc0c0 2023-11-06T13:28:14.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000cde9e10 con 0x56000cf0f8a0 2023-11-06T13:28:14.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f447240bb80 10 client.0 ll_register_callbacks cb 0x56000ce8c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:14.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 0x56000cf4ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 0x56000cf4ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48828/0 (socket says 172.21.15.38:48828) 2023-11-06T13:28:14.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 -- 172.21.15.38:0/1200655485 learned_addr learned my addr 172.21.15.38:0/1200655485 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:14.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f4459d9b700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cf4ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445ad9d700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cefcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 -- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 msgr2=0x56000cefcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cefcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 -- 172.21.15.38:0/1200655485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 msgr2=0x56000cf4ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:14.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cf4ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 -- 172.21.15.38:0/1200655485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c16f250 con 0x56000cc88e40 2023-11-06T13:28:14.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f445a59c700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 0x56000cf4ccd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f4454005fd0 tx=0x7f4454007000).ready entity=mon.0 client_cookie=5e75bb140cc4f8eb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:14.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.952+0000 7f4438ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:14.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f4438ff9700 1 -- 172.21.15.38:0/1200655485 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445401d070 con 0x56000cc88e40 2023-11-06T13:28:14.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f4438ff9700 1 -- 172.21.15.38:0/1200655485 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4454004a30 con 0x56000cc88e40 2023-11-06T13:28:14.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56000cec0640 con 0x56000cc88e40 2023-11-06T13:28:14.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f4438ff9700 1 -- 172.21.15.38:0/1200655485 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4454004e00 con 0x56000cc88e40 2023-11-06T13:28:14.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 10 client.4938 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:14.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56000ce129c0 con 0x56000cc88e40 2023-11-06T13:28:14.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f4438ff9700 1 -- 172.21.15.38:0/1200655485 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56000cec0640 con 0x56000cc88e40 2023-11-06T13:28:14.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f4438ff9700 1 -- 172.21.15.38:0/1200655485 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f4454005030 con 0x56000cc88e40 2023-11-06T13:28:14.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 10 client.4938 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:14.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 10 client.4938 resolve_mds: resolved name 'i' to daemon mds.i 2023-11-06T13:28:14.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 20 client.4938 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:14.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf4e600 0x56000cf08620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 4 client.4938 mds_command: new command op to 4355 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:14.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 --> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56000cc84ca0 con 0x56000cf4e600 2023-11-06T13:28:14.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.953+0000 7f4459d9b700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf4e600 0x56000cf08620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:14.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.954+0000 7f4438ff9700 10 client.4938 ms_handle_connect on v2:172.21.15.163:6838/3927893034 2023-11-06T13:28:14.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.954+0000 7f4459d9b700 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf4e600 0x56000cf08620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.1 client_cookie=bd827a390c4590b4 server_cookie=df341c112f708700 in_seq=0 out_seq=0 2023-11-06T13:28:14.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.954+0000 7f4438ff9700 1 -- 172.21.15.38:0/1200655485 <== mds.1 v2:172.21.15.163:6838/3927893034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56000cc84ca0 con 0x56000cf4e600 2023-11-06T13:28:14.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.954+0000 7f4438ff9700 10 client.4938 handle_command_reply: tid=0 2023-11-06T13:28:14.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.954+0000 7f447240bb80 1 client.4938 shutdown 2023-11-06T13:28:14.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 msgr2=0x56000cf4ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:14.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 0x56000cf4ccd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f4454005fd0 tx=0x7f4454007000).stop 2023-11-06T13:28:14.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 shutdown_connections 2023-11-06T13:28:14.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cf0f8a0 0x56000cefcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf4e600 0x56000cf08620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cc88e40 0x56000cf4ccd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 --2- 172.21.15.38:0/1200655485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cf4ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:14.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 >> 172.21.15.38:0/1200655485 conn(0x56000cd364a0 msgr2=0x56000ced3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:14.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f4438ff9700 0 client.4938 ms_handle_reset on v2:172.21.15.163:6838/3927893034 2023-11-06T13:28:14.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 shutdown_connections 2023-11-06T13:28:14.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 1 -- 172.21.15.38:0/1200655485 wait complete. 2023-11-06T13:28:14.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.955+0000 7f447240bb80 20 client.4938 trim_cache size 0 max 16384 2023-11-06T13:28:14.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.972+0000 7f447240bb80 1 Processor -- start 2023-11-06T13:28:14.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.972+0000 7f447240bb80 1 -- start start 2023-11-06T13:28:14.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f447240bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf32540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f447240bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cecc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:14.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f447240bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf98370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f447240bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000cf0dc90 con 0x56000cf0f8a0 2023-11-06T13:28:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f447240bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000cec7d10 con 0x56000cecc0c0 2023-11-06T13:28:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f447240bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000cf4d400 con 0x56000cc88e40 2023-11-06T13:28:15.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf98370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf98370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48836/0 (socket says 172.21.15.38:48836) 2023-11-06T13:28:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 -- 172.21.15.38:0/2216875394 learned_addr learned my addr 172.21.15.38:0/2216875394 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f4459d9b700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cecc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445a59c700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf32540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 -- 172.21.15.38:0/2216875394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 msgr2=0x56000cf32540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf32540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 -- 172.21.15.38:0/2216875394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 msgr2=0x56000cecc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cecc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 -- 172.21.15.38:0/2216875394 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56000cec0260 con 0x56000cf0f8a0 2023-11-06T13:28:15.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445a59c700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf32540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f4459d9b700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cecc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f445ad9d700 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf98370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f444c0860a0 tx=0x7f444c056000).ready entity=mon.0 client_cookie=531de7a7d4314a6b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.973+0000 7f443bfff700 1 -- 172.21.15.38:0/2216875394 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0876b0 con 0x56000cf0f8a0 2023-11-06T13:28:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f443bfff700 1 -- 172.21.15.38:0/2216875394 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c08d630 con 0x56000cf0f8a0 2023-11-06T13:28:15.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f443bfff700 1 -- 172.21.15.38:0/2216875394 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c0860f0 con 0x56000cf0f8a0 2023-11-06T13:28:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 -- 172.21.15.38:0/2216875394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 msgr2=0x56000cf98370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf98370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f444c0860a0 tx=0x7f444c056000).stop 2023-11-06T13:28:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 -- 172.21.15.38:0/2216875394 shutdown_connections 2023-11-06T13:28:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf98370 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf32540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 --2- 172.21.15.38:0/2216875394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cecc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 -- 172.21.15.38:0/2216875394 >> 172.21.15.38:0/2216875394 conn(0x56000cd364a0 msgr2=0x56000cec7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 -- 172.21.15.38:0/2216875394 shutdown_connections 2023-11-06T13:28:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.974+0000 7f447240bb80 1 -- 172.21.15.38:0/2216875394 wait complete. 2023-11-06T13:28:15.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.975+0000 7f447240bb80 1 -- start start 2023-11-06T13:28:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.975+0000 7f447240bb80 1 Processor -- start 2023-11-06T13:28:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf0dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cfa4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000ced2400 con 0x56000cf0f8a0 2023-11-06T13:28:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000cfa1160 con 0x56000cecc0c0 2023-11-06T13:28:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56000cfa5090 con 0x56000cc88e40 2023-11-06T13:28:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f447240bb80 10 client.0 ll_register_callbacks cb 0x56000ce8c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:15.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48844/0 (socket says 172.21.15.38:48844) 2023-11-06T13:28:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 -- 172.21.15.38:0/1656003501 learned_addr learned my addr 172.21.15.38:0/1656003501 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445a59c700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf0dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f4459d9b700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cfa4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 -- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 msgr2=0x56000cf0dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf0dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 -- 172.21.15.38:0/1656003501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 msgr2=0x56000cfa4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cfa4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f445ad9d700 1 -- 172.21.15.38:0/1656003501 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56000ce17620 con 0x56000cf0f8a0 2023-11-06T13:28:15.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.976+0000 7f4459d9b700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cfa4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f445ad9d700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf499f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f444c006e00 tx=0x7f444c08f040).ready entity=mon.0 client_cookie=3ed2bef380a290a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f4438ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f4438ff9700 1 -- 172.21.15.38:0/1656003501 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c006930 con 0x56000cf0f8a0 2023-11-06T13:28:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f4438ff9700 1 -- 172.21.15.38:0/1656003501 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f444c0860f0 con 0x56000cf0f8a0 2023-11-06T13:28:15.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f444c087d50 con 0x56000cf0f8a0 2023-11-06T13:28:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f4438ff9700 1 -- 172.21.15.38:0/1656003501 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f444c087890 con 0x56000cf0f8a0 2023-11-06T13:28:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 10 client.4944 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56000ce12710 con 0x56000cf0f8a0 2023-11-06T13:28:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f4438ff9700 1 -- 172.21.15.38:0/1656003501 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c087d50 con 0x56000cf0f8a0 2023-11-06T13:28:15.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f4438ff9700 1 -- 172.21.15.38:0/1656003501 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f444c083b40 con 0x56000cf0f8a0 2023-11-06T13:28:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 10 client.4944 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 10 client.4944 resolve_mds: resolved name 'i' to daemon mds.i 2023-11-06T13:28:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 20 client.4944 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf0e5f0 0x56000cfa17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 4 client.4944 mds_command: new command op to 4355 tid=0[{"prefix": "status"}] 2023-11-06T13:28:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 --> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56000ccbbca0 con 0x56000cf0e5f0 2023-11-06T13:28:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.977+0000 7f445a59c700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf0e5f0 0x56000cfa17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f4438ff9700 10 client.4944 ms_handle_connect on v2:172.21.15.163:6838/3927893034 2023-11-06T13:28:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f445a59c700 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf0e5f0 0x56000cfa17c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.1 client_cookie=dff40c3c9ed236d8 server_cookie=e2c7cc064b2bc67d in_seq=0 out_seq=0 2023-11-06T13:28:15.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f4438ff9700 1 -- 172.21.15.38:0/1656003501 <== mds.1 v2:172.21.15.163:6838/3927893034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56000ccbbca0 con 0x56000cf0e5f0 2023-11-06T13:28:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f4438ff9700 10 client.4944 handle_command_reply: tid=0 2023-11-06T13:28:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 client.4944 shutdown 2023-11-06T13:28:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 msgr2=0x56000cf499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf499f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f444c006e00 tx=0x7f444c08f040).stop 2023-11-06T13:28:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 shutdown_connections 2023-11-06T13:28:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:6838/3927893034,v1:172.21.15.163:6839/3927893034] conn(0x56000cf0e5f0 0x56000cfa17c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56000cf0f8a0 0x56000cf499f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56000cc88e40 0x56000cf0dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 --2- 172.21.15.38:0/1656003501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56000cecc0c0 0x56000cfa4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f4438ff9700 0 client.4944 ms_handle_reset on v2:172.21.15.163:6838/3927893034 2023-11-06T13:28:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 >> 172.21.15.38:0/1656003501 conn(0x56000cd364a0 msgr2=0x56000cec7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 shutdown_connections 2023-11-06T13:28:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 1 -- 172.21.15.38:0/1656003501 wait complete. 2023-11-06T13:28:15.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.978+0000 7f447240bb80 20 client.4944 trim_cache size 0 max 16384 2023-11-06T13:28:15.017 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:15.017 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "678c2a34-c65e-414a-9c54-b10698be691f", 2023-11-06T13:28:15.017 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 1, 2023-11-06T13:28:15.018 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4355, 2023-11-06T13:28:15.018 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-11-06T13:28:15.018 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-11-06T13:28:15.018 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-11-06T13:28:15.018 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 20.643457495, 2023-11-06T13:28:15.019 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 17, 2023-11-06T13:28:15.019 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-11-06T13:28:15.019 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 31, 2023-11-06T13:28:15.019 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 37.496144788000002 2023-11-06T13:28:15.019 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f443c08cbd0 msgr2=0x7f443c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f443c08cbd0 0x7f443c08f090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4454005ad0 tx=0x7f4454009040).stop 2023-11-06T13:28:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 msgr2=0x7f445c150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 0x7f445c150800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f444c009e00 tx=0x7f444c017000).stop 2023-11-06T13:28:15.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 shutdown_connections 2023-11-06T13:28:15.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f445c17e570 0x7f445c150800 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f445c0647f0 0x7f445c18f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f443c08cbd0 0x7f443c08f090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 --2- 172.21.15.38:0/816095545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f445c1756e0 0x7f445c18fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 >> 172.21.15.38:0/816095545 conn(0x7f445c069ea0 msgr2=0x7f445c16f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 shutdown_connections 2023-11-06T13:28:15.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:14.979+0000 7f4460a73700 1 -- 172.21.15.38:0/816095545 wait complete. 2023-11-06T13:28:15.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-11-06T13:28:15.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.140+0000 7f55017c7700 1 Processor -- start 2023-11-06T13:28:15.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.140+0000 7f55017c7700 1 -- start start 2023-11-06T13:28:15.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.141+0000 7f55017c7700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f54fc1820b0 0x7f54fc0ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.141+0000 7f55017c7700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0ee7d0 con 0x7f54fc0ef370 2023-11-06T13:28:15.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.141+0000 7f55017c7700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0ed8e0 con 0x7f54fc17e720 2023-11-06T13:28:15.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.141+0000 7f55017c7700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc0edbc0 con 0x7f54fc1820b0 2023-11-06T13:28:15.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.141+0000 7f54fb7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f54fc0ef370 0x7f54fc182490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43908/0 (socket says 172.21.15.38:43908) 2023-11-06T13:28:15.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.141+0000 7f54fb7fe700 1 -- 172.21.15.38:0/1105477070 learned_addr learned my addr 172.21.15.38:0/1105477070 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:15.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54faffd700 1 --2- 172.21.15.38:0/1105477070 >> v2:172.21.15.44:3300/0 conn(0x7f54fc1820b0 0x7f54fc0ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257492429 0 0) 0x7f54fc0ee7d0 con 0x7f54fc0ef370 2023-11-06T13:28:15.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e80033f0 con 0x7f54fc0ef370 2023-11-06T13:28:15.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775756574 0 0) 0x7f54fc0ed8e0 con 0x7f54fc17e720 2023-11-06T13:28:15.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54fc0ee7d0 con 0x7f54fc17e720 2023-11-06T13:28:15.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 980467964 0 0) 0x7f54e80033f0 con 0x7f54fc0ef370 2023-11-06T13:28:15.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 >> v2:172.21.15.44:3300/0 conn(0x7f54fc1820b0 msgr2=0x7f54fc0ed2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 --2- 172.21.15.38:0/1105477070 >> v2:172.21.15.44:3300/0 conn(0x7f54fc1820b0 0x7f54fc0ed2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 >> v1:172.21.15.163:6789/0 conn(0x7f54fc17e720 legacy=0x7f54fc0eec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0edea0 con 0x7f54fc0ef370 2023-11-06T13:28:15.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f54ec0017f0 con 0x7f54fc0ef370 2023-11-06T13:28:15.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 >> v1:172.21.15.38:6789/0 conn(0x7f54fc0ef370 legacy=0x7f54fc182490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54e8003ac0 0x7f54e8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54e8004690 0x7f54e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8005000 0x7f54e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0edbc0 con 0x7f54e8004690 2023-11-06T13:28:15.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e800beb0 con 0x7f54e8003ac0 2023-11-06T13:28:15.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e800c070 con 0x7f54e8005000 2023-11-06T13:28:15.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54e8004690 0x7f54e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8005000 0x7f54e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54faffd700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54e8003ac0 0x7f54e8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fa7fc700 1 -- 172.21.15.38:0/1105477070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8005000 msgr2=0x7f54e800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8005000 0x7f54e800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fa7fc700 1 -- 172.21.15.38:0/1105477070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54e8003ac0 msgr2=0x7f54e8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54e8003ac0 0x7f54e8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fa7fc700 1 -- 172.21.15.38:0/1105477070 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80033f0 con 0x7f54e8004690 2023-11-06T13:28:15.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.142+0000 7f54fb7fe700 1 -- 172.21.15.38:0/1105477070 reap_dead start 2023-11-06T13:28:15.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54e8004690 0x7f54e8004b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f54e4001860 tx=0x7f54e4007bb0).ready entity=mon.0 client_cookie=1d17ade706d5d944 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4007020 con 0x7f54e8004690 2023-11-06T13:28:15.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4007180 con 0x7f54e8004690 2023-11-06T13:28:15.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f54f9ffb700 1 -- 172.21.15.38:0/1105477070 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4007500 con 0x7f54e8004690 2023-11-06T13:28:15.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 -- 172.21.15.38:0/1105477070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54e8004690 msgr2=0x7f54e8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54e8004690 0x7f54e8004b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f54e4001860 tx=0x7f54e4007bb0).stop 2023-11-06T13:28:15.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 -- 172.21.15.38:0/1105477070 shutdown_connections 2023-11-06T13:28:15.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 --2- 172.21.15.38:0/1105477070 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54e8004690 0x7f54e8004b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 -- 172.21.15.38:0/1105477070 >> 172.21.15.38:0/1105477070 conn(0x7f54fc0f5c60 msgr2=0x7f54fc0f1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 -- 172.21.15.38:0/1105477070 shutdown_connections 2023-11-06T13:28:15.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.143+0000 7f55017c7700 1 -- 172.21.15.38:0/1105477070 wait complete. 2023-11-06T13:28:15.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.145+0000 7f55017c7700 1 Processor -- start 2023-11-06T13:28:15.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.145+0000 7f55017c7700 1 -- start start 2023-11-06T13:28:15.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8004690 0x7f54fc0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54fc0f19a0 0x7f54fc0f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 0x7f54fc190540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0ca090 con 0x7f54fc1900c0 2023-11-06T13:28:15.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0c9c00 con 0x7f54fc0f19a0 2023-11-06T13:28:15.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0c8d10 con 0x7f54e8004690 2023-11-06T13:28:15.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 0x7f54fc190540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 0x7f54fc190540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48848/0 (socket says 172.21.15.38:48848) 2023-11-06T13:28:15.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2459643290 learned_addr learned my addr 172.21.15.38:0/2459643290 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54faffd700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8004690 0x7f54fc0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8004690 msgr2=0x7f54fc0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8004690 0x7f54fc0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2459643290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54fc0f19a0 msgr2=0x7f54fc0f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54fc0f19a0 0x7f54fc0f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54fc0f19a0 0x7f54fc0f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2459643290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0c8ff0 con 0x7f54fc1900c0 2023-11-06T13:28:15.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 0x7f54fc190540 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f54ec000f80 tx=0x7f54ec007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54f2ffd700 1 -- 172.21.15.38:0/2459643290 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00f970 con 0x7f54fc1900c0 2023-11-06T13:28:15.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54f2ffd700 1 -- 172.21.15.38:0/2459643290 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec00fad0 con 0x7f54fc1900c0 2023-11-06T13:28:15.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc0c92d0 con 0x7f54fc1900c0 2023-11-06T13:28:15.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.146+0000 7f54f2ffd700 1 -- 172.21.15.38:0/2459643290 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00fe70 con 0x7f54fc1900c0 2023-11-06T13:28:15.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.147+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc0c9890 con 0x7f54fc1900c0 2023-11-06T13:28:15.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.148+0000 7f54f2ffd700 1 -- 172.21.15.38:0/2459643290 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f54ec012560 con 0x7f54fc1900c0 2023-11-06T13:28:15.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.149+0000 7f54f2ffd700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f54dc08cbd0 0x7f54dc08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.180 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.149+0000 7f54f2ffd700 1 -- 172.21.15.38:0/2459643290 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f54ec0b18a0 con 0x7f54fc1900c0 2023-11-06T13:28:15.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.149+0000 7f54faffd700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f54dc08cbd0 0x7f54dc08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.149+0000 7f54faffd700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f54dc08cbd0 0x7f54dc08f090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f54f4009270 tx=0x7f54f4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.150+0000 7f551315fb80 1 Processor -- start 2023-11-06T13:28:15.181 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.151+0000 7f551315fb80 1 -- start start 2023-11-06T13:28:15.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f551315fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b752460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f551315fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b75a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f551315fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b75ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f551315fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b6d6f80 con 0x55ae5b75a7a0 2023-11-06T13:28:15.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f551315fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b64e1f0 con 0x55ae5b752950 2023-11-06T13:28:15.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f551315fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b663440 con 0x55ae5b4cde40 2023-11-06T13:28:15.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b75ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b75ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48864/0 (socket says 172.21.15.38:48864) 2023-11-06T13:28:15.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 -- 172.21.15.38:0/92443562 learned_addr learned my addr 172.21.15.38:0/92443562 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54faffd700 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b752460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b75a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 -- 172.21.15.38:0/92443562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 msgr2=0x55ae5b752460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b752460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 -- 172.21.15.38:0/92443562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 msgr2=0x55ae5b75a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b75a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 -- 172.21.15.38:0/92443562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae5b65c620 con 0x55ae5b75a7a0 2023-11-06T13:28:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b75ac20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f54ec001220 tx=0x7f54ec0af420).ready entity=mon.0 client_cookie=b633d9eb338348a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54dbfff700 1 -- 172.21.15.38:0/92443562 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec085aa0 con 0x55ae5b75a7a0 2023-11-06T13:28:15.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54dbfff700 1 -- 172.21.15.38:0/92443562 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec08b380 con 0x55ae5b75a7a0 2023-11-06T13:28:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.152+0000 7f54dbfff700 1 -- 172.21.15.38:0/92443562 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0aee60 con 0x55ae5b75a7a0 2023-11-06T13:28:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 -- 172.21.15.38:0/92443562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 msgr2=0x55ae5b75ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b75ac20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f54ec001220 tx=0x7f54ec0af420).stop 2023-11-06T13:28:15.186 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 -- 172.21.15.38:0/92443562 shutdown_connections 2023-11-06T13:28:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b75ac20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b752460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 --2- 172.21.15.38:0/92443562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b75a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 -- 172.21.15.38:0/92443562 >> 172.21.15.38:0/92443562 conn(0x55ae5b57b4a0 msgr2=0x55ae5b711660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 -- 172.21.15.38:0/92443562 shutdown_connections 2023-11-06T13:28:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.153+0000 7f551315fb80 1 -- 172.21.15.38:0/92443562 wait complete. 2023-11-06T13:28:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.154+0000 7f551315fb80 1 -- start start 2023-11-06T13:28:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.154+0000 7f551315fb80 1 Processor -- start 2023-11-06T13:28:15.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b74c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b754de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b753c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b663580 con 0x55ae5b75a7a0 2023-11-06T13:28:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b663800 con 0x55ae5b752950 2023-11-06T13:28:15.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b62ee10 con 0x55ae5b4cde40 2023-11-06T13:28:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f551315fb80 10 client.0 ll_register_callbacks cb 0x55ae5b6d1560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b753c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b753c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48868/0 (socket says 172.21.15.38:48868) 2023-11-06T13:28:15.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f54fb7fe700 1 -- 172.21.15.38:0/1442765242 learned_addr learned my addr 172.21.15.38:0/1442765242 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.155+0000 7f54faffd700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b74c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b754de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fb7fe700 1 -- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 msgr2=0x55ae5b74c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b74c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fb7fe700 1 -- 172.21.15.38:0/1442765242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 msgr2=0x55ae5b754de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b754de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fb7fe700 1 -- 172.21.15.38:0/1442765242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc0c9890 con 0x55ae5b75a7a0 2023-11-06T13:28:15.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b753c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f54ec001220 tx=0x7f54ec016000).ready entity=mon.0 client_cookie=759a4fa0755be6c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:15.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54d97fa700 1 -- 172.21.15.38:0/1442765242 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec091070 con 0x55ae5b75a7a0 2023-11-06T13:28:15.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54d97fa700 1 -- 172.21.15.38:0/1442765242 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f54ec085aa0 con 0x55ae5b75a7a0 2023-11-06T13:28:15.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae5b705640 con 0x55ae5b75a7a0 2023-11-06T13:28:15.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54d97fa700 1 -- 172.21.15.38:0/1442765242 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54ec001f70 con 0x55ae5b75a7a0 2023-11-06T13:28:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 10 client.4956 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ae5b6579c0 con 0x55ae5b75a7a0 2023-11-06T13:28:15.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54d97fa700 1 -- 172.21.15.38:0/1442765242 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec0a0020 con 0x55ae5b75a7a0 2023-11-06T13:28:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f54d97fa700 1 -- 172.21.15.38:0/1442765242 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f54ec08aef0 con 0x55ae5b75a7a0 2023-11-06T13:28:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 10 client.4956 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 10 client.4956 resolve_mds: resolved name 'l' to daemon mds.l 2023-11-06T13:28:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 20 client.4956 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:15.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b70cd70 0x55ae5b7908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 4 client.4956 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.156+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae5b4c9ca0 con 0x55ae5b70cd70 2023-11-06T13:28:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.157+0000 7f54faffd700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b70cd70 0x55ae5b7908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.157+0000 7f54d97fa700 10 client.4956 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:15.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.157+0000 7f54faffd700 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b70cd70 0x55ae5b7908b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7f0ae8784e1ea6e4 server_cookie=fe5f57acd170b611 in_seq=0 out_seq=0 2023-11-06T13:28:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f54d97fa700 1 -- 172.21.15.38:0/1442765242 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55ae5b4c9ca0 con 0x55ae5b70cd70 2023-11-06T13:28:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f54d97fa700 10 client.4956 handle_command_reply: tid=0 2023-11-06T13:28:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 client.4956 shutdown 2023-11-06T13:28:15.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 msgr2=0x55ae5b753c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b753c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f54ec001220 tx=0x7f54ec016000).stop 2023-11-06T13:28:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 shutdown_connections 2023-11-06T13:28:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b753c70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b70cd70 0x55ae5b7908b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b74c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f54d97fa700 0 client.4956 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 --2- 172.21.15.38:0/1442765242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b752950 0x55ae5b754de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 >> 172.21.15.38:0/1442765242 conn(0x55ae5b57b4a0 msgr2=0x55ae5b781330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 shutdown_connections 2023-11-06T13:28:15.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 1 -- 172.21.15.38:0/1442765242 wait complete. 2023-11-06T13:28:15.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.158+0000 7f551315fb80 20 client.4956 trim_cache size 0 max 16384 2023-11-06T13:28:15.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.175+0000 7f551315fb80 1 Processor -- start 2023-11-06T13:28:15.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.175+0000 7f551315fb80 1 -- start start 2023-11-06T13:28:15.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f551315fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b708d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f551315fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 0x55ae5b78f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f551315fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b75a7a0 0x55ae5b783970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f551315fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b70ddb0 con 0x55ae5b752950 2023-11-06T13:28:15.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f551315fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b70ee70 con 0x55ae5b75a7a0 2023-11-06T13:28:15.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f551315fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b754a00 con 0x55ae5b4cde40 2023-11-06T13:28:15.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f54fa7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 0x55ae5b78f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f54fa7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 0x55ae5b78f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48872/0 (socket says 172.21.15.38:48872) 2023-11-06T13:28:15.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f54fa7fc700 1 -- 172.21.15.38:0/47232711 learned_addr learned my addr 172.21.15.38:0/47232711 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f54faffd700 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b708d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.176+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b75a7a0 0x55ae5b783970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54fa7fc700 1 -- 172.21.15.38:0/47232711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 msgr2=0x55ae5b708d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b708d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54fa7fc700 1 -- 172.21.15.38:0/47232711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b75a7a0 msgr2=0x55ae5b783970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b75a7a0 0x55ae5b783970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54fa7fc700 1 -- 172.21.15.38:0/47232711 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae5b657710 con 0x55ae5b752950 2023-11-06T13:28:15.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 0x55ae5b78f510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f54e4011000 tx=0x7f54e4015000).ready entity=mon.0 client_cookie=a1a1b29b7725a4c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54f0ff9700 1 -- 172.21.15.38:0/47232711 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4007930 con 0x55ae5b752950 2023-11-06T13:28:15.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54f0ff9700 1 -- 172.21.15.38:0/47232711 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4000c30 con 0x55ae5b752950 2023-11-06T13:28:15.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f54f0ff9700 1 -- 172.21.15.38:0/47232711 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40072f0 con 0x55ae5b752950 2023-11-06T13:28:15.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 -- 172.21.15.38:0/47232711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 msgr2=0x55ae5b78f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 0x55ae5b78f510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f54e4011000 tx=0x7f54e4015000).stop 2023-11-06T13:28:15.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 -- 172.21.15.38:0/47232711 shutdown_connections 2023-11-06T13:28:15.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b75a7a0 0x55ae5b783970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b4cde40 0x55ae5b708d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 --2- 172.21.15.38:0/47232711 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b752950 0x55ae5b78f510 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 -- 172.21.15.38:0/47232711 >> 172.21.15.38:0/47232711 conn(0x55ae5b57b4a0 msgr2=0x55ae5b776e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 -- 172.21.15.38:0/47232711 shutdown_connections 2023-11-06T13:28:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.177+0000 7f551315fb80 1 -- 172.21.15.38:0/47232711 wait complete. 2023-11-06T13:28:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.178+0000 7f551315fb80 1 -- start start 2023-11-06T13:28:15.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.178+0000 7f551315fb80 1 Processor -- start 2023-11-06T13:28:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b4cde40 0x55ae5b711460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b752950 0x55ae5b7e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b78f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b793780 con 0x55ae5b75a7a0 2023-11-06T13:28:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b7e6890 con 0x55ae5b4cde40 2023-11-06T13:28:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae5b7e9c80 con 0x55ae5b752950 2023-11-06T13:28:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.179+0000 7f551315fb80 10 client.0 ll_register_callbacks cb 0x55ae5b70d5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:15.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b78f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b78f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48876/0 (socket says 172.21.15.38:48876) 2023-11-06T13:28:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2175083093 learned_addr learned my addr 172.21.15.38:0/2175083093 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54faffd700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b4cde40 0x55ae5b711460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fa7fc700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b752950 0x55ae5b7e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b752950 msgr2=0x55ae5b7e5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b752950 0x55ae5b7e5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2175083093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b4cde40 msgr2=0x55ae5b711460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b4cde40 0x55ae5b711460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 -- 172.21.15.38:0/2175083093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e80033f0 con 0x55ae5b75a7a0 2023-11-06T13:28:15.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54fb7fe700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b78f510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f54ec007fd0 tx=0x7f54ec091000).ready entity=mon.0 client_cookie=a7bad6052d10 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:15.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54d97fa700 1 -- 172.21.15.38:0/2175083093 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0af340 con 0x55ae5b75a7a0 2023-11-06T13:28:15.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54d97fa700 1 -- 172.21.15.38:0/2175083093 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f54ec0a1080 con 0x55ae5b75a7a0 2023-11-06T13:28:15.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54ec08b380 con 0x55ae5b75a7a0 2023-11-06T13:28:15.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54d97fa700 1 -- 172.21.15.38:0/2175083093 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54ec001f70 con 0x55ae5b75a7a0 2023-11-06T13:28:15.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f551315fb80 10 client.4962 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:15.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ae5b4cef80 con 0x55ae5b75a7a0 2023-11-06T13:28:15.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.180+0000 7f54d97fa700 1 -- 172.21.15.38:0/2175083093 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec08b380 con 0x55ae5b75a7a0 2023-11-06T13:28:15.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f54d97fa700 1 -- 172.21.15.38:0/2175083093 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f54ec084a00 con 0x55ae5b75a7a0 2023-11-06T13:28:15.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 10 client.4962 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:15.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 10 client.4962 resolve_mds: resolved name 'l' to daemon mds.l 2023-11-06T13:28:15.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 20 client.4962 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b716b10 0x55ae5b7e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 4 client.4962 mds_command: new command op to 4361 tid=0[{"prefix": "status"}] 2023-11-06T13:28:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ae5b500ca0 con 0x55ae5b716b10 2023-11-06T13:28:15.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f54faffd700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b716b10 0x55ae5b7e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f54d97fa700 10 client.4962 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f54faffd700 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b716b10 0x55ae5b7e62f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4a90321d5754e81c server_cookie=ce8b49ddfb135886 in_seq=0 out_seq=0 2023-11-06T13:28:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f54d97fa700 1 -- 172.21.15.38:0/2175083093 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ae5b500ca0 con 0x55ae5b716b10 2023-11-06T13:28:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f54d97fa700 10 client.4962 handle_command_reply: tid=0 2023-11-06T13:28:15.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.181+0000 7f551315fb80 1 client.4962 shutdown 2023-11-06T13:28:15.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 msgr2=0x55ae5b78f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b78f510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f54ec007fd0 tx=0x7f54ec091000).stop 2023-11-06T13:28:15.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 shutdown_connections 2023-11-06T13:28:15.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ae5b75a7a0 0x55ae5b78f510 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ae5b4cde40 0x55ae5b711460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ae5b716b10 0x55ae5b7e62f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 --2- 172.21.15.38:0/2175083093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ae5b752950 0x55ae5b7e5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f54d97fa700 0 client.4962 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:15.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 >> 172.21.15.38:0/2175083093 conn(0x55ae5b57b4a0 msgr2=0x55ae5b776e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 shutdown_connections 2023-11-06T13:28:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 1 -- 172.21.15.38:0/2175083093 wait complete. 2023-11-06T13:28:15.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f551315fb80 20 client.4962 trim_cache size 0 max 16384 2023-11-06T13:28:15.224 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:15.225 INFO:teuthology.orchestra.run.smithi038.stdout: "cluster_fsid": "678c2a34-c65e-414a-9c54-b10698be691f", 2023-11-06T13:28:15.225 INFO:teuthology.orchestra.run.smithi038.stdout: "whoami": 0, 2023-11-06T13:28:15.225 INFO:teuthology.orchestra.run.smithi038.stdout: "id": 4361, 2023-11-06T13:28:15.225 INFO:teuthology.orchestra.run.smithi038.stdout: "want_state": "up:active", 2023-11-06T13:28:15.226 INFO:teuthology.orchestra.run.smithi038.stdout: "state": "up:active", 2023-11-06T13:28:15.226 INFO:teuthology.orchestra.run.smithi038.stdout: "fs_name": "cephfs", 2023-11-06T13:28:15.226 INFO:teuthology.orchestra.run.smithi038.stdout: "rank_uptime": 33.290334497000003, 2023-11-06T13:28:15.226 INFO:teuthology.orchestra.run.smithi038.stdout: "mdsmap_epoch": 17, 2023-11-06T13:28:15.226 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch": 31, 2023-11-06T13:28:15.227 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_epoch_barrier": 31, 2023-11-06T13:28:15.227 INFO:teuthology.orchestra.run.smithi038.stdout: "uptime": 37.695172282000001 2023-11-06T13:28:15.227 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:15.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f54dc08cbd0 msgr2=0x7f54dc08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f54dc08cbd0 0x7f54dc08f090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f54f4009270 tx=0x7f54f4008040).stop 2023-11-06T13:28:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 msgr2=0x7f54fc190540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 0x7f54fc190540 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f54ec000f80 tx=0x7f54ec007f20).stop 2023-11-06T13:28:15.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 shutdown_connections 2023-11-06T13:28:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f54fc1900c0 0x7f54fc190540 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54e8004690 0x7f54fc0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f54dc08cbd0 0x7f54dc08f090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 --2- 172.21.15.38:0/2459643290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54fc0f19a0 0x7f54fc0f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 >> 172.21.15.38:0/2459643290 conn(0x7f54fc0f5c60 msgr2=0x7f54fc0c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 shutdown_connections 2023-11-06T13:28:15.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.182+0000 7f55017c7700 1 -- 172.21.15.38:0/2459643290 wait complete. 2023-11-06T13:28:15.231 INFO:teuthology.run_tasks:Running task kclient... 2023-11-06T13:28:15.246 INFO:tasks.kclient:Mounting kernel clients... 2023-11-06T13:28:15.247 INFO:tasks.kclient:config is {'client.0': {}} 2023-11-06T13:28:15.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.247 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-11-06T13:28:15.263 INFO:teuthology.orchestra.run.smithi038.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-06T13:28:15.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-06T13:28:15.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link delete ceph-brx 2023-11-06T13:28:15.432 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'mount_subvol_num': 1} 2023-11-06T13:28:15.433 DEBUG:teuthology.orchestra.run.smithi038:> ceph fs ls 2023-11-06T13:28:15.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.536+0000 7ff9333e4700 1 Processor -- start 2023-11-06T13:28:15.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.536+0000 7ff9333e4700 1 -- start start 2023-11-06T13:28:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff9333e4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff92c154b70 0x7ff92c155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff9333e4700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff92c179460 0x7ff92c1798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff9333e4700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c17a400 con 0x7ff92c171970 2023-11-06T13:28:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff9333e4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c17b780 con 0x7ff92c154b70 2023-11-06T13:28:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff9333e4700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c17a6e0 con 0x7ff92c179460 2023-11-06T13:28:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff93097f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff92c154b70 0x7ff92c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff93097f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ff92c154b70 0x7ff92c155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48892/0 (socket says 172.21.15.38:48892) 2023-11-06T13:28:15.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff93097f700 1 -- 172.21.15.38:0/1327084818 learned_addr learned my addr 172.21.15.38:0/1327084818 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.537+0000 7ff931981700 1 --2- 172.21.15.38:0/1327084818 >> v2:172.21.15.163:3300/0 conn(0x7ff92c179460 0x7ff92c1798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff93097f700 1 -- 172.21.15.38:0/1327084818 >> v2:172.21.15.163:3300/0 conn(0x7ff92c179460 msgr2=0x7ff92c1798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff93097f700 1 --2- 172.21.15.38:0/1327084818 >> v2:172.21.15.163:3300/0 conn(0x7ff92c179460 0x7ff92c1798d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff93097f700 1 -- 172.21.15.38:0/1327084818 >> v1:172.21.15.163:6789/0 conn(0x7ff92c171970 legacy=0x7ff92c171d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff93097f700 1 -- 172.21.15.38:0/1327084818 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c17a9c0 con 0x7ff92c154b70 2023-11-06T13:28:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff93097f700 1 --2- 172.21.15.38:0/1327084818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c154b70 0x7ff92c155000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7ff92c0e9350 tx=0x7ff9200090f0).ready entity=mon.0 client_cookie=f72aeebd6a97caf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff92bfff700 1 -- 172.21.15.38:0/1327084818 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000b600 con 0x7ff92c154b70 2023-11-06T13:28:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff92bfff700 1 -- 172.21.15.38:0/1327084818 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000b760 con 0x7ff92c154b70 2023-11-06T13:28:15.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff92bfff700 1 -- 172.21.15.38:0/1327084818 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000bae0 con 0x7ff92c154b70 2023-11-06T13:28:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff9333e4700 1 -- 172.21.15.38:0/1327084818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c154b70 msgr2=0x7ff92c155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff9333e4700 1 --2- 172.21.15.38:0/1327084818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c154b70 0x7ff92c155000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7ff92c0e9350 tx=0x7ff9200090f0).stop 2023-11-06T13:28:15.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff9333e4700 1 -- 172.21.15.38:0/1327084818 shutdown_connections 2023-11-06T13:28:15.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff9333e4700 1 --2- 172.21.15.38:0/1327084818 >> v2:172.21.15.163:3300/0 conn(0x7ff92c179460 0x7ff92c1798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff9333e4700 1 --2- 172.21.15.38:0/1327084818 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c154b70 0x7ff92c155000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.538+0000 7ff9333e4700 1 -- 172.21.15.38:0/1327084818 >> 172.21.15.38:0/1327084818 conn(0x7ff92c0eeb00 msgr2=0x7ff92c0eef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.539+0000 7ff9333e4700 1 -- 172.21.15.38:0/1327084818 shutdown_connections 2023-11-06T13:28:15.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.539+0000 7ff9333e4700 1 -- 172.21.15.38:0/1327084818 wait complete. 2023-11-06T13:28:15.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.540+0000 7ff9333e4700 1 Processor -- start 2023-11-06T13:28:15.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.540+0000 7ff9333e4700 1 -- start start 2023-11-06T13:28:15.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.541+0000 7ff9333e4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff92c154b70 0x7ff92c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.541+0000 7ff9333e4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c171970 0x7ff92c175210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.541+0000 7ff9333e4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 0x7ff92c18cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9333e4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c173e90 con 0x7ff92c179460 2023-11-06T13:28:15.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9333e4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c174170 con 0x7ff92c154b70 2023-11-06T13:28:15.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9333e4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c174450 con 0x7ff92c171970 2023-11-06T13:28:15.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 0x7ff92c18cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 0x7ff92c18cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48906/0 (socket says 172.21.15.38:48906) 2023-11-06T13:28:15.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff93097f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c171970 0x7ff92c175210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 -- 172.21.15.38:0/2804576751 learned_addr learned my addr 172.21.15.38:0/2804576751 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:15.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931180700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff92c154b70 0x7ff92c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 -- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c171970 msgr2=0x7ff92c175210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c171970 0x7ff92c175210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 -- 172.21.15.38:0/2804576751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff92c154b70 msgr2=0x7ff92c14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff92c154b70 0x7ff92c14dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 -- 172.21.15.38:0/2804576751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920009370 con 0x7ff92c179460 2023-11-06T13:28:15.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff931981700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 0x7ff92c18cfb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff91c007f20 tx=0x7ff91c009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00ebf0 con 0x7ff92c179460 2023-11-06T13:28:15.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00ed50 con 0x7ff92c179460 2023-11-06T13:28:15.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c174730 con 0x7ff92c179460 2023-11-06T13:28:15.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c014610 con 0x7ff92c179460 2023-11-06T13:28:15.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.542+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c174cf0 con 0x7ff92c179460 2023-11-06T13:28:15.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.543+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c174f10 con 0x7ff92c179460 2023-11-06T13:28:15.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.544+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff91c01d3b0 con 0x7ff92c179460 2023-11-06T13:28:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.545+0000 7ff9297fa700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cbd0 0x7ff91808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.545+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff91c0b2ce0 con 0x7ff92c179460 2023-11-06T13:28:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.545+0000 7ff931180700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cbd0 0x7ff91808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.545+0000 7ff931180700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cbd0 0x7ff91808f090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff924000c00 tx=0x7ff924009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:15.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.548+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff91c083220 con 0x7ff92c179460 2023-11-06T13:28:15.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.766+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff92c0008d0 con 0x7ff92c179460 2023-11-06T13:28:15.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.766+0000 7ff9297fa700 1 -- 172.21.15.38:0/2804576751 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff91c019020 con 0x7ff92c179460 2023-11-06T13:28:15.770 INFO:teuthology.orchestra.run.smithi038.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-06T13:28:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cbd0 msgr2=0x7ff91808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cbd0 0x7ff91808f090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff924000c00 tx=0x7ff924009040).stop 2023-11-06T13:28:15.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 msgr2=0x7ff92c18cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 0x7ff92c18cfb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff91c007f20 tx=0x7ff91c009860).stop 2023-11-06T13:28:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 shutdown_connections 2023-11-06T13:28:15.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c179460 0x7ff92c18cfb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cbd0 0x7ff91808f090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff92c154b70 0x7ff92c14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 --2- 172.21.15.38:0/2804576751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c171970 0x7ff92c175210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:15.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 >> 172.21.15.38:0/2804576751 conn(0x7ff92c0eeb00 msgr2=0x7ff92c0f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:15.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 shutdown_connections 2023-11-06T13:28:15.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:15.768+0000 7ff9333e4700 1 -- 172.21.15.38:0/2804576751 wait complete. 2023-11-06T13:28:15.782 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-06T13:28:15.782 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-06T13:28:15.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi038.front.sepia.ceph.com 2023-11-06T13:28:15.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-06T13:28:15.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-06T13:28:15.784 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-06T13:28:15.784 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-06T13:28:15.784 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-06T13:28:15.785 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-06T13:28:15.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.785 DEBUG:teuthology.orchestra.run.smithi038:> ip addr 2023-11-06T13:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-06T13:28:15.801 INFO:teuthology.orchestra.run.smithi038.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-06T13:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: inet 127.0.0.1/8 scope host lo 2023-11-06T13:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-11-06T13:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 ::1/128 scope host 2023-11-06T13:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-11-06T13:28:15.802 INFO:teuthology.orchestra.run.smithi038.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-06T13:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a2 brd ff:ff:ff:ff:ff:ff 2023-11-06T13:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f0 2023-11-06T13:28:15.803 INFO:teuthology.orchestra.run.smithi038.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-06T13:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:6b:fd:a3 brd ff:ff:ff:ff:ff:ff 2023-11-06T13:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp7s0f1 2023-11-06T13:28:15.804 INFO:teuthology.orchestra.run.smithi038.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-06T13:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fc brd ff:ff:ff:ff:ff:ff 2023-11-06T13:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f0 2023-11-06T13:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: inet 172.21.15.38/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-06T13:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-11-06T13:28:15.805 INFO:teuthology.orchestra.run.smithi038.stdout: inet6 fe80::ec4:7aff:febd:15fc/64 scope link 2023-11-06T13:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: valid_lft forever preferred_lft forever 2023-11-06T13:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-06T13:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: link/ether 0c:c4:7a:bd:15:fd brd ff:ff:ff:ff:ff:ff 2023-11-06T13:28:15.806 INFO:teuthology.orchestra.run.smithi038.stdout: altname enp1s0f1 2023-11-06T13:28:15.807 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-06T13:28:15.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.807 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:28:15.808 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:28:15.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add name ceph-brx type bridge 2023-11-06T13:28:15.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr flush dev ceph-brx 2023-11-06T13:28:15.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set ceph-brx up 2023-11-06T13:28:15.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-06T13:28:15.809 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:28:15.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.923 DEBUG:teuthology.orchestra.run.smithi038:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-06T13:28:15.947 INFO:teuthology.orchestra.run.smithi038.stdout:1 2023-11-06T13:28:15.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:15.949 DEBUG:teuthology.orchestra.run.smithi038:> route 2023-11-06T13:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout:Kernel IP routing table 2023-11-06T13:28:16.006 INFO:teuthology.orchestra.run.smithi038.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-06T13:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-06T13:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-06T13:28:16.007 INFO:teuthology.orchestra.run.smithi038.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-06T13:28:16.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.008 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:28:16.008 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:28:16.008 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-06T13:28:16.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-06T13:28:16.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-06T13:28:16.009 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:28:16.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.112 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list 2023-11-06T13:28:16.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.128 DEBUG:teuthology.orchestra.run.smithi038:> ip netns list-id 2023-11-06T13:28:16.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.185 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:28:16.186 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:28:16.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-06T13:28:16.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-06T13:28:16.189 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:28:16.275 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-06T13:28:16.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.276 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:28:16.276 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:28:16.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-06T13:28:16.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-06T13:28:16.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-06T13:28:16.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-06T13:28:16.278 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-06T13:28:16.278 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:28:16.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.466 DEBUG:teuthology.orchestra.run.smithi038:> (cd / && exec bash -c ' 2023-11-06T13:28:16.466 DEBUG:teuthology.orchestra.run.smithi038:> set -e 2023-11-06T13:28:16.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set brx.0 up 2023-11-06T13:28:16.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo ip link set dev brx.0 master ceph-brx 2023-11-06T13:28:16.467 DEBUG:teuthology.orchestra.run.smithi038:> ') 2023-11-06T13:28:16.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.561 DEBUG:teuthology.orchestra.run.smithi038:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-11-06T13:28:16.576 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-11-06T13:28:16.577 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes,ms_mode=secure,nowsync 2023-11-06T13:28:16.657 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes,ms_mode=secure,nowsync 2023-11-06T13:28:16.658 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes,ms_mode=secure,nowsync" will pass to kernel. 2023-11-06T13:28:16.773 INFO:teuthology.orchestra.run.smithi038.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes,ms_mode=secure,nowsync 2023-11-06T13:28:16.773 INFO:teuthology.orchestra.run.smithi038.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes,ms_mode=secure,nowsync" will pass to kernel. 2023-11-06T13:28:16.775 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-06T13:28:16.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-06T13:28:16.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-06T13:28:16.844 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-11-06T13:28:16.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:17.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:16.999+0000 7f4ae5b42700 1 Processor -- start 2023-11-06T13:28:17.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:16.999+0000 7f4ae5b42700 1 -- start start 2023-11-06T13:28:17.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4ae5b42700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4ae01756e0 0x7f4ae00640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4ae5b42700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ae00645d0 0x7f4ae017de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4ae5b42700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae017d9d0 con 0x7f4ae017e350 2023-11-06T13:28:17.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4ae5b42700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae00c8560 con 0x7f4ae00645d0 2023-11-06T13:28:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4ae5b42700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae0064a50 con 0x7f4ae01756e0 2023-11-06T13:28:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ae00645d0 0x7f4ae017de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f4ae00645d0 0x7f4ae017de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48248/0 (socket says 172.21.15.38:48248) 2023-11-06T13:28:17.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 -- 172.21.15.38:0/3327461152 learned_addr learned my addr 172.21.15.38:0/3327461152 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adf7fe700 1 --2- 172.21.15.38:0/3327461152 >> v2:172.21.15.163:3300/0 conn(0x7f4ae01756e0 0x7f4ae00640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 -- 172.21.15.38:0/3327461152 >> v2:172.21.15.163:3300/0 conn(0x7f4ae01756e0 msgr2=0x7f4ae00640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 --2- 172.21.15.38:0/3327461152 >> v2:172.21.15.163:3300/0 conn(0x7f4ae01756e0 0x7f4ae00640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 -- 172.21.15.38:0/3327461152 >> v1:172.21.15.44:6789/0 conn(0x7f4ae017e350 legacy=0x7f4ae00f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:17.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.000+0000 7f4adeffd700 1 -- 172.21.15.38:0/3327461152 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae017c800 con 0x7f4ae00645d0 2023-11-06T13:28:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4adf7fe700 1 --2- 172.21.15.38:0/3327461152 >> v2:172.21.15.163:3300/0 conn(0x7f4ae01756e0 0x7f4ae00640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4adeffd700 1 --2- 172.21.15.38:0/3327461152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae00645d0 0x7f4ae017de60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f4ae00ce060 tx=0x7f4ad40090f0).ready entity=mon.0 client_cookie=e678fee7896de3f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ade7fc700 1 -- 172.21.15.38:0/3327461152 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400b5a0 con 0x7f4ae00645d0 2023-11-06T13:28:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ade7fc700 1 -- 172.21.15.38:0/3327461152 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400b700 con 0x7f4ae00645d0 2023-11-06T13:28:17.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ade7fc700 1 -- 172.21.15.38:0/3327461152 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400ba80 con 0x7f4ae00645d0 2023-11-06T13:28:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 -- 172.21.15.38:0/3327461152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae00645d0 msgr2=0x7f4ae017de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/3327461152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae00645d0 0x7f4ae017de60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f4ae00ce060 tx=0x7f4ad40090f0).stop 2023-11-06T13:28:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 -- 172.21.15.38:0/3327461152 shutdown_connections 2023-11-06T13:28:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/3327461152 >> v2:172.21.15.163:3300/0 conn(0x7f4ae01756e0 0x7f4ae00640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/3327461152 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae00645d0 0x7f4ae017de60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 -- 172.21.15.38:0/3327461152 >> 172.21.15.38:0/3327461152 conn(0x7f4ae0069ea0 msgr2=0x7f4ae006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 -- 172.21.15.38:0/3327461152 shutdown_connections 2023-11-06T13:28:17.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.001+0000 7f4ae5b42700 1 -- 172.21.15.38:0/3327461152 wait complete. 2023-11-06T13:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.003+0000 7f4ae5b42700 1 Processor -- start 2023-11-06T13:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.003+0000 7f4ae5b42700 1 -- start start 2023-11-06T13:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4ae5b42700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ae00645d0 0x7f4ae00c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4ae5b42700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 0x7f4ae016e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4ae5b42700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae017e350 0x7f4ae016eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4ae5b42700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae016efe0 con 0x7f4ae01756e0 2023-11-06T13:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4ae5b42700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00ca070 con 0x7f4ae017e350 2023-11-06T13:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4ae5b42700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00c8f10 con 0x7f4ae00645d0 2023-11-06T13:28:17.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 0x7f4ae016e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 0x7f4ae016e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48258/0 (socket says 172.21.15.38:48258) 2023-11-06T13:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 -- 172.21.15.38:0/2197043918 learned_addr learned my addr 172.21.15.38:0/2197043918 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adf7fe700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ae00645d0 0x7f4ae00c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 -- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ae00645d0 msgr2=0x7f4ae00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ae00645d0 0x7f4ae00c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 -- 172.21.15.38:0/2197043918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae017e350 msgr2=0x7f4ae016eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adffff700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae017e350 0x7f4ae016eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae017e350 0x7f4ae016eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 -- 172.21.15.38:0/2197043918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4009370 con 0x7f4ae01756e0 2023-11-06T13:28:17.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.004+0000 7f4adeffd700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 0x7f4ae016e600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f4ae006ac20 tx=0x7f4ad4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.005+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400b870 con 0x7f4ae01756e0 2023-11-06T13:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.005+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400b9d0 con 0x7f4ae01756e0 2023-11-06T13:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.005+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae00c9180 con 0x7f4ae01756e0 2023-11-06T13:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.005+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad401b640 con 0x7f4ae01756e0 2023-11-06T13:28:17.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.005+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae00c9740 con 0x7f4ae01756e0 2023-11-06T13:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.006+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae006c580 con 0x7f4ae01756e0 2023-11-06T13:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.006+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f4ad401b9b0 con 0x7f4ae01756e0 2023-11-06T13:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.007+0000 7f4ac77fe700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4acc08cbd0 0x7f4acc08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.007+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f4ad40b3f70 con 0x7f4ae01756e0 2023-11-06T13:28:17.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.007+0000 7f4adf7fe700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4acc08cbd0 0x7f4acc08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.008+0000 7f4adf7fe700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4acc08cbd0 0x7f4acc08f090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4ad0006fd0 tx=0x7f4ad0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.010+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f4ad40844b0 con 0x7f4ae01756e0 2023-11-06T13:28:17.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.184+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae017cae0 con 0x7f4ae01756e0 2023-11-06T13:28:17.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.186+0000 7f4ac77fe700 1 -- 172.21.15.38:0/2197043918 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f4ad4029090 con 0x7f4ae01756e0 2023-11-06T13:28:17.189 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:17.189 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:17.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4acc08cbd0 msgr2=0x7f4acc08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4acc08cbd0 0x7f4acc08f090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f4ad0006fd0 tx=0x7f4ad0008040).stop 2023-11-06T13:28:17.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 msgr2=0x7f4ae016e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 0x7f4ae016e600 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f4ae006ac20 tx=0x7f4ad4015000).stop 2023-11-06T13:28:17.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 shutdown_connections 2023-11-06T13:28:17.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f4acc08cbd0 0x7f4acc08f090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ae017e350 0x7f4ae016eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4ae00645d0 0x7f4ae00c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 --2- 172.21.15.38:0/2197043918 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4ae01756e0 0x7f4ae016e600 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 >> 172.21.15.38:0/2197043918 conn(0x7f4ae0069ea0 msgr2=0x7f4ae00f3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 shutdown_connections 2023-11-06T13:28:17.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.187+0000 7f4ae5b42700 1 -- 172.21.15.38:0/2197043918 wait complete. 2023-11-06T13:28:17.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-06T13:27:40.368418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-06T13:27:40.848313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-06T13:27:43.934481+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-06T13:28:17.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:28:17.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.324+0000 7fd4f7925700 1 Processor -- start 2023-11-06T13:28:17.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.324+0000 7fd4f7925700 1 -- start start 2023-11-06T13:28:17.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f7925700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd4f017cde0 0x7fd4f017d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f7925700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4f017d760 0x7fd4f017eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f7925700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f00c1490 con 0x7fd4f0175b50 2023-11-06T13:28:17.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f7925700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f017c920 con 0x7fd4f017d760 2023-11-06T13:28:17.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f7925700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f00c1770 con 0x7fd4f017cde0 2023-11-06T13:28:17.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f5ec2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd4f017d760 0x7fd4f017eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f56c1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fd4f0175b50 0x7fd4f00c5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50014/0 (socket says 172.21.15.38:50014) 2023-11-06T13:28:17.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f56c1700 1 -- 172.21.15.38:0/157996232 learned_addr learned my addr 172.21.15.38:0/157996232 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:17.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f4ec0700 1 --2- 172.21.15.38:0/157996232 >> v2:172.21.15.44:3300/0 conn(0x7fd4f017cde0 0x7fd4f017d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f5ec2700 1 -- 172.21.15.38:0/157996232 >> v2:172.21.15.44:3300/0 conn(0x7fd4f017cde0 msgr2=0x7fd4f017d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:17.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f5ec2700 1 --2- 172.21.15.38:0/157996232 >> v2:172.21.15.44:3300/0 conn(0x7fd4f017cde0 0x7fd4f017d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f5ec2700 1 -- 172.21.15.38:0/157996232 >> v1:172.21.15.38:6789/0 conn(0x7fd4f0175b50 legacy=0x7fd4f00c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4effff700 1 -- 172.21.15.38:0/157996232 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449438910 0 0) 0x7fd4f00c1490 con 0x7fd4f0175b50 2023-11-06T13:28:17.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f5ec2700 1 -- 172.21.15.38:0/157996232 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f00c1a50 con 0x7fd4f017d760 2023-11-06T13:28:17.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.325+0000 7fd4f4ec0700 1 --2- 172.21.15.38:0/157996232 >> v2:172.21.15.44:3300/0 conn(0x7fd4f017cde0 0x7fd4f017d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:17.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f5ec2700 1 --2- 172.21.15.38:0/157996232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f017d760 0x7fd4f017eee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fd4f00f0f40 tx=0x7fd4e0009780).ready entity=mon.0 client_cookie=a77d6c8718cd2d04 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4effff700 1 -- 172.21.15.38:0/157996232 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000e070 con 0x7fd4f017d760 2023-11-06T13:28:17.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4effff700 1 -- 172.21.15.38:0/157996232 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000bc30 con 0x7fd4f017d760 2023-11-06T13:28:17.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4effff700 1 -- 172.21.15.38:0/157996232 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0012410 con 0x7fd4f017d760 2023-11-06T13:28:17.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 -- 172.21.15.38:0/157996232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f017d760 msgr2=0x7fd4f017eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 --2- 172.21.15.38:0/157996232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f017d760 0x7fd4f017eee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fd4f00f0f40 tx=0x7fd4e0009780).stop 2023-11-06T13:28:17.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 -- 172.21.15.38:0/157996232 shutdown_connections 2023-11-06T13:28:17.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 --2- 172.21.15.38:0/157996232 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f017d760 0x7fd4f017eee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 --2- 172.21.15.38:0/157996232 >> v2:172.21.15.44:3300/0 conn(0x7fd4f017cde0 0x7fd4f017d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 -- 172.21.15.38:0/157996232 >> 172.21.15.38:0/157996232 conn(0x7fd4f005e1b0 msgr2=0x7fd4f005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 -- 172.21.15.38:0/157996232 shutdown_connections 2023-11-06T13:28:17.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.326+0000 7fd4f7925700 1 -- 172.21.15.38:0/157996232 wait complete. 2023-11-06T13:28:17.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.328+0000 7fd4f7925700 1 Processor -- start 2023-11-06T13:28:17.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.328+0000 7fd4f7925700 1 -- start start 2023-11-06T13:28:17.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f7925700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 0x7fd4f0163190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f7925700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4f017cde0 0x7fd4f0190990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f7925700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4f017d760 0x7fd4f0190e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f7925700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f018b170 con 0x7fd4f0175b50 2023-11-06T13:28:17.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f7925700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f016eaa0 con 0x7fd4f017d760 2023-11-06T13:28:17.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f7925700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f016ed80 con 0x7fd4f017cde0 2023-11-06T13:28:17.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 0x7fd4f0163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 0x7fd4f0163190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48270/0 (socket says 172.21.15.38:48270) 2023-11-06T13:28:17.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 -- 172.21.15.38:0/493723678 learned_addr learned my addr 172.21.15.38:0/493723678 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:17.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f4ec0700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4f017cde0 0x7fd4f0190990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f5ec2700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4f017d760 0x7fd4f0190e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 -- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4f017cde0 msgr2=0x7fd4f0190990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4f017cde0 0x7fd4f0190990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 -- 172.21.15.38:0/493723678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4f017d760 msgr2=0x7fd4f0190e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4f017d760 0x7fd4f0190e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 -- 172.21.15.38:0/493723678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e0009a20 con 0x7fd4f0175b50 2023-11-06T13:28:17.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f4ec0700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4f017cde0 0x7fd4f0190990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:17.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f5ec2700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4f017d760 0x7fd4f0190e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:17.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.329+0000 7fd4f56c1700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 0x7fd4f0163190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fd4e800c490 tx=0x7fd4e8007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.330+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80072e0 con 0x7fd4f0175b50 2023-11-06T13:28:17.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.330+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e8007440 con 0x7fd4f0175b50 2023-11-06T13:28:17.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.330+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f016f060 con 0x7fd4f0175b50 2023-11-06T13:28:17.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.330+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80057a0 con 0x7fd4f0175b50 2023-11-06T13:28:17.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.330+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f016f620 con 0x7fd4f0175b50 2023-11-06T13:28:17.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.331+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f006c580 con 0x7fd4f0175b50 2023-11-06T13:28:17.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.331+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fd4e8005b90 con 0x7fd4f0175b50 2023-11-06T13:28:17.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.332+0000 7fd4ed7fa700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd4dc08cbd0 0x7fd4dc08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.332+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fd4e80b18e0 con 0x7fd4f0175b50 2023-11-06T13:28:17.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.332+0000 7fd4f4ec0700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd4dc08cbd0 0x7fd4dc08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.333+0000 7fd4f4ec0700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd4dc08cbd0 0x7fd4dc08f090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd4e4006fd0 tx=0x7fd4e4008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.336+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fd4e8081e20 con 0x7fd4f0175b50 2023-11-06T13:28:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.510+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd4f00833f0 con 0x7fd4f0175b50 2023-11-06T13:28:17.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.510+0000 7fd4ed7fa700 1 -- 172.21.15.38:0/493723678 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd4e8018020 con 0x7fd4f0175b50 2023-11-06T13:28:17.514 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:28:17.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd4dc08cbd0 msgr2=0x7fd4dc08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd4dc08cbd0 0x7fd4dc08f090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd4e4006fd0 tx=0x7fd4e4008040).stop 2023-11-06T13:28:17.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 msgr2=0x7fd4f0163190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 0x7fd4f0163190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fd4e800c490 tx=0x7fd4e8007e40).stop 2023-11-06T13:28:17.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 shutdown_connections 2023-11-06T13:28:17.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd4dc08cbd0 0x7fd4dc08f090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4f017d760 0x7fd4f0190e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd4f0175b50 0x7fd4f0163190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 --2- 172.21.15.38:0/493723678 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd4f017cde0 0x7fd4f0190990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 >> 172.21.15.38:0/493723678 conn(0x7fd4f005e1b0 msgr2=0x7fd4f0167640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 shutdown_connections 2023-11-06T13:28:17.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.512+0000 7fd4f7925700 1 -- 172.21.15.38:0/493723678 wait complete. 2023-11-06T13:28:17.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:28:17.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.646+0000 7fb2c359e700 1 Processor -- start 2023-11-06T13:28:17.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.646+0000 7fb2c359e700 1 -- start start 2023-11-06T13:28:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb2c4175970 0x7fb2c417e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c359e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2c41823f0 0x7fb2c4182840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c359e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c417d550 con 0x7fb2c4175590 2023-11-06T13:28:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c359e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c417fad0 con 0x7fb2c41823f0 2023-11-06T13:28:17.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c4085ad0 con 0x7fb2c4175970 2023-11-06T13:28:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c2d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2c41823f0 0x7fb2c4182840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c2d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb2c41823f0 0x7fb2c4182840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48280/0 (socket says 172.21.15.38:48280) 2023-11-06T13:28:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c2d9d700 1 -- 172.21.15.38:0/3391262330 learned_addr learned my addr 172.21.15.38:0/3391262330 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.647+0000 7fb2c1d9b700 1 --2- 172.21.15.38:0/3391262330 >> v2:172.21.15.44:3300/0 conn(0x7fb2c4175970 0x7fb2c417e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c2d9d700 1 -- 172.21.15.38:0/3391262330 >> v2:172.21.15.44:3300/0 conn(0x7fb2c4175970 msgr2=0x7fb2c417e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c2d9d700 1 --2- 172.21.15.38:0/3391262330 >> v2:172.21.15.44:3300/0 conn(0x7fb2c4175970 0x7fb2c417e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c2d9d700 1 -- 172.21.15.38:0/3391262330 >> v1:172.21.15.163:6789/0 conn(0x7fb2c4175590 legacy=0x7fb2c417d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c2d9d700 1 -- 172.21.15.38:0/3391262330 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c417c940 con 0x7fb2c41823f0 2023-11-06T13:28:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c2d9d700 1 --2- 172.21.15.38:0/3391262330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c41823f0 0x7fb2c4182840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb2c40f11f0 tx=0x7fb2b4009840).ready entity=mon.0 client_cookie=be825d8f47924a96 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c159a700 1 -- 172.21.15.38:0/3391262330 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400e070 con 0x7fb2c41823f0 2023-11-06T13:28:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c159a700 1 -- 172.21.15.38:0/3391262330 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b400ba20 con 0x7fb2c41823f0 2023-11-06T13:28:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c159a700 1 -- 172.21.15.38:0/3391262330 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400bda0 con 0x7fb2c41823f0 2023-11-06T13:28:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c359e700 1 -- 172.21.15.38:0/3391262330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c41823f0 msgr2=0x7fb2c4182840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.648+0000 7fb2c359e700 1 --2- 172.21.15.38:0/3391262330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c41823f0 0x7fb2c4182840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fb2c40f11f0 tx=0x7fb2b4009840).stop 2023-11-06T13:28:17.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.649+0000 7fb2c359e700 1 -- 172.21.15.38:0/3391262330 shutdown_connections 2023-11-06T13:28:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.649+0000 7fb2c359e700 1 --2- 172.21.15.38:0/3391262330 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c41823f0 0x7fb2c4182840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.649+0000 7fb2c359e700 1 --2- 172.21.15.38:0/3391262330 >> v2:172.21.15.44:3300/0 conn(0x7fb2c4175970 0x7fb2c417e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.649+0000 7fb2c359e700 1 -- 172.21.15.38:0/3391262330 >> 172.21.15.38:0/3391262330 conn(0x7fb2c40f5d10 msgr2=0x7fb2c40f1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.649+0000 7fb2c359e700 1 -- 172.21.15.38:0/3391262330 shutdown_connections 2023-11-06T13:28:17.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.649+0000 7fb2c359e700 1 -- 172.21.15.38:0/3391262330 wait complete. 2023-11-06T13:28:17.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.650+0000 7fb2c359e700 1 Processor -- start 2023-11-06T13:28:17.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.650+0000 7fb2c359e700 1 -- start start 2023-11-06T13:28:17.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 0x7fb2c4085300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2c4175970 0x7fb2c4083bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c359e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2c41823f0 0x7fb2c41713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c359e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4085e90 con 0x7fb2c4175590 2023-11-06T13:28:17.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40840b0 con 0x7fb2c4175970 2023-11-06T13:28:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c359e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4084320 con 0x7fb2c41823f0 2023-11-06T13:28:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 0x7fb2c4085300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 0x7fb2c4085300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48296/0 (socket says 172.21.15.38:48296) 2023-11-06T13:28:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 -- 172.21.15.38:0/2519963111 learned_addr learned my addr 172.21.15.38:0/2519963111 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:17.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c2d9d700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2c41823f0 0x7fb2c41713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c1d9b700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2c4175970 0x7fb2c4083bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 -- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2c41823f0 msgr2=0x7fb2c41713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2c41823f0 0x7fb2c41713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 -- 172.21.15.38:0/2519963111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2c4175970 msgr2=0x7fb2c4083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2c4175970 0x7fb2c4083bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.651+0000 7fb2c259c700 1 -- 172.21.15.38:0/2519963111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4009ae0 con 0x7fb2c4175590 2023-11-06T13:28:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.652+0000 7fb2c259c700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 0x7fb2c4085300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fb2bc00c440 tx=0x7fb2bc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.652+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc012400 con 0x7fb2c4175590 2023-11-06T13:28:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.652+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc012560 con 0x7fb2c4175590 2023-11-06T13:28:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.652+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c4084600 con 0x7fb2c4175590 2023-11-06T13:28:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.652+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc012900 con 0x7fb2c4175590 2023-11-06T13:28:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.652+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c4084bc0 con 0x7fb2c4175590 2023-11-06T13:28:17.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.653+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c40475a0 con 0x7fb2c4175590 2023-11-06T13:28:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.654+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7fb2bc01b3b0 con 0x7fb2c4175590 2023-11-06T13:28:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.654+0000 7fb2ba7fc700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb2a408cbd0 0x7fb2a408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.654+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7fb2bc0b1840 con 0x7fb2c4175590 2023-11-06T13:28:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.654+0000 7fb2c1d9b700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb2a408cbd0 0x7fb2a408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.655+0000 7fb2c1d9b700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb2a408cbd0 0x7fb2a408f090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb2ac009270 tx=0x7fb2ac008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.658+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fb2bc081d80 con 0x7fb2c4175590 2023-11-06T13:28:17.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.831+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb2c40f1220 con 0x7fb2c4175590 2023-11-06T13:28:17.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.831+0000 7fb2ba7fc700 1 -- 172.21.15.38:0/2519963111 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb2bc017020 con 0x7fb2c4175590 2023-11-06T13:28:17.835 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:28:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb2a408cbd0 msgr2=0x7fb2a408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb2a408cbd0 0x7fb2a408f090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb2ac009270 tx=0x7fb2ac008040).stop 2023-11-06T13:28:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 msgr2=0x7fb2c4085300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 0x7fb2c4085300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fb2bc00c440 tx=0x7fb2bc007db0).stop 2023-11-06T13:28:17.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 shutdown_connections 2023-11-06T13:28:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2c41823f0 0x7fb2c41713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb2c4175590 0x7fb2c4085300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb2a408cbd0 0x7fb2a408f090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 --2- 172.21.15.38:0/2519963111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2c4175970 0x7fb2c4083bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 >> 172.21.15.38:0/2519963111 conn(0x7fb2c40f5d10 msgr2=0x7fb2c417ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 shutdown_connections 2023-11-06T13:28:17.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.833+0000 7fb2c359e700 1 -- 172.21.15.38:0/2519963111 wait complete. 2023-11-06T13:28:17.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-06T13:28:17.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.967+0000 7f5d67b32700 1 Processor -- start 2023-11-06T13:28:17.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.967+0000 7f5d67b32700 1 -- start start 2023-11-06T13:28:17.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.968+0000 7f5d67b32700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5d6017e260 0x7f5d6017e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d67b32700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6017ddd0 con 0x7f5d60183830 2023-11-06T13:28:17.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d67b32700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d60064780 con 0x7f5d60175a40 2023-11-06T13:28:17.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d67b32700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600c4c20 con 0x7f5d6017e260 2023-11-06T13:28:17.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d660cf700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5d60183830 0x7f5d60185c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50024/0 (socket says 172.21.15.38:50024) 2023-11-06T13:28:17.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d660cf700 1 -- 172.21.15.38:0/3474000434 learned_addr learned my addr 172.21.15.38:0/3474000434 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:17.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d650cd700 1 --2- 172.21.15.38:0/3474000434 >> v2:172.21.15.44:3300/0 conn(0x7f5d6017e260 0x7f5d6017e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d648cc700 1 -- 172.21.15.38:0/3474000434 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106241782 0 0) 0x7f5d6017ddd0 con 0x7f5d60183830 2023-11-06T13:28:17.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d648cc700 1 -- 172.21.15.38:0/3474000434 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d480033f0 con 0x7f5d60183830 2023-11-06T13:28:17.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d650cd700 1 -- 172.21.15.38:0/3474000434 >> v1:172.21.15.163:6789/0 conn(0x7f5d60175a40 legacy=0x7f5d6017f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d650cd700 1 -- 172.21.15.38:0/3474000434 >> v1:172.21.15.38:6789/0 conn(0x7f5d60183830 legacy=0x7f5d60185c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d650cd700 1 -- 172.21.15.38:0/3474000434 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6017fda0 con 0x7f5d6017e260 2023-11-06T13:28:17.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d650cd700 1 --2- 172.21.15.38:0/3474000434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d6017e6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5d54009760 tx=0x7f5d54009060).ready entity=mon.1 client_cookie=c8d043769ebc823a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d648cc700 1 -- 172.21.15.38:0/3474000434 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400f510 con 0x7f5d6017e260 2023-11-06T13:28:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d648cc700 1 -- 172.21.15.38:0/3474000434 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400f670 con 0x7f5d6017e260 2023-11-06T13:28:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.969+0000 7f5d648cc700 1 -- 172.21.15.38:0/3474000434 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400f9f0 con 0x7f5d6017e260 2023-11-06T13:28:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 -- 172.21.15.38:0/3474000434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 msgr2=0x7f5d6017e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 --2- 172.21.15.38:0/3474000434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d6017e6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f5d54009760 tx=0x7f5d54009060).stop 2023-11-06T13:28:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 -- 172.21.15.38:0/3474000434 shutdown_connections 2023-11-06T13:28:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 --2- 172.21.15.38:0/3474000434 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d6017e6e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 -- 172.21.15.38:0/3474000434 >> 172.21.15.38:0/3474000434 conn(0x7f5d6006a970 msgr2=0x7f5d600f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 -- 172.21.15.38:0/3474000434 shutdown_connections 2023-11-06T13:28:17.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.970+0000 7f5d67b32700 1 -- 172.21.15.38:0/3474000434 wait complete. 2023-11-06T13:28:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.971+0000 7f5d67b32700 1 Processor -- start 2023-11-06T13:28:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.971+0000 7f5d67b32700 1 -- start start 2023-11-06T13:28:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.972+0000 7f5d67b32700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60175a40 0x7f5d60157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.972+0000 7f5d67b32700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d60171ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.972+0000 7f5d67b32700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 0x7f5d601723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.972+0000 7f5d67b32700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60182db0 con 0x7f5d60183830 2023-11-06T13:28:17.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.972+0000 7f5d67b32700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60181010 con 0x7f5d6017e260 2023-11-06T13:28:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.972+0000 7f5d67b32700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60180440 con 0x7f5d60175a40 2023-11-06T13:28:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 0x7f5d601723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 0x7f5d601723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48302/0 (socket says 172.21.15.38:48302) 2023-11-06T13:28:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 -- 172.21.15.38:0/2038000668 learned_addr learned my addr 172.21.15.38:0/2038000668 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:17.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d650cd700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d60171ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d658ce700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60175a40 0x7f5d60157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 -- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60175a40 msgr2=0x7f5d60157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60175a40 0x7f5d60157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 -- 172.21.15.38:0/2038000668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 msgr2=0x7f5d60171ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:17.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d60171ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:17.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 -- 172.21.15.38:0/2038000668 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540092a0 con 0x7f5d60183830 2023-11-06T13:28:17.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d660cf700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 0x7f5d601723d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5d580010e0 tx=0x7f5d58007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5800ce90 con 0x7f5d60183830 2023-11-06T13:28:17.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d580072e0 con 0x7f5d60183830 2023-11-06T13:28:17.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d601806e0 con 0x7f5d60183830 2023-11-06T13:28:17.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58007660 con 0x7f5d60183830 2023-11-06T13:28:17.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.973+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d60180ca0 con 0x7f5d60183830 2023-11-06T13:28:17.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.975+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d60180e60 con 0x7f5d60183830 2023-11-06T13:28:17.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.975+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f5d580059b0 con 0x7f5d60183830 2023-11-06T13:28:17.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.976+0000 7f5d5dffb700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d4c08cbd0 0x7f5d4c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:17.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.976+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f5d580b17c0 con 0x7f5d60183830 2023-11-06T13:28:17.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.976+0000 7f5d658ce700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d4c08cbd0 0x7f5d4c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:17.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.977+0000 7f5d658ce700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d4c08cbd0 0x7f5d4c08f090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5d50007fd0 tx=0x7f5d50009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:17.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:17.980+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f5d58081d00 con 0x7f5d60183830 2023-11-06T13:28:18.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.152+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d60180200 con 0x7f5d60183830 2023-11-06T13:28:18.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.152+0000 7f5d5dffb700 1 -- 172.21.15.38:0/2038000668 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d60180200 con 0x7f5d60183830 2023-11-06T13:28:18.156 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:18.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d4c08cbd0 msgr2=0x7f5d4c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d4c08cbd0 0x7f5d4c08f090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5d50007fd0 tx=0x7f5d50009040).stop 2023-11-06T13:28:18.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 msgr2=0x7f5d601723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 0x7f5d601723d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f5d580010e0 tx=0x7f5d58007c50).stop 2023-11-06T13:28:18.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 shutdown_connections 2023-11-06T13:28:18.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5d60183830 0x7f5d601723d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60175a40 0x7f5d60157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5d4c08cbd0 0x7f5d4c08f090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 --2- 172.21.15.38:0/2038000668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5d6017e260 0x7f5d60171ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 >> 172.21.15.38:0/2038000668 conn(0x7f5d6006a970 msgr2=0x7f5d600cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:18.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 shutdown_connections 2023-11-06T13:28:18.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.154+0000 7f5d67b32700 1 -- 172.21.15.38:0/2038000668 wait complete. 2023-11-06T13:28:18.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-06T13:28:18.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.289+0000 7f945b330700 1 Processor -- start 2023-11-06T13:28:18.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.289+0000 7f945b330700 1 -- start start 2023-11-06T13:28:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945b330700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9454175170 0x7f94540ecf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945b330700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94541759e0 con 0x7f945417f6c0 2023-11-06T13:28:18.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945b330700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94540ec210 con 0x7f9454175550 2023-11-06T13:28:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945b330700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94540ed5e0 con 0x7f9454175170 2023-11-06T13:28:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945a32e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9454175170 0x7f94540ecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f9459b2d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f945417f6c0 0x7f945417ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:38364/0 (socket says 172.21.15.38:38364) 2023-11-06T13:28:18.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f9459b2d700 1 -- 172.21.15.38:0/3422893479 learned_addr learned my addr 172.21.15.38:0/3422893479 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:18.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922442656 0 0) 0x7f94541759e0 con 0x7f945417f6c0 2023-11-06T13:28:18.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f943c0033f0 con 0x7f945417f6c0 2023-11-06T13:28:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339368748 0 0) 0x7f94540ec210 con 0x7f9454175550 2023-11-06T13:28:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.291+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94541759e0 con 0x7f9454175550 2023-11-06T13:28:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945a32e700 1 -- 172.21.15.38:0/3422893479 >> v1:172.21.15.163:6789/0 conn(0x7f9454175550 legacy=0x7f94541806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945a32e700 1 -- 172.21.15.38:0/3422893479 >> v1:172.21.15.44:6789/0 conn(0x7f945417f6c0 legacy=0x7f945417ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945a32e700 1 -- 172.21.15.38:0/3422893479 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94540ed8c0 con 0x7f9454175170 2023-11-06T13:28:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945a32e700 1 --2- 172.21.15.38:0/3422893479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9454175170 0x7f94540ecf80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f944c009760 tx=0x7f944c009060).ready entity=mon.2 client_cookie=8ee2a4d0c7dcf586 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00d4a0 con 0x7f9454175170 2023-11-06T13:28:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c00d600 con 0x7f9454175170 2023-11-06T13:28:18.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945932c700 1 -- 172.21.15.38:0/3422893479 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00d980 con 0x7f9454175170 2023-11-06T13:28:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945b330700 1 -- 172.21.15.38:0/3422893479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9454175170 msgr2=0x7f94540ecf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945b330700 1 --2- 172.21.15.38:0/3422893479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9454175170 0x7f94540ecf80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f944c009760 tx=0x7f944c009060).stop 2023-11-06T13:28:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945b330700 1 -- 172.21.15.38:0/3422893479 shutdown_connections 2023-11-06T13:28:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945b330700 1 --2- 172.21.15.38:0/3422893479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9454175170 0x7f94540ecf80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945b330700 1 -- 172.21.15.38:0/3422893479 >> 172.21.15.38:0/3422893479 conn(0x7f945405e1b0 msgr2=0x7f945405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:18.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.292+0000 7f945b330700 1 -- 172.21.15.38:0/3422893479 shutdown_connections 2023-11-06T13:28:18.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.293+0000 7f945b330700 1 -- 172.21.15.38:0/3422893479 wait complete. 2023-11-06T13:28:18.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.294+0000 7f945b330700 1 Processor -- start 2023-11-06T13:28:18.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.294+0000 7f945b330700 1 -- start start 2023-11-06T13:28:18.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945b330700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 0x7f94540c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945b330700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9454175550 0x7f9454190930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945b330700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f945417f6c0 0x7f9454190e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945b330700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94541901c0 con 0x7f9454175170 2023-11-06T13:28:18.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945b330700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c8b20 con 0x7f9454175550 2023-11-06T13:28:18.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945b330700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540c8e00 con 0x7f945417f6c0 2023-11-06T13:28:18.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 0x7f94540c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 0x7f94540c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48304/0 (socket says 172.21.15.38:48304) 2023-11-06T13:28:18.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 -- 172.21.15.38:0/3222988479 learned_addr learned my addr 172.21.15.38:0/3222988479 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:18.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f9459b2d700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9454175550 0x7f9454190930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945ab2f700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f945417f6c0 0x7f9454190e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 -- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f945417f6c0 msgr2=0x7f9454190e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f945417f6c0 0x7f9454190e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 -- 172.21.15.38:0/3222988479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9454175550 msgr2=0x7f9454190930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9454175550 0x7f9454190930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 -- 172.21.15.38:0/3222988479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0092a0 con 0x7f9454175170 2023-11-06T13:28:18.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945ab2f700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f945417f6c0 0x7f9454190e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:18.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.295+0000 7f945a32e700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 0x7f94540c3680 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9454086980 tx=0x7f944c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.296+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00dcf0 con 0x7f9454175170 2023-11-06T13:28:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.296+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c00de50 con 0x7f9454175170 2023-11-06T13:28:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.296+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c01d430 con 0x7f9454175170 2023-11-06T13:28:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.296+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94540c90e0 con 0x7f9454175170 2023-11-06T13:28:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.296+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9454190410 con 0x7f9454175170 2023-11-06T13:28:18.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.297+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94540475a0 con 0x7f9454175170 2023-11-06T13:28:18.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.297+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f944c01d7a0 con 0x7f9454175170 2023-11-06T13:28:18.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.298+0000 7f94527fc700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f944008cbd0 0x7f944008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.298+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f944c0b3940 con 0x7f9454175170 2023-11-06T13:28:18.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.298+0000 7f9459b2d700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f944008cbd0 0x7f944008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.299+0000 7f9459b2d700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f944008cbd0 0x7f944008f090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f945417e570 tx=0x7f9448009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.302+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f944c083e80 con 0x7f9454175170 2023-11-06T13:28:18.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.476+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9454083190 con 0x7f9454175170 2023-11-06T13:28:18.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.476+0000 7f94527fc700 1 -- 172.21.15.38:0/3222988479 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f944c0874a0 con 0x7f9454175170 2023-11-06T13:28:18.480 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:18.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f944008cbd0 msgr2=0x7f944008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f944008cbd0 0x7f944008f090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f945417e570 tx=0x7f9448009040).stop 2023-11-06T13:28:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 msgr2=0x7f94540c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 0x7f94540c3680 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9454086980 tx=0x7f944c016000).stop 2023-11-06T13:28:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 shutdown_connections 2023-11-06T13:28:18.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f945417f6c0 0x7f9454190e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9454175170 0x7f94540c3680 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f944008cbd0 0x7f944008f090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 --2- 172.21.15.38:0/3222988479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9454175550 0x7f9454190930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 >> 172.21.15.38:0/3222988479 conn(0x7f945405e1b0 msgr2=0x7f94540eb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:18.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 shutdown_connections 2023-11-06T13:28:18.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.478+0000 7f945b330700 1 -- 172.21.15.38:0/3222988479 wait complete. 2023-11-06T13:28:18.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-06T13:28:18.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.611+0000 7f372653e700 1 Processor -- start 2023-11-06T13:28:18.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.611+0000 7f372653e700 1 -- start start 2023-11-06T13:28:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.612+0000 7f372653e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3720175a40 0x7f372017f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.612+0000 7f372653e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f372017e970 0x7f3720185840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.612+0000 7f372653e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372017ddd0 con 0x7f372017fb80 2023-11-06T13:28:18.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.612+0000 7f372653e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3720064780 con 0x7f372017e970 2023-11-06T13:28:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.612+0000 7f372653e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37200c4c20 con 0x7f3720175a40 2023-11-06T13:28:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.612+0000 7f3724adb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f372017e970 0x7f3720185840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f372017e970 0x7f3720185840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48318/0 (socket says 172.21.15.38:48318) 2023-11-06T13:28:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 -- 172.21.15.38:0/1835021813 learned_addr learned my addr 172.21.15.38:0/1835021813 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:18.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f371ffff700 1 --2- 172.21.15.38:0/1835021813 >> v2:172.21.15.44:3300/0 conn(0x7f3720175a40 0x7f372017f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 -- 172.21.15.38:0/1835021813 >> v2:172.21.15.44:3300/0 conn(0x7f3720175a40 msgr2=0x7f372017f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:18.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 --2- 172.21.15.38:0/1835021813 >> v2:172.21.15.44:3300/0 conn(0x7f3720175a40 0x7f372017f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 -- 172.21.15.38:0/1835021813 >> v1:172.21.15.163:6789/0 conn(0x7f372017fb80 legacy=0x7f372017e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 -- 172.21.15.38:0/1835021813 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372017cee0 con 0x7f372017e970 2023-11-06T13:28:18.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f3724adb700 1 --2- 172.21.15.38:0/1835021813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017e970 0x7f3720185840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f37200898b0 tx=0x7f3718009840).ready entity=mon.0 client_cookie=80241dcf85b6ac0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f371effd700 1 -- 172.21.15.38:0/1835021813 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800e070 con 0x7f372017e970 2023-11-06T13:28:18.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f371effd700 1 -- 172.21.15.38:0/1835021813 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371800ba50 con 0x7f372017e970 2023-11-06T13:28:18.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.613+0000 7f371effd700 1 -- 172.21.15.38:0/1835021813 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800bdd0 con 0x7f372017e970 2023-11-06T13:28:18.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 -- 172.21.15.38:0/1835021813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017e970 msgr2=0x7f3720185840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 --2- 172.21.15.38:0/1835021813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017e970 0x7f3720185840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f37200898b0 tx=0x7f3718009840).stop 2023-11-06T13:28:18.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 -- 172.21.15.38:0/1835021813 shutdown_connections 2023-11-06T13:28:18.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 --2- 172.21.15.38:0/1835021813 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017e970 0x7f3720185840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 --2- 172.21.15.38:0/1835021813 >> v2:172.21.15.44:3300/0 conn(0x7f3720175a40 0x7f372017f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 -- 172.21.15.38:0/1835021813 >> 172.21.15.38:0/1835021813 conn(0x7f372006a970 msgr2=0x7f37200f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:18.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 -- 172.21.15.38:0/1835021813 shutdown_connections 2023-11-06T13:28:18.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.614+0000 7f372653e700 1 -- 172.21.15.38:0/1835021813 wait complete. 2023-11-06T13:28:18.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.615+0000 7f372653e700 1 Processor -- start 2023-11-06T13:28:18.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.615+0000 7f372653e700 1 -- start start 2023-11-06T13:28:18.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f372653e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3720175a40 0x7f372016f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f372653e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372017e970 0x7f372016fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f372653e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 0x7f37201802b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f372653e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200ef170 con 0x7f372017fb80 2023-11-06T13:28:18.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f372653e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200ee560 con 0x7f372017e970 2023-11-06T13:28:18.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f372653e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37200ee840 con 0x7f3720175a40 2023-11-06T13:28:18.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f3724adb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 0x7f37201802b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f3724adb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 0x7f37201802b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48328/0 (socket says 172.21.15.38:48328) 2023-11-06T13:28:18.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f3724adb700 1 -- 172.21.15.38:0/4107490213 learned_addr learned my addr 172.21.15.38:0/4107490213 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:18.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.616+0000 7f371ffff700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3720175a40 0x7f372016f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f371f7fe700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372017e970 0x7f372016fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3724adb700 1 -- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3720175a40 msgr2=0x7f372016f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3724adb700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3720175a40 0x7f372016f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3724adb700 1 -- 172.21.15.38:0/4107490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372017e970 msgr2=0x7f372016fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3724adb700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372017e970 0x7f372016fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3724adb700 1 -- 172.21.15.38:0/4107490213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718009ae0 con 0x7f372017fb80 2023-11-06T13:28:18.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3724adb700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 0x7f37201802b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f3718009fd0 tx=0x7f3718009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800bdd0 con 0x7f372017fb80 2023-11-06T13:28:18.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718009500 con 0x7f372017fb80 2023-11-06T13:28:18.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371801c610 con 0x7f372017fb80 2023-11-06T13:28:18.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37200eeb20 con 0x7f372017fb80 2023-11-06T13:28:18.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.617+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37200ef600 con 0x7f372017fb80 2023-11-06T13:28:18.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.618+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372006c580 con 0x7f372017fb80 2023-11-06T13:28:18.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.619+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f371801ca00 con 0x7f372017fb80 2023-11-06T13:28:18.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.619+0000 7f3707fff700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f370c08cbd0 0x7f370c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.619+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f37180b39d0 con 0x7f372017fb80 2023-11-06T13:28:18.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.620+0000 7f371ffff700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f370c08cbd0 0x7f370c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.620+0000 7f371ffff700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f370c08cbd0 0x7f370c08f090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f371000bb10 tx=0x7f3710008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.623+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3718083f10 con 0x7f372017fb80 2023-11-06T13:28:18.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.794+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f37200ef2b0 con 0x7f372017fb80 2023-11-06T13:28:18.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.794+0000 7f3707fff700 1 -- 172.21.15.38:0/4107490213 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3718023310 con 0x7f372017fb80 2023-11-06T13:28:18.798 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-11-06T13:28:18.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f370c08cbd0 msgr2=0x7f370c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f370c08cbd0 0x7f370c08f090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f371000bb10 tx=0x7f3710008040).stop 2023-11-06T13:28:18.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 msgr2=0x7f37201802b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 0x7f37201802b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f3718009fd0 tx=0x7f3718009840).stop 2023-11-06T13:28:18.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 shutdown_connections 2023-11-06T13:28:18.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f372017fb80 0x7f37201802b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3720175a40 0x7f372016f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f370c08cbd0 0x7f370c08f090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 --2- 172.21.15.38:0/4107490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372017e970 0x7f372016fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 >> 172.21.15.38:0/4107490213 conn(0x7f372006a970 msgr2=0x7f37200f1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:18.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 shutdown_connections 2023-11-06T13:28:18.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.796+0000 7f372653e700 1 -- 172.21.15.38:0/4107490213 wait complete. 2023-11-06T13:28:18.811 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:18.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.926+0000 7f70f359e700 1 Processor -- start 2023-11-06T13:28:18.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.926+0000 7f70f359e700 1 -- start start 2023-11-06T13:28:18.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.927+0000 7f70f359e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70f40c4960 0x7f70f40c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.927+0000 7f70f359e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40c44d0 con 0x7f70f417ae20 2023-11-06T13:28:18.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f359e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40c35e0 con 0x7f70f40c67c0 2023-11-06T13:28:18.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f359e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40c38c0 con 0x7f70f40c4960 2023-11-06T13:28:18.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70f40c4960 0x7f70f40c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f70f40c4960 0x7f70f40c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48332/0 (socket says 172.21.15.38:48332) 2023-11-06T13:28:18.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 -- 172.21.15.38:0/1881900186 learned_addr learned my addr 172.21.15.38:0/1881900186 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:18.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 -- 172.21.15.38:0/1881900186 >> v1:172.21.15.163:6789/0 conn(0x7f70f40c67c0 legacy=0x7f70f40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 -- 172.21.15.38:0/1881900186 >> v1:172.21.15.44:6789/0 conn(0x7f70f417ae20 legacy=0x7f70f40e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 -- 172.21.15.38:0/1881900186 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40c3ba0 con 0x7f70f40c4960 2023-11-06T13:28:18.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f1d9b700 1 --2- 172.21.15.38:0/1881900186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c4960 0x7f70f40c4de0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f70dc006fd0 tx=0x7f70dc0090f0).ready entity=mon.0 client_cookie=ec981c5a3a7e04d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f159a700 1 -- 172.21.15.38:0/1881900186 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00b600 con 0x7f70f40c4960 2023-11-06T13:28:18.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f159a700 1 -- 172.21.15.38:0/1881900186 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00b760 con 0x7f70f40c4960 2023-11-06T13:28:18.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.928+0000 7f70f159a700 1 -- 172.21.15.38:0/1881900186 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00bae0 con 0x7f70f40c4960 2023-11-06T13:28:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 -- 172.21.15.38:0/1881900186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c4960 msgr2=0x7f70f40c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 --2- 172.21.15.38:0/1881900186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c4960 0x7f70f40c4de0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f70dc006fd0 tx=0x7f70dc0090f0).stop 2023-11-06T13:28:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 -- 172.21.15.38:0/1881900186 shutdown_connections 2023-11-06T13:28:18.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 --2- 172.21.15.38:0/1881900186 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c4960 0x7f70f40c4de0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 -- 172.21.15.38:0/1881900186 >> 172.21.15.38:0/1881900186 conn(0x7f70f40ed830 msgr2=0x7f70f40edc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 -- 172.21.15.38:0/1881900186 shutdown_connections 2023-11-06T13:28:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.929+0000 7f70f359e700 1 -- 172.21.15.38:0/1881900186 wait complete. 2023-11-06T13:28:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.930+0000 7f70f359e700 1 Processor -- start 2023-11-06T13:28:18.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.930+0000 7f70f359e700 1 -- start start 2023-11-06T13:28:18.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f359e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40c4960 0x7f70f4166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 0x7f70f416db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70f417ae20 0x7f70f415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f359e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4160580 con 0x7f70f40c67c0 2023-11-06T13:28:18.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f416e2d0 con 0x7f70f417ae20 2023-11-06T13:28:18.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f359e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f416e5b0 con 0x7f70f40c4960 2023-11-06T13:28:18.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.931+0000 7f70f1d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 0x7f70f416db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 0x7f70f416db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48346/0 (socket says 172.21.15.38:48346) 2023-11-06T13:28:18.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 -- 172.21.15.38:0/197967296 learned_addr learned my addr 172.21.15.38:0/197967296 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:18.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f2d9d700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70f417ae20 0x7f70f415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f259c700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40c4960 0x7f70f4166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 -- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40c4960 msgr2=0x7f70f4166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40c4960 0x7f70f4166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 -- 172.21.15.38:0/197967296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70f417ae20 msgr2=0x7f70f415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:18.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70f417ae20 0x7f70f415da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 -- 172.21.15.38:0/197967296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009370 con 0x7f70f40c67c0 2023-11-06T13:28:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f1d9b700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 0x7f70f416db00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f70dc009130 tx=0x7f70dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00b8d0 con 0x7f70f40c67c0 2023-11-06T13:28:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00ba30 con 0x7f70f40c67c0 2023-11-06T13:28:18.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc01c670 con 0x7f70f40c67c0 2023-11-06T13:28:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f416e890 con 0x7f70f40c67c0 2023-11-06T13:28:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.932+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f416ee50 con 0x7f70f40c67c0 2023-11-06T13:28:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.933+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f40475a0 con 0x7f70f40c67c0 2023-11-06T13:28:18.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.934+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f70dc01c9e0 con 0x7f70f40c67c0 2023-11-06T13:28:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.934+0000 7f70ea7fc700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f70d408cbd0 0x7f70d408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:18.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.935+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f70dc0b39e0 con 0x7f70f40c67c0 2023-11-06T13:28:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.935+0000 7f70f259c700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f70d408cbd0 0x7f70d408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.935+0000 7f70f259c700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f70d408cbd0 0x7f70d408f090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f70ec00c6f0 tx=0x7f70ec009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:18.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:18.938+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f70dc083f20 con 0x7f70f40c67c0 2023-11-06T13:28:19.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.112+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70f40c3e80 con 0x7f70f40c67c0 2023-11-06T13:28:19.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.114+0000 7f70ea7fc700 1 -- 172.21.15.38:0/197967296 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f70dc020030 con 0x7f70f40c67c0 2023-11-06T13:28:19.117 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:19.118 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:19.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f70d408cbd0 msgr2=0x7f70d408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f70d408cbd0 0x7f70d408f090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f70ec00c6f0 tx=0x7f70ec009040).stop 2023-11-06T13:28:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 msgr2=0x7f70f416db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 0x7f70f416db00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f70dc009130 tx=0x7f70dc017000).stop 2023-11-06T13:28:19.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 shutdown_connections 2023-11-06T13:28:19.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f70d408cbd0 0x7f70d408f090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70f417ae20 0x7f70f415da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f70f40c4960 0x7f70f4166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 --2- 172.21.15.38:0/197967296 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f70f40c67c0 0x7f70f416db00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 >> 172.21.15.38:0/197967296 conn(0x7f70f40ed830 msgr2=0x7f70f40c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:19.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 shutdown_connections 2023-11-06T13:28:19.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.116+0000 7f70f359e700 1 -- 172.21.15.38:0/197967296 wait complete. 2023-11-06T13:28:19.131 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-06T13:27:40.368418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-06T13:27:40.848313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-06T13:27:43.934481+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-06T13:28:19.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:28:19.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.249+0000 7f3a6a108700 1 Processor -- start 2023-11-06T13:28:19.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.249+0000 7f3a6a108700 1 -- start start 2023-11-06T13:28:19.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.250+0000 7f3a6a108700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a64175a40 0x7f3a6417f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a6a108700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a6417e970 0x7f3a64185840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a6a108700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6417ddd0 con 0x7f3a6417fb80 2023-11-06T13:28:19.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a6a108700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a64064780 con 0x7f3a64175a40 2023-11-06T13:28:19.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a6a108700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640c4c20 con 0x7f3a6417e970 2023-11-06T13:28:19.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a637fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3a64175a40 0x7f3a6417f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a62ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f3a6417fb80 0x7f3a6417e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50026/0 (socket says 172.21.15.38:50026) 2023-11-06T13:28:19.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a62ffd700 1 -- 172.21.15.38:0/2989125340 learned_addr learned my addr 172.21.15.38:0/2989125340 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:19.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a63fff700 1 --2- 172.21.15.38:0/2989125340 >> v2:172.21.15.44:3300/0 conn(0x7f3a6417e970 0x7f3a64185840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a637fe700 1 -- 172.21.15.38:0/2989125340 >> v2:172.21.15.44:3300/0 conn(0x7f3a6417e970 msgr2=0x7f3a64185840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:19.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a637fe700 1 --2- 172.21.15.38:0/2989125340 >> v2:172.21.15.44:3300/0 conn(0x7f3a6417e970 0x7f3a64185840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a637fe700 1 -- 172.21.15.38:0/2989125340 >> v1:172.21.15.38:6789/0 conn(0x7f3a6417fb80 legacy=0x7f3a6417e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a637fe700 1 -- 172.21.15.38:0/2989125340 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6417cee0 con 0x7f3a64175a40 2023-11-06T13:28:19.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a627fc700 1 -- 172.21.15.38:0/2989125340 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015109097 0 0) 0x7f3a6417ddd0 con 0x7f3a6417fb80 2023-11-06T13:28:19.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a637fe700 1 --2- 172.21.15.38:0/2989125340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a64175a40 0x7f3a6417f690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f3a64157d50 tx=0x7f3a54009060).ready entity=mon.0 client_cookie=df2c2b6e1d018eda server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a627fc700 1 -- 172.21.15.38:0/2989125340 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5400b580 con 0x7f3a64175a40 2023-11-06T13:28:19.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a627fc700 1 -- 172.21.15.38:0/2989125340 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5400b6e0 con 0x7f3a64175a40 2023-11-06T13:28:19.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.251+0000 7f3a627fc700 1 -- 172.21.15.38:0/2989125340 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5400ba60 con 0x7f3a64175a40 2023-11-06T13:28:19.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 -- 172.21.15.38:0/2989125340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a64175a40 msgr2=0x7f3a6417f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 --2- 172.21.15.38:0/2989125340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a64175a40 0x7f3a6417f690 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f3a64157d50 tx=0x7f3a54009060).stop 2023-11-06T13:28:19.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 -- 172.21.15.38:0/2989125340 shutdown_connections 2023-11-06T13:28:19.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 --2- 172.21.15.38:0/2989125340 >> v2:172.21.15.44:3300/0 conn(0x7f3a6417e970 0x7f3a64185840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 --2- 172.21.15.38:0/2989125340 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a64175a40 0x7f3a6417f690 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 -- 172.21.15.38:0/2989125340 >> 172.21.15.38:0/2989125340 conn(0x7f3a6406a970 msgr2=0x7f3a640f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:19.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 -- 172.21.15.38:0/2989125340 shutdown_connections 2023-11-06T13:28:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.252+0000 7f3a6a108700 1 -- 172.21.15.38:0/2989125340 wait complete. 2023-11-06T13:28:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.253+0000 7f3a6a108700 1 Processor -- start 2023-11-06T13:28:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.253+0000 7f3a6a108700 1 -- start start 2023-11-06T13:28:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.254+0000 7f3a6a108700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a64175a40 0x7f3a641577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.254+0000 7f3a6a108700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 0x7f3a64193910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.254+0000 7f3a6a108700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6417fb80 0x7f3a64175e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.254+0000 7f3a6a108700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640cc700 con 0x7f3a6417e970 2023-11-06T13:28:19.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.254+0000 7f3a6a108700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640cb810 con 0x7f3a64175a40 2023-11-06T13:28:19.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.254+0000 7f3a6a108700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640cbaf0 con 0x7f3a6417fb80 2023-11-06T13:28:19.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 0x7f3a64193910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 0x7f3a64193910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48366/0 (socket says 172.21.15.38:48366) 2023-11-06T13:28:19.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 -- 172.21.15.38:0/645060502 learned_addr learned my addr 172.21.15.38:0/645060502 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:19.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a637fe700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a64175a40 0x7f3a641577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a63fff700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6417fb80 0x7f3a64175e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 -- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6417fb80 msgr2=0x7f3a64175e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6417fb80 0x7f3a64175e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 -- 172.21.15.38:0/645060502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a64175a40 msgr2=0x7f3a641577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a64175a40 0x7f3a641577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 -- 172.21.15.38:0/645060502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540092a0 con 0x7f3a6417e970 2023-11-06T13:28:19.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a63fff700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6417fb80 0x7f3a64175e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:19.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a62ffd700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 0x7f3a64193910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f3a5800c490 tx=0x7f3a58007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800ce90 con 0x7f3a6417e970 2023-11-06T13:28:19.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580072e0 con 0x7f3a6417e970 2023-11-06T13:28:19.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58007680 con 0x7f3a6417e970 2023-11-06T13:28:19.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a640cbdd0 con 0x7f3a6417e970 2023-11-06T13:28:19.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.255+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a640cc390 con 0x7f3a6417e970 2023-11-06T13:28:19.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.256+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a640cc870 con 0x7f3a6417e970 2023-11-06T13:28:19.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.257+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f3a580059b0 con 0x7f3a6417e970 2023-11-06T13:28:19.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.258+0000 7f3a4b7fe700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3a5008cbd0 0x7f3a5008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.258+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3a580b1830 con 0x7f3a6417e970 2023-11-06T13:28:19.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.258+0000 7f3a637fe700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3a5008cbd0 0x7f3a5008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.258+0000 7f3a637fe700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3a5008cbd0 0x7f3a5008f090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3a54009fd0 tx=0x7f3a54017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.262+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3a58081cf0 con 0x7f3a6417e970 2023-11-06T13:28:19.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.431+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3a640cc520 con 0x7f3a6417e970 2023-11-06T13:28:19.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.432+0000 7f3a4b7fe700 1 -- 172.21.15.38:0/645060502 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3a58085310 con 0x7f3a6417e970 2023-11-06T13:28:19.436 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:28:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3a5008cbd0 msgr2=0x7f3a5008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3a5008cbd0 0x7f3a5008f090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3a54009fd0 tx=0x7f3a54017000).stop 2023-11-06T13:28:19.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 msgr2=0x7f3a64193910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 0x7f3a64193910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f3a5800c490 tx=0x7f3a58007e60).stop 2023-11-06T13:28:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 shutdown_connections 2023-11-06T13:28:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a6417fb80 0x7f3a64175e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3a5008cbd0 0x7f3a5008f090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a64175a40 0x7f3a641577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 --2- 172.21.15.38:0/645060502 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3a6417e970 0x7f3a64193910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 >> 172.21.15.38:0/645060502 conn(0x7f3a6406a970 msgr2=0x7f3a6417e260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 shutdown_connections 2023-11-06T13:28:19.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.434+0000 7f3a6a108700 1 -- 172.21.15.38:0/645060502 wait complete. 2023-11-06T13:28:19.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:28:19.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.568+0000 7ff3df21a700 1 Processor -- start 2023-11-06T13:28:19.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.568+0000 7ff3df21a700 1 -- start start 2023-11-06T13:28:19.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.569+0000 7ff3df21a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3d8182520 0x7ff3d8175ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.569+0000 7ff3df21a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d81833b0 con 0x7ff3d8069550 2023-11-06T13:28:19.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.569+0000 7ff3df21a700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d8182b10 con 0x7ff3d8175700 2023-11-06T13:28:19.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.569+0000 7ff3df21a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d8182df0 con 0x7ff3d8182520 2023-11-06T13:28:19.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d7fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3d8182520 0x7ff3d8175ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3dcfb6700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ff3d8175700 0x7ff3d80853e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:51752/0 (socket says 172.21.15.38:51752) 2023-11-06T13:28:19.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3dcfb6700 1 -- 172.21.15.38:0/2903561140 learned_addr learned my addr 172.21.15.38:0/2903561140 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:19.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d77fe700 1 -- 172.21.15.38:0/2903561140 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677168934 0 0) 0x7ff3d8182b10 con 0x7ff3d8175700 2023-11-06T13:28:19.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d77fe700 1 -- 172.21.15.38:0/2903561140 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c40033f0 con 0x7ff3d8175700 2023-11-06T13:28:19.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d7fff700 1 -- 172.21.15.38:0/2903561140 >> v1:172.21.15.163:6789/0 conn(0x7ff3d8175700 legacy=0x7ff3d80853e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d7fff700 1 -- 172.21.15.38:0/2903561140 >> v1:172.21.15.44:6789/0 conn(0x7ff3d8069550 legacy=0x7ff3d80699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d7fff700 1 -- 172.21.15.38:0/2903561140 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d81830d0 con 0x7ff3d8182520 2023-11-06T13:28:19.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.570+0000 7ff3d7fff700 1 --2- 172.21.15.38:0/2903561140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8182520 0x7ff3d8175ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff3c8009e60 tx=0x7ff3c8009780).ready entity=mon.1 client_cookie=b9fa17a73c6858e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3d77fe700 1 -- 172.21.15.38:0/2903561140 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800e070 con 0x7ff3d8182520 2023-11-06T13:28:19.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3d77fe700 1 -- 172.21.15.38:0/2903561140 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800bb60 con 0x7ff3d8182520 2023-11-06T13:28:19.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3d77fe700 1 -- 172.21.15.38:0/2903561140 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8012410 con 0x7ff3d8182520 2023-11-06T13:28:19.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 -- 172.21.15.38:0/2903561140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8182520 msgr2=0x7ff3d8175ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 --2- 172.21.15.38:0/2903561140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8182520 0x7ff3d8175ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff3c8009e60 tx=0x7ff3c8009780).stop 2023-11-06T13:28:19.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 -- 172.21.15.38:0/2903561140 shutdown_connections 2023-11-06T13:28:19.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 --2- 172.21.15.38:0/2903561140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8182520 0x7ff3d8175ae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 -- 172.21.15.38:0/2903561140 >> 172.21.15.38:0/2903561140 conn(0x7ff3d80f06a0 msgr2=0x7ff3d805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:19.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 -- 172.21.15.38:0/2903561140 shutdown_connections 2023-11-06T13:28:19.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.571+0000 7ff3df21a700 1 -- 172.21.15.38:0/2903561140 wait complete. 2023-11-06T13:28:19.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.572+0000 7ff3df21a700 1 Processor -- start 2023-11-06T13:28:19.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.573+0000 7ff3df21a700 1 -- start start 2023-11-06T13:28:19.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3df21a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 0x7ff3d817bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3df21a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8175700 0x7ff3d8178460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3df21a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d8182520 0x7ff3d8178950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3df21a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d8165f00 con 0x7ff3d8069550 2023-11-06T13:28:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3df21a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d8177170 con 0x7ff3d8175700 2023-11-06T13:28:19.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3df21a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d8177fd0 con 0x7ff3d8182520 2023-11-06T13:28:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 0x7ff3d817bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 0x7ff3d817bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48384/0 (socket says 172.21.15.38:48384) 2023-11-06T13:28:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 -- 172.21.15.38:0/3463875728 learned_addr learned my addr 172.21.15.38:0/3463875728 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3d7fff700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8175700 0x7ff3d8178460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dd7b7700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d8182520 0x7ff3d8178950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 -- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d8182520 msgr2=0x7ff3d8178950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d8182520 0x7ff3d8178950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 -- 172.21.15.38:0/3463875728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8175700 msgr2=0x7ff3d8178460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8175700 0x7ff3d8178460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 -- 172.21.15.38:0/3463875728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8009a20 con 0x7ff3d8069550 2023-11-06T13:28:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3dcfb6700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 0x7ff3d817bf50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff3c000c410 tx=0x7ff3c0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00070d0 con 0x7ff3d8069550 2023-11-06T13:28:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.574+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0007230 con 0x7ff3d8069550 2023-11-06T13:28:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.575+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d8178e40 con 0x7ff3d8069550 2023-11-06T13:28:19.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.575+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00075f0 con 0x7ff3d8069550 2023-11-06T13:28:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.575+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d81776a0 con 0x7ff3d8069550 2023-11-06T13:28:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.576+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d81782b0 con 0x7ff3d8069550 2023-11-06T13:28:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.576+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff3c00059b0 con 0x7ff3d8069550 2023-11-06T13:28:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.577+0000 7ff3d4ff9700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff3b808cbd0 0x7ff3b808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.577+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff3c00b14a0 con 0x7ff3d8069550 2023-11-06T13:28:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.577+0000 7ff3d7fff700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff3b808cbd0 0x7ff3b808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.578+0000 7ff3d7fff700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff3b808cbd0 0x7ff3b808f090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ff3c80094d0 tx=0x7ff3c8009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.581+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff3c00819e0 con 0x7ff3d8069550 2023-11-06T13:28:19.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.753+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3d806c580 con 0x7ff3d8069550 2023-11-06T13:28:19.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.753+0000 7ff3d4ff9700 1 -- 172.21.15.38:0/3463875728 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3c0085000 con 0x7ff3d8069550 2023-11-06T13:28:19.757 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:28:19.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff3b808cbd0 msgr2=0x7ff3b808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff3b808cbd0 0x7ff3b808f090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ff3c80094d0 tx=0x7ff3c8009780).stop 2023-11-06T13:28:19.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 msgr2=0x7ff3d817bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 0x7ff3d817bf50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff3c000c410 tx=0x7ff3c0007c70).stop 2023-11-06T13:28:19.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 shutdown_connections 2023-11-06T13:28:19.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3d8182520 0x7ff3d8178950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff3d8069550 0x7ff3d817bf50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff3b808cbd0 0x7ff3b808f090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 --2- 172.21.15.38:0/3463875728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8175700 0x7ff3d8178460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 >> 172.21.15.38:0/3463875728 conn(0x7ff3d80f06a0 msgr2=0x7ff3d8086100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:19.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 shutdown_connections 2023-11-06T13:28:19.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.755+0000 7ff3df21a700 1 -- 172.21.15.38:0/3463875728 wait complete. 2023-11-06T13:28:19.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-06T13:28:19.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.889+0000 7f3ef759e700 1 Processor -- start 2023-11-06T13:28:19.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.889+0000 7f3ef759e700 1 -- start start 2023-11-06T13:28:19.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef759e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ef8172130 0x7f3ef80c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3ef8179970 0x7f3ef8179dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef759e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef8172990 con 0x7f3ef8172510 2023-11-06T13:28:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef759e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80c9640 con 0x7f3ef8172130 2023-11-06T13:28:19.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80c9920 con 0x7f3ef8179970 2023-11-06T13:28:19.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ef8172130 0x7f3ef80c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f3ef8172130 0x7f3ef80c3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48390/0 (socket says 172.21.15.38:48390) 2023-11-06T13:28:19.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 -- 172.21.15.38:0/1633126453 learned_addr learned my addr 172.21.15.38:0/1633126453 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:19.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef6d9d700 1 --2- 172.21.15.38:0/1633126453 >> v2:172.21.15.44:3300/0 conn(0x7f3ef8179970 0x7f3ef8179dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 -- 172.21.15.38:0/1633126453 >> v2:172.21.15.44:3300/0 conn(0x7f3ef8179970 msgr2=0x7f3ef8179dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 --2- 172.21.15.38:0/1633126453 >> v2:172.21.15.44:3300/0 conn(0x7f3ef8179970 0x7f3ef8179dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 -- 172.21.15.38:0/1633126453 >> v1:172.21.15.44:6789/0 conn(0x7f3ef8172510 legacy=0x7f3ef80c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef659c700 1 -- 172.21.15.38:0/1633126453 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80c9c00 con 0x7f3ef8172130 2023-11-06T13:28:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.890+0000 7f3ef6d9d700 1 --2- 172.21.15.38:0/1633126453 >> v2:172.21.15.44:3300/0 conn(0x7f3ef8179970 0x7f3ef8179dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:19.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef659c700 1 --2- 172.21.15.38:0/1633126453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8172130 0x7f3ef80c3240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f3ef8175fc0 tx=0x7f3ef0009060).ready entity=mon.0 client_cookie=fe6bdf5d3e7f40a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef559a700 1 -- 172.21.15.38:0/1633126453 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0005880 con 0x7f3ef8172130 2023-11-06T13:28:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef559a700 1 -- 172.21.15.38:0/1633126453 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef00059e0 con 0x7f3ef8172130 2023-11-06T13:28:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef559a700 1 -- 172.21.15.38:0/1633126453 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0005d60 con 0x7f3ef8172130 2023-11-06T13:28:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 -- 172.21.15.38:0/1633126453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8172130 msgr2=0x7f3ef80c3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 --2- 172.21.15.38:0/1633126453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8172130 0x7f3ef80c3240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f3ef8175fc0 tx=0x7f3ef0009060).stop 2023-11-06T13:28:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 -- 172.21.15.38:0/1633126453 shutdown_connections 2023-11-06T13:28:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 --2- 172.21.15.38:0/1633126453 >> v2:172.21.15.44:3300/0 conn(0x7f3ef8179970 0x7f3ef8179dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 --2- 172.21.15.38:0/1633126453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8172130 0x7f3ef80c3240 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 -- 172.21.15.38:0/1633126453 >> 172.21.15.38:0/1633126453 conn(0x7f3ef805e1b0 msgr2=0x7f3ef805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:19.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 -- 172.21.15.38:0/1633126453 shutdown_connections 2023-11-06T13:28:19.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.891+0000 7f3ef759e700 1 -- 172.21.15.38:0/1633126453 wait complete. 2023-11-06T13:28:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.893+0000 7f3ef759e700 1 Processor -- start 2023-11-06T13:28:19.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.893+0000 7f3ef759e700 1 -- start start 2023-11-06T13:28:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef8172130 0x7f3ef8166530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ef8172510 0x7f3ef8175200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 0x7f3ef80e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8166a20 con 0x7f3ef8179970 2023-11-06T13:28:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80e8a20 con 0x7f3ef8172510 2023-11-06T13:28:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80e8c30 con 0x7f3ef8172130 2023-11-06T13:28:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 0x7f3ef80e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 0x7f3ef80e9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48400/0 (socket says 172.21.15.38:48400) 2023-11-06T13:28:19.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 -- 172.21.15.38:0/2037299417 learned_addr learned my addr 172.21.15.38:0/2037299417 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef659c700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef8172130 0x7f3ef8166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef5d9b700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ef8172510 0x7f3ef8175200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 -- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef8172130 msgr2=0x7f3ef8166530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef8172130 0x7f3ef8166530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 -- 172.21.15.38:0/2037299417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ef8172510 msgr2=0x7f3ef8175200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ef8172510 0x7f3ef8175200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 -- 172.21.15.38:0/2037299417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0009300 con 0x7f3ef8179970 2023-11-06T13:28:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef6d9d700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 0x7f3ef80e9cd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3ee800a380 tx=0x7f3ee8007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800ae10 con 0x7f3ef8179970 2023-11-06T13:28:19.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800d650 con 0x7f3ef8179970 2023-11-06T13:28:19.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.894+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef80e8f10 con 0x7f3ef8179970 2023-11-06T13:28:19.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.895+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800d9d0 con 0x7f3ef8179970 2023-11-06T13:28:19.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.895+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef80e94d0 con 0x7f3ef8179970 2023-11-06T13:28:19.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.895+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef80475a0 con 0x7f3ef8179970 2023-11-06T13:28:19.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.896+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f3ee8013070 con 0x7f3ef8179970 2023-11-06T13:28:19.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.897+0000 7f3eee7fc700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3ed808cbd0 0x7f3ed808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:19.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.897+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f3ee80b2830 con 0x7f3ef8179970 2023-11-06T13:28:19.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.897+0000 7f3ef659c700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3ed808cbd0 0x7f3ed808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:19.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.897+0000 7f3ef659c700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3ed808cbd0 0x7f3ed808f090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3ef000b360 tx=0x7f3ef0016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:19.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:19.901+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f3ee8082d70 con 0x7f3ef8179970 2023-11-06T13:28:20.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.073+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ef80ead70 con 0x7f3ef8179970 2023-11-06T13:28:20.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.074+0000 7f3eee7fc700 1 -- 172.21.15.38:0/2037299417 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ee801b070 con 0x7f3ef8179970 2023-11-06T13:28:20.077 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3ed808cbd0 msgr2=0x7f3ed808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3ed808cbd0 0x7f3ed808f090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3ef000b360 tx=0x7f3ef0016000).stop 2023-11-06T13:28:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 msgr2=0x7f3ef80e9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 0x7f3ef80e9cd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3ee800a380 tx=0x7f3ee8007900).stop 2023-11-06T13:28:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 shutdown_connections 2023-11-06T13:28:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f3ef8179970 0x7f3ef80e9cd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef8172130 0x7f3ef8166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f3ed808cbd0 0x7f3ed808f090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 --2- 172.21.15.38:0/2037299417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ef8172510 0x7f3ef8175200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 >> 172.21.15.38:0/2037299417 conn(0x7f3ef805e1b0 msgr2=0x7f3ef8176c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 shutdown_connections 2023-11-06T13:28:20.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.076+0000 7f3ef759e700 1 -- 172.21.15.38:0/2037299417 wait complete. 2023-11-06T13:28:20.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-06T13:28:20.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.208+0000 7efbee885700 1 Processor -- start 2023-11-06T13:28:20.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.208+0000 7efbee885700 1 -- start start 2023-11-06T13:28:20.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.209+0000 7efbee885700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efbe8178ca0 0x7efbe8064300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.209+0000 7efbee885700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7efbe8180210 0x7efbe817ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.209+0000 7efbee885700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbe8063e70 con 0x7efbe817f230 2023-11-06T13:28:20.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.209+0000 7efbee885700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbe817f6a0 con 0x7efbe8178ca0 2023-11-06T13:28:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.209+0000 7efbee885700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbe817f8f0 con 0x7efbe8180210 2023-11-06T13:28:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.209+0000 7efbe7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efbe8178ca0 0x7efbe8064300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7efbe8178ca0 0x7efbe8064300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48404/0 (socket says 172.21.15.38:48404) 2023-11-06T13:28:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 -- 172.21.15.38:0/878690336 learned_addr learned my addr 172.21.15.38:0/878690336 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:20.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe77fe700 1 --2- 172.21.15.38:0/878690336 >> v2:172.21.15.163:3300/0 conn(0x7efbe8180210 0x7efbe817ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 -- 172.21.15.38:0/878690336 >> v2:172.21.15.163:3300/0 conn(0x7efbe8180210 msgr2=0x7efbe817ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:20.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 --2- 172.21.15.38:0/878690336 >> v2:172.21.15.163:3300/0 conn(0x7efbe8180210 0x7efbe817ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 -- 172.21.15.38:0/878690336 >> v1:172.21.15.44:6789/0 conn(0x7efbe817f230 legacy=0x7efbe80c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 -- 172.21.15.38:0/878690336 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe817fbd0 con 0x7efbe8178ca0 2023-11-06T13:28:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe77fe700 1 --2- 172.21.15.38:0/878690336 >> v2:172.21.15.163:3300/0 conn(0x7efbe8180210 0x7efbe817ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe7fff700 1 --2- 172.21.15.38:0/878690336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8178ca0 0x7efbe8064300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7efbe8182270 tx=0x7efbd80090f0).ready entity=mon.0 client_cookie=f8ac1633f11ed83e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe6ffd700 1 -- 172.21.15.38:0/878690336 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbd800b600 con 0x7efbe8178ca0 2023-11-06T13:28:20.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe6ffd700 1 -- 172.21.15.38:0/878690336 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbd800b760 con 0x7efbe8178ca0 2023-11-06T13:28:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.210+0000 7efbe6ffd700 1 -- 172.21.15.38:0/878690336 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbd800bb00 con 0x7efbe8178ca0 2023-11-06T13:28:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 -- 172.21.15.38:0/878690336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8178ca0 msgr2=0x7efbe8064300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 --2- 172.21.15.38:0/878690336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8178ca0 0x7efbe8064300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7efbe8182270 tx=0x7efbd80090f0).stop 2023-11-06T13:28:20.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 -- 172.21.15.38:0/878690336 shutdown_connections 2023-11-06T13:28:20.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 --2- 172.21.15.38:0/878690336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8178ca0 0x7efbe8064300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 --2- 172.21.15.38:0/878690336 >> v2:172.21.15.163:3300/0 conn(0x7efbe8180210 0x7efbe817ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 -- 172.21.15.38:0/878690336 >> 172.21.15.38:0/878690336 conn(0x7efbe80eed10 msgr2=0x7efbe805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:20.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 -- 172.21.15.38:0/878690336 shutdown_connections 2023-11-06T13:28:20.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.211+0000 7efbee885700 1 -- 172.21.15.38:0/878690336 wait complete. 2023-11-06T13:28:20.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.212+0000 7efbee885700 1 Processor -- start 2023-11-06T13:28:20.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.212+0000 7efbee885700 1 -- start start 2023-11-06T13:28:20.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbee885700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efbe8178ca0 0x7efbe805e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbee885700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efbe817f230 0x7efbe816c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbee885700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 0x7efbe816c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbee885700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe817cbe0 con 0x7efbe8180210 2023-11-06T13:28:20.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbee885700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe817dd20 con 0x7efbe8178ca0 2023-11-06T13:28:20.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbee885700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe817ce30 con 0x7efbe817f230 2023-11-06T13:28:20.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbece22700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 0x7efbe816c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbece22700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 0x7efbe816c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48412/0 (socket says 172.21.15.38:48412) 2023-11-06T13:28:20.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.213+0000 7efbece22700 1 -- 172.21.15.38:0/4003913468 learned_addr learned my addr 172.21.15.38:0/4003913468 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:20.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbe77fe700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efbe817f230 0x7efbe816c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbe7fff700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efbe8178ca0 0x7efbe805e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbece22700 1 -- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efbe817f230 msgr2=0x7efbe816c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbece22700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efbe817f230 0x7efbe816c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbece22700 1 -- 172.21.15.38:0/4003913468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efbe8178ca0 msgr2=0x7efbe805e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbece22700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efbe8178ca0 0x7efbe805e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbece22700 1 -- 172.21.15.38:0/4003913468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbd8009370 con 0x7efbe8180210 2023-11-06T13:28:20.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbece22700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 0x7efbe816c6f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7efbe000c7c0 tx=0x7efbe00014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0010510 con 0x7efbe8180210 2023-11-06T13:28:20.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe0010670 con 0x7efbe8180210 2023-11-06T13:28:20.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe817d110 con 0x7efbe8180210 2023-11-06T13:28:20.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0010a10 con 0x7efbe8180210 2023-11-06T13:28:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.214+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe817d6d0 con 0x7efbe8180210 2023-11-06T13:28:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.215+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbe817de90 con 0x7efbe8180210 2023-11-06T13:28:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.216+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7efbe001b3b0 con 0x7efbe8180210 2023-11-06T13:28:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.216+0000 7efbcffff700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efbd408cba0 0x7efbd408f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.217+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7efbe00b1940 con 0x7efbe8180210 2023-11-06T13:28:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.217+0000 7efbe7fff700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efbd408cba0 0x7efbd408f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.217+0000 7efbe7fff700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efbd408cba0 0x7efbd408f060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efbd8009fd0 tx=0x7efbd8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.221+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7efbe0081e80 con 0x7efbe8180210 2023-11-06T13:28:20.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.392+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efbe817e0b0 con 0x7efbe8180210 2023-11-06T13:28:20.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.392+0000 7efbcffff700 1 -- 172.21.15.38:0/4003913468 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7efbe0017020 con 0x7efbe8180210 2023-11-06T13:28:20.396 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:20.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efbd408cba0 msgr2=0x7efbd408f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efbd408cba0 0x7efbd408f060 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7efbd8009fd0 tx=0x7efbd8017000).stop 2023-11-06T13:28:20.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 msgr2=0x7efbe816c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 0x7efbe816c6f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7efbe000c7c0 tx=0x7efbe00014e0).stop 2023-11-06T13:28:20.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 shutdown_connections 2023-11-06T13:28:20.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7efbe8180210 0x7efbe816c6f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7efbd408cba0 0x7efbd408f060 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efbe8178ca0 0x7efbe805e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 --2- 172.21.15.38:0/4003913468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efbe817f230 0x7efbe816c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 >> 172.21.15.38:0/4003913468 conn(0x7efbe80eed10 msgr2=0x7efbe8177060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:20.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 shutdown_connections 2023-11-06T13:28:20.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.394+0000 7efbee885700 1 -- 172.21.15.38:0/4003913468 wait complete. 2023-11-06T13:28:20.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-06T13:28:20.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.529+0000 7f0c49ac1700 1 Processor -- start 2023-11-06T13:28:20.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.529+0000 7f0c49ac1700 1 -- start start 2023-11-06T13:28:20.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c49ac1700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f0c440c4ed0 0x7f0c4417f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c49ac1700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4417e1e0 con 0x7f0c44176ab0 2023-11-06T13:28:20.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c49ac1700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c440860b0 con 0x7f0c44176e90 2023-11-06T13:28:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c49ac1700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c44086390 con 0x7f0c440c4ed0 2023-11-06T13:28:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c437fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0c44176ab0 0x7f0c440ee2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50032/0 (socket says 172.21.15.38:50032) 2023-11-06T13:28:20.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c437fe700 1 -- 172.21.15.38:0/2951841065 learned_addr learned my addr 172.21.15.38:0/2951841065 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c43fff700 1 --2- 172.21.15.38:0/2951841065 >> v2:172.21.15.163:3300/0 conn(0x7f0c440c4ed0 0x7f0c4417f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c427fc700 1 -- 172.21.15.38:0/2951841065 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116085881 0 0) 0x7f0c4417e1e0 con 0x7f0c44176ab0 2023-11-06T13:28:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c427fc700 1 -- 172.21.15.38:0/2951841065 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c0033f0 con 0x7f0c44176ab0 2023-11-06T13:28:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.530+0000 7f0c43fff700 1 -- 172.21.15.38:0/2951841065 >> v1:172.21.15.163:6789/0 conn(0x7f0c44176e90 legacy=0x7f0c4417e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c427fc700 1 -- 172.21.15.38:0/2951841065 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368036093 0 0) 0x7f0c440860b0 con 0x7f0c44176e90 2023-11-06T13:28:20.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c43fff700 1 -- 172.21.15.38:0/2951841065 >> v1:172.21.15.38:6789/0 conn(0x7f0c44176ab0 legacy=0x7f0c440ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c43fff700 1 -- 172.21.15.38:0/2951841065 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44086670 con 0x7f0c440c4ed0 2023-11-06T13:28:20.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c43fff700 1 --2- 172.21.15.38:0/2951841065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4417f0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0c3c009e60 tx=0x7f0c3c009780).ready entity=mon.2 client_cookie=c24b948ed6e1347a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c427fc700 1 -- 172.21.15.38:0/2951841065 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00e070 con 0x7f0c440c4ed0 2023-11-06T13:28:20.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c427fc700 1 -- 172.21.15.38:0/2951841065 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00bb60 con 0x7f0c440c4ed0 2023-11-06T13:28:20.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c427fc700 1 -- 172.21.15.38:0/2951841065 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00bee0 con 0x7f0c440c4ed0 2023-11-06T13:28:20.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 -- 172.21.15.38:0/2951841065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 msgr2=0x7f0c4417f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/2951841065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4417f0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0c3c009e60 tx=0x7f0c3c009780).stop 2023-11-06T13:28:20.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 -- 172.21.15.38:0/2951841065 shutdown_connections 2023-11-06T13:28:20.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/2951841065 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4417f0b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 -- 172.21.15.38:0/2951841065 >> 172.21.15.38:0/2951841065 conn(0x7f0c440efbd0 msgr2=0x7f0c440effe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:20.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 -- 172.21.15.38:0/2951841065 shutdown_connections 2023-11-06T13:28:20.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.531+0000 7f0c49ac1700 1 -- 172.21.15.38:0/2951841065 wait complete. 2023-11-06T13:28:20.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.533+0000 7f0c49ac1700 1 Processor -- start 2023-11-06T13:28:20.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.533+0000 7f0c49ac1700 1 -- start start 2023-11-06T13:28:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c49ac1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4416fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c49ac1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 0x7f0c44170670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c49ac1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c44176e90 0x7f0c44170b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c49ac1700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44171d70 con 0x7f0c44176ab0 2023-11-06T13:28:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c49ac1700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c441736a0 con 0x7f0c44176e90 2023-11-06T13:28:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c49ac1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c441711f0 con 0x7f0c440c4ed0 2023-11-06T13:28:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 0x7f0c44170670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 0x7f0c44170670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48422/0 (socket says 172.21.15.38:48422) 2023-11-06T13:28:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 -- 172.21.15.38:0/3399803859 learned_addr learned my addr 172.21.15.38:0/3399803859 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c437fe700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4416fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c43fff700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c44176e90 0x7f0c44170b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 -- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 msgr2=0x7f0c4416fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4416fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 -- 172.21.15.38:0/3399803859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c44176e90 msgr2=0x7f0c44170b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c44176e90 0x7f0c44170b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.534+0000 7f0c42ffd700 1 -- 172.21.15.38:0/3399803859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c009a20 con 0x7f0c44176ab0 2023-11-06T13:28:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.535+0000 7f0c42ffd700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 0x7f0c44170670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f0c38007fd0 tx=0x7f0c38007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.535+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800f470 con 0x7f0c44176ab0 2023-11-06T13:28:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.535+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c441714d0 con 0x7f0c44176ab0 2023-11-06T13:28:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.535+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3800f5f0 con 0x7f0c44176ab0 2023-11-06T13:28:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.535+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800f9b0 con 0x7f0c44176ab0 2023-11-06T13:28:20.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.535+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44171a90 con 0x7f0c44176ab0 2023-11-06T13:28:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.536+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c44068330 con 0x7f0c44176ab0 2023-11-06T13:28:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.537+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f0c38012400 con 0x7f0c44176ab0 2023-11-06T13:28:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.537+0000 7f0c2b7fe700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0c3008cbd0 0x7f0c3008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.537+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0c380b1670 con 0x7f0c44176ab0 2023-11-06T13:28:20.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.538+0000 7f0c437fe700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0c3008cbd0 0x7f0c3008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.538+0000 7f0c437fe700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0c3008cbd0 0x7f0c3008f090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0c34005750 tx=0x7f0c34009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.541+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0c38081bb0 con 0x7f0c44176ab0 2023-11-06T13:28:20.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.713+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0c4417e480 con 0x7f0c44176ab0 2023-11-06T13:28:20.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.713+0000 7f0c2b7fe700 1 -- 172.21.15.38:0/3399803859 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0c38017070 con 0x7f0c44176ab0 2023-11-06T13:28:20.717 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-11-06T13:28:20.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0c3008cbd0 msgr2=0x7f0c3008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0c3008cbd0 0x7f0c3008f090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f0c34005750 tx=0x7f0c34009040).stop 2023-11-06T13:28:20.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 msgr2=0x7f0c44170670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 0x7f0c44170670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f0c38007fd0 tx=0x7f0c38007c20).stop 2023-11-06T13:28:20.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 shutdown_connections 2023-11-06T13:28:20.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0c3008cbd0 0x7f0c3008f090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c44176e90 0x7f0c44170b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0c440c4ed0 0x7f0c4416fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 --2- 172.21.15.38:0/3399803859 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0c44176ab0 0x7f0c44170670 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 >> 172.21.15.38:0/3399803859 conn(0x7f0c440efbd0 msgr2=0x7f0c44174020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:20.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 shutdown_connections 2023-11-06T13:28:20.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.715+0000 7f0c49ac1700 1 -- 172.21.15.38:0/3399803859 wait complete. 2023-11-06T13:28:20.731 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-11-06T13:28:20.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:28:20.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.847+0000 7f93519a6700 1 Processor -- start 2023-11-06T13:28:20.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.847+0000 7f93519a6700 1 -- start start 2023-11-06T13:28:20.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.848+0000 7f93519a6700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f934c17e570 0x7f934c186590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.848+0000 7f93519a6700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c17d9d0 con 0x7f934c1756e0 2023-11-06T13:28:20.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.848+0000 7f93519a6700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c17c800 con 0x7f934c0647f0 2023-11-06T13:28:20.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.848+0000 7f93519a6700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0c8560 con 0x7f934c17e570 2023-11-06T13:28:20.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.848+0000 7f934affd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f934c1756e0 0x7f934c0640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50048/0 (socket says 172.21.15.38:50048) 2023-11-06T13:28:20.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.848+0000 7f934affd700 1 -- 172.21.15.38:0/2209157990 learned_addr learned my addr 172.21.15.38:0/2209157990 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:20.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f934b7fe700 1 --2- 172.21.15.38:0/2209157990 >> v2:172.21.15.163:3300/0 conn(0x7f934c17e570 0x7f934c186590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f9349ffb700 1 -- 172.21.15.38:0/2209157990 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232952369 0 0) 0x7f934c17d9d0 con 0x7f934c1756e0 2023-11-06T13:28:20.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f9349ffb700 1 -- 172.21.15.38:0/2209157990 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93380033f0 con 0x7f934c1756e0 2023-11-06T13:28:20.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f934b7fe700 1 -- 172.21.15.38:0/2209157990 >> v1:172.21.15.163:6789/0 conn(0x7f934c0647f0 legacy=0x7f934c17de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f9349ffb700 1 -- 172.21.15.38:0/2209157990 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521619651 0 0) 0x7f93380033f0 con 0x7f934c1756e0 2023-11-06T13:28:20.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f934b7fe700 1 -- 172.21.15.38:0/2209157990 >> v1:172.21.15.38:6789/0 conn(0x7f934c1756e0 legacy=0x7f934c0640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f934b7fe700 1 -- 172.21.15.38:0/2209157990 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c17cae0 con 0x7f934c17e570 2023-11-06T13:28:20.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f934b7fe700 1 --2- 172.21.15.38:0/2209157990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c17e570 0x7f934c186590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f933c009760 tx=0x7f933c009060).ready entity=mon.2 client_cookie=2aece20fa027f64f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f9349ffb700 1 -- 172.21.15.38:0/2209157990 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440017f0 con 0x7f934c17e570 2023-11-06T13:28:20.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f9349ffb700 1 -- 172.21.15.38:0/2209157990 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c012410 con 0x7f934c17e570 2023-11-06T13:28:20.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.849+0000 7f9349ffb700 1 -- 172.21.15.38:0/2209157990 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c012790 con 0x7f934c17e570 2023-11-06T13:28:20.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 -- 172.21.15.38:0/2209157990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c17e570 msgr2=0x7f934c186590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 --2- 172.21.15.38:0/2209157990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c17e570 0x7f934c186590 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f933c009760 tx=0x7f933c009060).stop 2023-11-06T13:28:20.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 -- 172.21.15.38:0/2209157990 shutdown_connections 2023-11-06T13:28:20.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 --2- 172.21.15.38:0/2209157990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c17e570 0x7f934c186590 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 -- 172.21.15.38:0/2209157990 >> 172.21.15.38:0/2209157990 conn(0x7f934c069ea0 msgr2=0x7f934c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:20.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 -- 172.21.15.38:0/2209157990 shutdown_connections 2023-11-06T13:28:20.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.850+0000 7f93519a6700 1 -- 172.21.15.38:0/2209157990 wait complete. 2023-11-06T13:28:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.851+0000 7f93519a6700 1 Processor -- start 2023-11-06T13:28:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.851+0000 7f93519a6700 1 -- start start 2023-11-06T13:28:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f93519a6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c0647f0 0x7f934c191950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f93519a6700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f934c1756e0 0x7f934c192960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f93519a6700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 0x7f934c190490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f93519a6700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c16f5d0 con 0x7f934c17e570 2023-11-06T13:28:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f93519a6700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c16e6e0 con 0x7f934c1756e0 2023-11-06T13:28:20.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f93519a6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c16e9c0 con 0x7f934c0647f0 2023-11-06T13:28:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f934b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 0x7f934c190490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f934b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 0x7f934c190490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48434/0 (socket says 172.21.15.38:48434) 2023-11-06T13:28:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f934b7fe700 1 -- 172.21.15.38:0/3177421448 learned_addr learned my addr 172.21.15.38:0/3177421448 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:20.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.852+0000 7f934affd700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c0647f0 0x7f934c191950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934a7fc700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f934c1756e0 0x7f934c192960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934b7fe700 1 -- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c0647f0 msgr2=0x7f934c191950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934b7fe700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c0647f0 0x7f934c191950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934b7fe700 1 -- 172.21.15.38:0/3177421448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f934c1756e0 msgr2=0x7f934c192960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:20.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934b7fe700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f934c1756e0 0x7f934c192960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:20.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934b7fe700 1 -- 172.21.15.38:0/3177421448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0092a0 con 0x7f934c17e570 2023-11-06T13:28:20.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934a7fc700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f934c1756e0 0x7f934c192960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:20.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f934b7fe700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 0x7f934c190490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f933c009e00 tx=0x7f933c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c011d70 con 0x7f934c17e570 2023-11-06T13:28:20.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c01d3f0 con 0x7f934c17e570 2023-11-06T13:28:20.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c16eca0 con 0x7f934c17e570 2023-11-06T13:28:20.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c01d790 con 0x7f934c17e570 2023-11-06T13:28:20.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.853+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c16f260 con 0x7f934c17e570 2023-11-06T13:28:20.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.854+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c06c580 con 0x7f934c17e570 2023-11-06T13:28:20.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.855+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f933c01db80 con 0x7f934c17e570 2023-11-06T13:28:20.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.855+0000 7f9342ffd700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f932c08cbd0 0x7f932c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:20.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.856+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f933c0b3d60 con 0x7f934c17e570 2023-11-06T13:28:20.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.856+0000 7f934affd700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f932c08cbd0 0x7f932c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:20.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.856+0000 7f934affd700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f932c08cbd0 0x7f932c08f090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f934c063080 tx=0x7f9344001d90).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:20.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:20.860+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f933c084220 con 0x7f934c17e570 2023-11-06T13:28:21.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.074+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f934c06c580 con 0x7f934c17e570 2023-11-06T13:28:21.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.074+0000 7f9342ffd700 1 -- 172.21.15.38:0/3177421448 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10635 (secure 0 0 0) 0x7f933c08b9a0 con 0x7f934c17e570 2023-11-06T13:28:21.078 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:21.079 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:58.254004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4361,"mds_1":4355,"mds_2":4352,"mds_3":4349,"mds_4":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4315":{"gid":4315,"name":"e","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4321":{"gid":4321,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4323":{"gid":4323,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4326":{"gid":4326,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4349":{"gid":4349,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4352":{"gid":4352,"name":"c","rank":2,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4355":{"gid":4355,"name":"i","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-06T13:28:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.076+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f932c08cbd0 msgr2=0x7f932c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.076+0000 7f93519a6700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f932c08cbd0 0x7f932c08f090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f934c063080 tx=0x7f9344001d90).stop 2023-11-06T13:28:21.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.076+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 msgr2=0x7f934c190490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.076+0000 7f93519a6700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 0x7f934c190490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f933c009e00 tx=0x7f933c015000).stop 2023-11-06T13:28:21.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 shutdown_connections 2023-11-06T13:28:21.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f934c17e570 0x7f934c190490 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f934c0647f0 0x7f934c191950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f932c08cbd0 0x7f932c08f090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 --2- 172.21.15.38:0/3177421448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f934c1756e0 0x7f934c192960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 >> 172.21.15.38:0/3177421448 conn(0x7f934c069ea0 msgr2=0x7f934c0cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:21.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 shutdown_connections 2023-11-06T13:28:21.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.077+0000 7f93519a6700 1 -- 172.21.15.38:0/3177421448 wait complete. 2023-11-06T13:28:21.084 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2023-11-06T13:28:21.092 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-11-06T13:28:21.092 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-11-06T13:28:21.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:28:21.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.207+0000 7f1d48a0f700 1 Processor -- start 2023-11-06T13:28:21.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.207+0000 7f1d48a0f700 1 -- start start 2023-11-06T13:28:21.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.208+0000 7f1d48a0f700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1d441756e0 0x7f1d440640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.212 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.208+0000 7f1d48a0f700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d4417e570 0x7f1d44185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.208+0000 7f1d48a0f700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4417d9d0 con 0x7f1d440645d0 2023-11-06T13:28:21.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.208+0000 7f1d48a0f700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d440c8560 con 0x7f1d4417e570 2023-11-06T13:28:21.213 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.208+0000 7f1d48a0f700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d44064a50 con 0x7f1d441756e0 2023-11-06T13:28:21.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d4417e570 0x7f1d44185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1d4417e570 0x7f1d44185580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48446/0 (socket says 172.21.15.38:48446) 2023-11-06T13:28:21.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 -- 172.21.15.38:0/4174602064 learned_addr learned my addr 172.21.15.38:0/4174602064 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:21.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d4259c700 1 --2- 172.21.15.38:0/4174602064 >> v2:172.21.15.44:3300/0 conn(0x7f1d441756e0 0x7f1d440640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.214 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 -- 172.21.15.38:0/4174602064 >> v2:172.21.15.44:3300/0 conn(0x7f1d441756e0 msgr2=0x7f1d440640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:21.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 --2- 172.21.15.38:0/4174602064 >> v2:172.21.15.44:3300/0 conn(0x7f1d441756e0 0x7f1d440640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 -- 172.21.15.38:0/4174602064 >> v1:172.21.15.44:6789/0 conn(0x7f1d440645d0 legacy=0x7f1d4417de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 -- 172.21.15.38:0/4174602064 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4417c800 con 0x7f1d4417e570 2023-11-06T13:28:21.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d42d9d700 1 --2- 172.21.15.38:0/4174602064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d4417e570 0x7f1d44185580 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f1d440ce060 tx=0x7f1d340090f0).ready entity=mon.0 client_cookie=bc2a8f672bb2389f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d4159a700 1 -- 172.21.15.38:0/4174602064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400b520 con 0x7f1d4417e570 2023-11-06T13:28:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d4159a700 1 -- 172.21.15.38:0/4174602064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400b680 con 0x7f1d4417e570 2023-11-06T13:28:21.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.209+0000 7f1d4159a700 1 -- 172.21.15.38:0/4174602064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400ba00 con 0x7f1d4417e570 2023-11-06T13:28:21.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 -- 172.21.15.38:0/4174602064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d4417e570 msgr2=0x7f1d44185580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/4174602064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d4417e570 0x7f1d44185580 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f1d440ce060 tx=0x7f1d340090f0).stop 2023-11-06T13:28:21.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 -- 172.21.15.38:0/4174602064 shutdown_connections 2023-11-06T13:28:21.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/4174602064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d4417e570 0x7f1d44185580 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/4174602064 >> v2:172.21.15.44:3300/0 conn(0x7f1d441756e0 0x7f1d440640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 -- 172.21.15.38:0/4174602064 >> 172.21.15.38:0/4174602064 conn(0x7f1d44069ea0 msgr2=0x7f1d4406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:21.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 -- 172.21.15.38:0/4174602064 shutdown_connections 2023-11-06T13:28:21.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.210+0000 7f1d48a0f700 1 -- 172.21.15.38:0/4174602064 wait complete. 2023-11-06T13:28:21.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.211+0000 7f1d48a0f700 1 Processor -- start 2023-11-06T13:28:21.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.211+0000 7f1d48a0f700 1 -- start start 2023-11-06T13:28:21.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d48a0f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d440645d0 0x7f1d4416e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d48a0f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 0x7f1d44179fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d48a0f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d4417e570 0x7f1d4417a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d48a0f700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4416e940 con 0x7f1d441756e0 2023-11-06T13:28:21.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d48a0f700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d44179280 con 0x7f1d440645d0 2023-11-06T13:28:21.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d48a0f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d44179b20 con 0x7f1d4417e570 2023-11-06T13:28:21.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d41d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 0x7f1d44179fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d41d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 0x7f1d44179fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48450/0 (socket says 172.21.15.38:48450) 2023-11-06T13:28:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.212+0000 7f1d41d9b700 1 -- 172.21.15.38:0/3305434315 learned_addr learned my addr 172.21.15.38:0/3305434315 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d4259c700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d440645d0 0x7f1d4416e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d42d9d700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d4417e570 0x7f1d4417a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d41d9b700 1 -- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d4417e570 msgr2=0x7f1d4417a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d41d9b700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d4417e570 0x7f1d4417a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d41d9b700 1 -- 172.21.15.38:0/3305434315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d440645d0 msgr2=0x7f1d4416e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d41d9b700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d440645d0 0x7f1d4416e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d41d9b700 1 -- 172.21.15.38:0/3305434315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34009370 con 0x7f1d441756e0 2023-11-06T13:28:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d41d9b700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 0x7f1d44179fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f1d2c00c440 tx=0x7f1d2c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00ce40 con 0x7f1d441756e0 2023-11-06T13:28:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c007020 con 0x7f1d441756e0 2023-11-06T13:28:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d440f4b50 con 0x7f1d441756e0 2023-11-06T13:28:21.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c0073e0 con 0x7f1d441756e0 2023-11-06T13:28:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.213+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d441794d0 con 0x7f1d441756e0 2023-11-06T13:28:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.214+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4406c580 con 0x7f1d441756e0 2023-11-06T13:28:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.215+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f1d2c0068b0 con 0x7f1d441756e0 2023-11-06T13:28:21.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.215+0000 7f1d3a7fc700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1d2408cbd0 0x7f1d2408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.216+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f1d2c0b1980 con 0x7f1d441756e0 2023-11-06T13:28:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.216+0000 7f1d4259c700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1d2408cbd0 0x7f1d2408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.216+0000 7f1d4259c700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1d2408cbd0 0x7f1d2408f090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f1d3c009fd0 tx=0x7f1d3c00b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.219+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1d2c081e40 con 0x7f1d441756e0 2023-11-06T13:28:21.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.386+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d4417cae0 con 0x7f1d2408cbd0 2023-11-06T13:28:21.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.399+0000 7f1d3a7fc700 1 -- 172.21.15.38:0/3305434315 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434683 (secure 0 0 0) 0x7f1d4417cae0 con 0x7f1d2408cbd0 2023-11-06T13:28:21.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:21.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.402+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1d2408cbd0 msgr2=0x7f1d2408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.402+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1d2408cbd0 0x7f1d2408f090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f1d3c009fd0 tx=0x7f1d3c00b040).stop 2023-11-06T13:28:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 msgr2=0x7f1d44179fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 0x7f1d44179fb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f1d2c00c440 tx=0x7f1d2c007e00).stop 2023-11-06T13:28:21.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 shutdown_connections 2023-11-06T13:28:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d4417e570 0x7f1d4417a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1d2408cbd0 0x7f1d2408f090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d440645d0 0x7f1d4416e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 --2- 172.21.15.38:0/3305434315 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1d441756e0 0x7f1d44179fb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 >> 172.21.15.38:0/3305434315 conn(0x7f1d44069ea0 msgr2=0x7f1d4416f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 shutdown_connections 2023-11-06T13:28:21.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.403+0000 7f1d48a0f700 1 -- 172.21.15.38:0/3305434315 wait complete. 2023-11-06T13:28:21.415 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:28:21.418 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-11-06T13:28:21.263146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65446,"num_objects":100,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":251,"num_read_kb":198,"num_write":241,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569572,"kb_used_data":4420,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892508,"statfs":{"total":1159641169920,"available":1155985928192,"internally_reserved":0,"allocated":4526080,"data_stored":2095944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1370,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":59,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004206"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'29","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.293242+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:28:16.293242+0000","last_peered":"2023-11-06T13:28:16.293242+0000","last_clean":"2023-11-06T13:28:16.293242+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:28:16.293242+0000","last_undegraded":"2023-11-06T13:28:16.293242+0000","last_fullsized":"2023-11-06T13:28:16.293242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57006,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":58,"num_write":31,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.282339+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:28:17.282339+0000","last_peered":"2023-11-06T13:28:17.282339+0000","last_clean":"2023-11-06T13:28:17.282339+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:28:17.282339+0000","last_undegraded":"2023-11-06T13:28:17.282339+0000","last_fullsized":"2023-11-06T13:28:17.282339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.491266+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:28:02.491266+0000","last_peered":"2023-11-06T13:28:02.491266+0000","last_clean":"2023-11-06T13:28:02.491266+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:28:02.491266+0000","last_undegraded":"2023-11-06T13:28:02.491266+0000","last_fullsized":"2023-11-06T13:28:02.491266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.281048+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:28:16.281048+0000","last_peered":"2023-11-06T13:28:16.281048+0000","last_clean":"2023-11-06T13:28:16.281048+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:28:16.281048+0000","last_undegraded":"2023-11-06T13:28:16.281048+0000","last_fullsized":"2023-11-06T13:28:16.281048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.277365+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:28:17.277365+0000","last_peered":"2023-11-06T13:28:17.277365+0000","last_clean":"2023-11-06T13:28:17.277365+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:28:17.277365+0000","last_undegraded":"2023-11-06T13:28:17.277365+0000","last_fullsized":"2023-11-06T13:28:17.277365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261513+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.261513+0000","last_peered":"2023-11-06T13:27:57.261513+0000","last_clean":"2023-11-06T13:27:57.261513+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.261513+0000","last_undegraded":"2023-11-06T13:27:57.261513+0000","last_fullsized":"2023-11-06T13:27:57.261513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.275549+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:28:17.275549+0000","last_peered":"2023-11-06T13:28:17.275549+0000","last_clean":"2023-11-06T13:28:17.275549+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:28:17.275549+0000","last_undegraded":"2023-11-06T13:28:17.275549+0000","last_fullsized":"2023-11-06T13:28:17.275549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.277676+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:28:17.277676+0000","last_peered":"2023-11-06T13:28:17.277676+0000","last_clean":"2023-11-06T13:28:17.277676+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:28:17.277676+0000","last_undegraded":"2023-11-06T13:28:17.277676+0000","last_fullsized":"2023-11-06T13:28:17.277676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.281560+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:28:16.281560+0000","last_peered":"2023-11-06T13:28:16.281560+0000","last_clean":"2023-11-06T13:28:16.281560+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:28:16.281560+0000","last_undegraded":"2023-11-06T13:28:16.281560+0000","last_fullsized":"2023-11-06T13:28:16.281560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.292759+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:28:16.292759+0000","last_peered":"2023-11-06T13:28:16.292759+0000","last_clean":"2023-11-06T13:28:16.292759+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:28:16.292759+0000","last_undegraded":"2023-11-06T13:28:16.292759+0000","last_fullsized":"2023-11-06T13:28:16.292759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'5","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.281736+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:28:17.281736+0000","last_peered":"2023-11-06T13:28:17.281736+0000","last_clean":"2023-11-06T13:28:17.281736+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:28:17.281736+0000","last_undegraded":"2023-11-06T13:28:17.281736+0000","last_fullsized":"2023-11-06T13:28:17.281736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65200,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":251,"num_read_kb":198,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":130400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.383}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":10,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":222857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":8,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":165567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":166449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":458752,"data_stored":230359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":61000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:28:21.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:28:21.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.575+0000 7f6cef06e700 1 Processor -- start 2023-11-06T13:28:21.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.575+0000 7f6cef06e700 1 -- start start 2023-11-06T13:28:21.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cef06e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6ce8175510 0x7f6ce81758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cef06e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ce80cada0 0x7f6ce80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cef06e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6ce817c950 0x7f6ce817cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cef06e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce817e680 con 0x7f6ce80cada0 2023-11-06T13:28:21.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cef06e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce817d790 con 0x7f6ce8175510 2023-11-06T13:28:21.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cef06e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce817da70 con 0x7f6ce817c950 2023-11-06T13:28:21.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ce80cada0 0x7f6ce80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f6ce80cada0 0x7f6ce80cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48452/0 (socket says 172.21.15.38:48452) 2023-11-06T13:28:21.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 -- 172.21.15.38:0/3748087406 learned_addr learned my addr 172.21.15.38:0/3748087406 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:21.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6cece0a700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.44:3300/0 conn(0x7f6ce8175510 0x7f6ce81758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ced60b700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.163:3300/0 conn(0x7f6ce817c950 0x7f6ce817cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 -- 172.21.15.38:0/3748087406 >> v2:172.21.15.163:3300/0 conn(0x7f6ce817c950 msgr2=0x7f6ce817cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:21.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.163:3300/0 conn(0x7f6ce817c950 0x7f6ce817cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 -- 172.21.15.38:0/3748087406 >> v2:172.21.15.44:3300/0 conn(0x7f6ce8175510 msgr2=0x7f6ce81758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:21.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.44:3300/0 conn(0x7f6ce8175510 0x7f6ce81758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 -- 172.21.15.38:0/3748087406 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce817dd50 con 0x7f6ce80cada0 2023-11-06T13:28:21.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ced60b700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.163:3300/0 conn(0x7f6ce817c950 0x7f6ce817cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:21.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.576+0000 7f6ce7fff700 1 --2- 172.21.15.38:0/3748087406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce80cada0 0x7f6ce80cb200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f6ce8083930 tx=0x7f6cd40090f0).ready entity=mon.0 client_cookie=1477336469c19f32 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6ce77fe700 1 -- 172.21.15.38:0/3748087406 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400b5a0 con 0x7f6ce80cada0 2023-11-06T13:28:21.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6ce77fe700 1 -- 172.21.15.38:0/3748087406 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400b700 con 0x7f6ce80cada0 2023-11-06T13:28:21.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6ce77fe700 1 -- 172.21.15.38:0/3748087406 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400ba80 con 0x7f6ce80cada0 2023-11-06T13:28:21.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 -- 172.21.15.38:0/3748087406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce80cada0 msgr2=0x7f6ce80cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 --2- 172.21.15.38:0/3748087406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce80cada0 0x7f6ce80cb200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f6ce8083930 tx=0x7f6cd40090f0).stop 2023-11-06T13:28:21.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 -- 172.21.15.38:0/3748087406 shutdown_connections 2023-11-06T13:28:21.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.163:3300/0 conn(0x7f6ce817c950 0x7f6ce817cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 --2- 172.21.15.38:0/3748087406 >> v2:172.21.15.44:3300/0 conn(0x7f6ce8175510 0x7f6ce81758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 --2- 172.21.15.38:0/3748087406 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce80cada0 0x7f6ce80cb200 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 -- 172.21.15.38:0/3748087406 >> 172.21.15.38:0/3748087406 conn(0x7f6ce80f28b0 msgr2=0x7f6ce8069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:21.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 -- 172.21.15.38:0/3748087406 shutdown_connections 2023-11-06T13:28:21.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.577+0000 7f6cef06e700 1 -- 172.21.15.38:0/3748087406 wait complete. 2023-11-06T13:28:21.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.578+0000 7f6cef06e700 1 Processor -- start 2023-11-06T13:28:21.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.579+0000 7f6cef06e700 1 -- start start 2023-11-06T13:28:21.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce80cada0 0x7f6ce8176480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce8175510 0x7f6ce816eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 0x7f6ce80ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80edcd0 con 0x7f6ce817c950 2023-11-06T13:28:21.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8176970 con 0x7f6ce80cada0 2023-11-06T13:28:21.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ecde0 con 0x7f6ce8175510 2023-11-06T13:28:21.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 0x7f6ce80ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 0x7f6ce80ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48458/0 (socket says 172.21.15.38:48458) 2023-11-06T13:28:21.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 -- 172.21.15.38:0/2106539161 learned_addr learned my addr 172.21.15.38:0/2106539161 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:21.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cece0a700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce80cada0 0x7f6ce8176480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ce7fff700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce8175510 0x7f6ce816eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 -- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce8175510 msgr2=0x7f6ce816eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce8175510 0x7f6ce816eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 -- 172.21.15.38:0/2106539161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce80cada0 msgr2=0x7f6ce8176480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce80cada0 0x7f6ce8176480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 -- 172.21.15.38:0/2106539161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009370 con 0x7f6ce817c950 2023-11-06T13:28:21.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cece0a700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce80cada0 0x7f6ce8176480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:21.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ce7fff700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce8175510 0x7f6ce816eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:21.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ced60b700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 0x7f6ce80ee160 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f6ce000cef0 tx=0x7f6ce0007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000ae00 con 0x7f6ce817c950 2023-11-06T13:28:21.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0016400 con 0x7f6ce817c950 2023-11-06T13:28:21.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce80ed0c0 con 0x7f6ce817c950 2023-11-06T13:28:21.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.580+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00167a0 con 0x7f6ce817c950 2023-11-06T13:28:21.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.581+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ed680 con 0x7f6ce817c950 2023-11-06T13:28:21.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.582+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce806c580 con 0x7f6ce817c950 2023-11-06T13:28:21.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.582+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f6ce0016b90 con 0x7f6ce817c950 2023-11-06T13:28:21.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.583+0000 7f6ce4ff9700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6ccc08cbd0 0x7f6ccc08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.583+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f6ce00b2b70 con 0x7f6ce817c950 2023-11-06T13:28:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.583+0000 7f6cece0a700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6ccc08cbd0 0x7f6ccc08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.584+0000 7f6cece0a700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6ccc08cbd0 0x7f6ccc08f090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6cdc00bb60 tx=0x7f6cdc008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.587+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6ce00830b0 con 0x7f6ce817c950 2023-11-06T13:28:21.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.753+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ce817e030 con 0x7f6ccc08cbd0 2023-11-06T13:28:21.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.766+0000 7f6ce4ff9700 1 -- 172.21.15.38:0/2106539161 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434683 (secure 0 0 0) 0x7f6ce817e030 con 0x7f6ccc08cbd0 2023-11-06T13:28:21.776 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6ccc08cbd0 msgr2=0x7f6ccc08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6ccc08cbd0 0x7f6ccc08f090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6cdc00bb60 tx=0x7f6cdc008040).stop 2023-11-06T13:28:21.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 msgr2=0x7f6ce80ee160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 0x7f6ce80ee160 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f6ce000cef0 tx=0x7f6ce0007860).stop 2023-11-06T13:28:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 shutdown_connections 2023-11-06T13:28:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6ce817c950 0x7f6ce80ee160 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f6ccc08cbd0 0x7f6ccc08f090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce80cada0 0x7f6ce8176480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 --2- 172.21.15.38:0/2106539161 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ce8175510 0x7f6ce816eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 >> 172.21.15.38:0/2106539161 conn(0x7f6ce80f28b0 msgr2=0x7f6ce80f2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 shutdown_connections 2023-11-06T13:28:21.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.770+0000 7f6cef06e700 1 -- 172.21.15.38:0/2106539161 wait complete. 2023-11-06T13:28:21.784 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:28:21.785 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-11-06T13:28:21.263146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65446,"num_objects":100,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":251,"num_read_kb":198,"num_write":241,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569572,"kb_used_data":4420,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892508,"statfs":{"total":1159641169920,"available":1155985928192,"internally_reserved":0,"allocated":4526080,"data_stored":2095944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1370,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":59,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004206"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'29","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.293242+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:28:16.293242+0000","last_peered":"2023-11-06T13:28:16.293242+0000","last_clean":"2023-11-06T13:28:16.293242+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:28:16.293242+0000","last_undegraded":"2023-11-06T13:28:16.293242+0000","last_fullsized":"2023-11-06T13:28:16.293242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57006,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":58,"num_write":31,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.282339+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:28:17.282339+0000","last_peered":"2023-11-06T13:28:17.282339+0000","last_clean":"2023-11-06T13:28:17.282339+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:28:17.282339+0000","last_undegraded":"2023-11-06T13:28:17.282339+0000","last_fullsized":"2023-11-06T13:28:17.282339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.491266+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:28:02.491266+0000","last_peered":"2023-11-06T13:28:02.491266+0000","last_clean":"2023-11-06T13:28:02.491266+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:28:02.491266+0000","last_undegraded":"2023-11-06T13:28:02.491266+0000","last_fullsized":"2023-11-06T13:28:02.491266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.281048+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:28:16.281048+0000","last_peered":"2023-11-06T13:28:16.281048+0000","last_clean":"2023-11-06T13:28:16.281048+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:28:16.281048+0000","last_undegraded":"2023-11-06T13:28:16.281048+0000","last_fullsized":"2023-11-06T13:28:16.281048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.277365+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:28:17.277365+0000","last_peered":"2023-11-06T13:28:17.277365+0000","last_clean":"2023-11-06T13:28:17.277365+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:28:17.277365+0000","last_undegraded":"2023-11-06T13:28:17.277365+0000","last_fullsized":"2023-11-06T13:28:17.277365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261513+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.261513+0000","last_peered":"2023-11-06T13:27:57.261513+0000","last_clean":"2023-11-06T13:27:57.261513+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.261513+0000","last_undegraded":"2023-11-06T13:27:57.261513+0000","last_fullsized":"2023-11-06T13:27:57.261513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.275549+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:28:17.275549+0000","last_peered":"2023-11-06T13:28:17.275549+0000","last_clean":"2023-11-06T13:28:17.275549+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:28:17.275549+0000","last_undegraded":"2023-11-06T13:28:17.275549+0000","last_fullsized":"2023-11-06T13:28:17.275549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.277676+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:28:17.277676+0000","last_peered":"2023-11-06T13:28:17.277676+0000","last_clean":"2023-11-06T13:28:17.277676+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:28:17.277676+0000","last_undegraded":"2023-11-06T13:28:17.277676+0000","last_fullsized":"2023-11-06T13:28:17.277676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.281560+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:28:16.281560+0000","last_peered":"2023-11-06T13:28:16.281560+0000","last_clean":"2023-11-06T13:28:16.281560+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:28:16.281560+0000","last_undegraded":"2023-11-06T13:28:16.281560+0000","last_fullsized":"2023-11-06T13:28:16.281560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.292759+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:28:16.292759+0000","last_peered":"2023-11-06T13:28:16.292759+0000","last_clean":"2023-11-06T13:28:16.292759+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:28:16.292759+0000","last_undegraded":"2023-11-06T13:28:16.292759+0000","last_fullsized":"2023-11-06T13:28:16.292759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'5","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.281736+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:28:17.281736+0000","last_peered":"2023-11-06T13:28:17.281736+0000","last_clean":"2023-11-06T13:28:17.281736+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:28:17.281736+0000","last_undegraded":"2023-11-06T13:28:17.281736+0000","last_fullsized":"2023-11-06T13:28:17.281736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65200,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":251,"num_read_kb":198,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":130400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.383}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":10,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":222857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":8,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":165567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":166449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":458752,"data_stored":230359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":61000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:28:21.793 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-11-06T13:28:21.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-06T13:28:21.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.942+0000 7f6958f90700 1 Processor -- start 2023-11-06T13:28:21.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.942+0000 7f6958f90700 1 -- start start 2023-11-06T13:28:21.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.943+0000 7f6958f90700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6954180640 0x7f6954182a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.943+0000 7f6958f90700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69540871b0 con 0x7f6954175680 2023-11-06T13:28:21.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.943+0000 7f6958f90700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69540882f0 con 0x7f69541752a0 2023-11-06T13:28:21.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.943+0000 7f6958f90700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6954182ef0 con 0x7f6954180640 2023-11-06T13:28:21.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f6953fff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f6954175680 0x7f6954085d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50056/0 (socket says 172.21.15.38:50056) 2023-11-06T13:28:21.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f6953fff700 1 -- 172.21.15.38:0/2172955791 learned_addr learned my addr 172.21.15.38:0/2172955791 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:21.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f6952ffd700 1 --2- 172.21.15.38:0/2172955791 >> v2:172.21.15.163:3300/0 conn(0x7f6954180640 0x7f6954182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956044011 0 0) 0x7f69540871b0 con 0x7f6954175680 2023-11-06T13:28:21.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f693c0033f0 con 0x7f6954175680 2023-11-06T13:28:21.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339159296 0 0) 0x7f69540882f0 con 0x7f69541752a0 2023-11-06T13:28:21.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69540871b0 con 0x7f69541752a0 2023-11-06T13:28:21.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1200576576 0 0) 0x7f693c0033f0 con 0x7f6954175680 2023-11-06T13:28:21.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 >> v2:172.21.15.163:3300/0 conn(0x7f6954180640 msgr2=0x7f6954182a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:21.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 --2- 172.21.15.38:0/2172955791 >> v2:172.21.15.163:3300/0 conn(0x7f6954180640 0x7f6954182a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 >> v1:172.21.15.44:6789/0 conn(0x7f69541752a0 legacy=0x7f695417ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954087400 con 0x7f6954175680 2023-11-06T13:28:21.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f694c0017f0 con 0x7f6954175680 2023-11-06T13:28:21.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 >> v1:172.21.15.38:6789/0 conn(0x7f6954175680 legacy=0x7f6954085d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f693c003ac0 0x7f693c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f693c004690 0x7f693c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c005070 0x7f693c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6954182ef0 con 0x7f693c003ac0 2023-11-06T13:28:21.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c00c010 con 0x7f693c005070 2023-11-06T13:28:21.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c00c1d0 con 0x7f693c004690 2023-11-06T13:28:21.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f69537fe700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f693c003ac0 0x7f693c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f6952ffd700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f693c004690 0x7f693c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.944+0000 7f6953fff700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c005070 0x7f693c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69537fe700 1 -- 172.21.15.38:0/2172955791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f693c004690 msgr2=0x7f693c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:21.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69537fe700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f693c004690 0x7f693c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69537fe700 1 -- 172.21.15.38:0/2172955791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c005070 msgr2=0x7f693c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:21.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69537fe700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c005070 0x7f693c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69537fe700 1 -- 172.21.15.38:0/2172955791 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0033f0 con 0x7f693c003ac0 2023-11-06T13:28:21.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6953fff700 1 -- 172.21.15.38:0/2172955791 reap_dead start 2023-11-06T13:28:21.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69537fe700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f693c003ac0 0x7f693c003ec0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6944001890 tx=0x7f6944007bb0).ready entity=mon.0 client_cookie=a63b633670f248f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944007020 con 0x7f693c003ac0 2023-11-06T13:28:21.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944007180 con 0x7f693c003ac0 2023-11-06T13:28:21.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f69527fc700 1 -- 172.21.15.38:0/2172955791 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944007500 con 0x7f693c003ac0 2023-11-06T13:28:21.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 -- 172.21.15.38:0/2172955791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f693c003ac0 msgr2=0x7f693c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f693c003ac0 0x7f693c003ec0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6944001890 tx=0x7f6944007bb0).stop 2023-11-06T13:28:21.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 -- 172.21.15.38:0/2172955791 shutdown_connections 2023-11-06T13:28:21.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 --2- 172.21.15.38:0/2172955791 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f693c003ac0 0x7f693c003ec0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 -- 172.21.15.38:0/2172955791 >> 172.21.15.38:0/2172955791 conn(0x7f69540f51f0 msgr2=0x7f69540f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:21.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 -- 172.21.15.38:0/2172955791 shutdown_connections 2023-11-06T13:28:21.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.945+0000 7f6958f90700 1 -- 172.21.15.38:0/2172955791 wait complete. 2023-11-06T13:28:21.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.947+0000 7f6958f90700 1 Processor -- start 2023-11-06T13:28:21.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.947+0000 7f6958f90700 1 -- start start 2023-11-06T13:28:21.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6958f90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c003ac0 0x7f6954173470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6958f90700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6954173960 0x7f695418fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6958f90700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 0x7f69540f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6958f90700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69540f4ea0 con 0x7f6954190380 2023-11-06T13:28:21.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6958f90700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69540f0870 con 0x7f693c003ac0 2023-11-06T13:28:21.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6958f90700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69540efc60 con 0x7f6954173960 2023-11-06T13:28:21.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 0x7f69540f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 0x7f69540f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48468/0 (socket says 172.21.15.38:48468) 2023-11-06T13:28:21.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 -- 172.21.15.38:0/563628010 learned_addr learned my addr 172.21.15.38:0/563628010 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:21.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6952ffd700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6954173960 0x7f695418fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f69537fe700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c003ac0 0x7f6954173470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 -- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6954173960 msgr2=0x7f695418fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6954173960 0x7f695418fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 -- 172.21.15.38:0/563628010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c003ac0 msgr2=0x7f6954173470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:21.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c003ac0 0x7f6954173470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:21.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.948+0000 7f6953fff700 1 -- 172.21.15.38:0/563628010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540eff40 con 0x7f6954190380 2023-11-06T13:28:21.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.949+0000 7f6953fff700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 0x7f69540f3f50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f69540f6230 tx=0x7f6954183030).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.949+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00f8a0 con 0x7f6954190380 2023-11-06T13:28:21.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.949+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00fa00 con 0x7f6954190380 2023-11-06T13:28:21.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.949+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69540f0220 con 0x7f6954190380 2023-11-06T13:28:21.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.949+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00fdc0 con 0x7f6954190380 2023-11-06T13:28:21.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.949+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6954190800 con 0x7f6954190380 2023-11-06T13:28:21.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.950+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6954173d40 con 0x7f6954190380 2023-11-06T13:28:21.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.951+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f694c015620 con 0x7f6954190380 2023-11-06T13:28:21.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.951+0000 7f693b7fe700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f694008cba0 0x7f694008f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:21.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.951+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f694c0b1e10 con 0x7f6954190380 2023-11-06T13:28:21.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.952+0000 7f69537fe700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f694008cba0 0x7f694008f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:21.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.952+0000 7f69537fe700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f694008cba0 0x7f694008f060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6944000c00 tx=0x7f6944015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:21.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:21.955+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f6954173d40 con 0x7f6954190380 2023-11-06T13:28:22.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.123+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 --> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6954173d40 con 0x7f694008cba0 2023-11-06T13:28:22.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.136+0000 7f693b7fe700 1 -- 172.21.15.38:0/563628010 <== mgr.4103 v2:172.21.15.163:6832/91073 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+434683 (secure 0 0 0) 0x7f6954173d40 con 0x7f694008cba0 2023-11-06T13:28:22.145 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:22.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f694008cba0 msgr2=0x7f694008f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f694008cba0 0x7f694008f060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f6944000c00 tx=0x7f6944015000).stop 2023-11-06T13:28:22.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 msgr2=0x7f69540f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 0x7f69540f3f50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f69540f6230 tx=0x7f6954183030).stop 2023-11-06T13:28:22.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 shutdown_connections 2023-11-06T13:28:22.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6954190380 0x7f69540f3f50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f694008cba0 0x7f694008f060 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f693c003ac0 0x7f6954173470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 --2- 172.21.15.38:0/563628010 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6954173960 0x7f695418fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 >> 172.21.15.38:0/563628010 conn(0x7f69540f51f0 msgr2=0x7f695417fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:22.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 shutdown_connections 2023-11-06T13:28:22.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.140+0000 7f6958f90700 1 -- 172.21.15.38:0/563628010 wait complete. 2023-11-06T13:28:22.152 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2023-11-06T13:28:22.155 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-11-06T13:28:21.263146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65446,"num_objects":100,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":251,"num_read_kb":198,"num_write":241,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3569572,"kb_used_data":4420,"kb_used_omap":0,"kb_used_meta":3565056,"kb_avail":1128892508,"statfs":{"total":1159641169920,"available":1155985928192,"internally_reserved":0,"allocated":4526080,"data_stored":2095944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3650617344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1370,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":59,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004206"},"pg_stats":[{"pgid":"3.3f","version":"31'9","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.258637+0000","last_change":"2023-11-06T13:27:41.521716+0000","last_active":"2023-11-06T13:27:57.258637+0000","last_peered":"2023-11-06T13:27:57.258637+0000","last_clean":"2023-11-06T13:27:57.258637+0000","last_became_active":"2023-11-06T13:27:41.521418+0000","last_became_peered":"2023-11-06T13:27:41.521418+0000","last_unstale":"2023-11-06T13:27:57.258637+0000","last_undegraded":"2023-11-06T13:27:57.258637+0000","last_fullsized":"2023-11-06T13:27:57.258637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921114+0000","last_change":"2023-11-06T13:27:41.910216+0000","last_active":"2023-11-06T13:27:45.921114+0000","last_peered":"2023-11-06T13:27:45.921114+0000","last_clean":"2023-11-06T13:27:45.921114+0000","last_became_active":"2023-11-06T13:27:41.909910+0000","last_became_peered":"2023-11-06T13:27:41.909910+0000","last_unstale":"2023-11-06T13:27:45.921114+0000","last_undegraded":"2023-11-06T13:27:45.921114+0000","last_fullsized":"2023-11-06T13:27:45.921114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.544618+0000","last_change":"2023-11-06T13:27:41.516322+0000","last_active":"2023-11-06T13:27:46.544618+0000","last_peered":"2023-11-06T13:27:46.544618+0000","last_clean":"2023-11-06T13:27:46.544618+0000","last_became_active":"2023-11-06T13:27:41.514745+0000","last_became_peered":"2023-11-06T13:27:41.514745+0000","last_unstale":"2023-11-06T13:27:46.544618+0000","last_undegraded":"2023-11-06T13:27:46.544618+0000","last_fullsized":"2023-11-06T13:27:46.544618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915777+0000","last_change":"2023-11-06T13:27:41.914964+0000","last_active":"2023-11-06T13:27:45.915777+0000","last_peered":"2023-11-06T13:27:45.915777+0000","last_clean":"2023-11-06T13:27:45.915777+0000","last_became_active":"2023-11-06T13:27:41.914630+0000","last_became_peered":"2023-11-06T13:27:41.914630+0000","last_unstale":"2023-11-06T13:27:45.915777+0000","last_undegraded":"2023-11-06T13:27:45.915777+0000","last_fullsized":"2023-11-06T13:27:45.915777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260696+0000","last_change":"2023-11-06T13:27:41.511096+0000","last_active":"2023-11-06T13:27:57.260696+0000","last_peered":"2023-11-06T13:27:57.260696+0000","last_clean":"2023-11-06T13:27:57.260696+0000","last_became_active":"2023-11-06T13:27:41.510810+0000","last_became_peered":"2023-11-06T13:27:41.510810+0000","last_unstale":"2023-11-06T13:27:57.260696+0000","last_undegraded":"2023-11-06T13:27:57.260696+0000","last_fullsized":"2023-11-06T13:27:57.260696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908876+0000","last_change":"2023-11-06T13:27:41.910421+0000","last_active":"2023-11-06T13:27:45.908876+0000","last_peered":"2023-11-06T13:27:45.908876+0000","last_clean":"2023-11-06T13:27:45.908876+0000","last_became_active":"2023-11-06T13:27:41.909861+0000","last_became_peered":"2023-11-06T13:27:41.909861+0000","last_unstale":"2023-11-06T13:27:45.908876+0000","last_undegraded":"2023-11-06T13:27:45.908876+0000","last_fullsized":"2023-11-06T13:27:45.908876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260595+0000","last_change":"2023-11-06T13:27:41.511781+0000","last_active":"2023-11-06T13:27:57.260595+0000","last_peered":"2023-11-06T13:27:57.260595+0000","last_clean":"2023-11-06T13:27:57.260595+0000","last_became_active":"2023-11-06T13:27:41.511490+0000","last_became_peered":"2023-11-06T13:27:41.511490+0000","last_unstale":"2023-11-06T13:27:57.260595+0000","last_undegraded":"2023-11-06T13:27:57.260595+0000","last_fullsized":"2023-11-06T13:27:57.260595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912533+0000","last_change":"2023-11-06T13:27:41.921271+0000","last_active":"2023-11-06T13:27:45.912533+0000","last_peered":"2023-11-06T13:27:45.912533+0000","last_clean":"2023-11-06T13:27:45.912533+0000","last_became_active":"2023-11-06T13:27:41.921007+0000","last_became_peered":"2023-11-06T13:27:41.921007+0000","last_unstale":"2023-11-06T13:27:45.912533+0000","last_undegraded":"2023-11-06T13:27:45.912533+0000","last_fullsized":"2023-11-06T13:27:45.912533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3b","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914427+0000","last_change":"2023-11-06T13:27:41.518608+0000","last_active":"2023-11-06T13:27:45.914427+0000","last_peered":"2023-11-06T13:27:45.914427+0000","last_clean":"2023-11-06T13:27:45.914427+0000","last_became_active":"2023-11-06T13:27:41.518380+0000","last_became_peered":"2023-11-06T13:27:41.518380+0000","last_unstale":"2023-11-06T13:27:45.914427+0000","last_undegraded":"2023-11-06T13:27:45.914427+0000","last_fullsized":"2023-11-06T13:27:45.914427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921271+0000","last_change":"2023-11-06T13:27:41.912535+0000","last_active":"2023-11-06T13:27:45.921271+0000","last_peered":"2023-11-06T13:27:45.921271+0000","last_clean":"2023-11-06T13:27:45.921271+0000","last_became_active":"2023-11-06T13:27:41.912187+0000","last_became_peered":"2023-11-06T13:27:41.912187+0000","last_unstale":"2023-11-06T13:27:45.921271+0000","last_undegraded":"2023-11-06T13:27:45.921271+0000","last_fullsized":"2023-11-06T13:27:45.921271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361198+0000","last_change":"2023-11-06T13:27:41.518424+0000","last_active":"2023-11-06T13:27:56.361198+0000","last_peered":"2023-11-06T13:27:56.361198+0000","last_clean":"2023-11-06T13:27:56.361198+0000","last_became_active":"2023-11-06T13:27:41.518111+0000","last_became_peered":"2023-11-06T13:27:41.518111+0000","last_unstale":"2023-11-06T13:27:56.361198+0000","last_undegraded":"2023-11-06T13:27:56.361198+0000","last_fullsized":"2023-11-06T13:27:56.361198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909667+0000","last_change":"2023-11-06T13:27:41.909753+0000","last_active":"2023-11-06T13:27:45.909667+0000","last_peered":"2023-11-06T13:27:45.909667+0000","last_clean":"2023-11-06T13:27:45.909667+0000","last_became_active":"2023-11-06T13:27:41.909320+0000","last_became_peered":"2023-11-06T13:27:41.909320+0000","last_unstale":"2023-11-06T13:27:45.909667+0000","last_undegraded":"2023-11-06T13:27:45.909667+0000","last_fullsized":"2023-11-06T13:27:45.909667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.352406+0000","last_change":"2023-11-06T13:27:41.512295+0000","last_active":"2023-11-06T13:27:55.352406+0000","last_peered":"2023-11-06T13:27:55.352406+0000","last_clean":"2023-11-06T13:27:55.352406+0000","last_became_active":"2023-11-06T13:27:41.511983+0000","last_became_peered":"2023-11-06T13:27:41.511983+0000","last_unstale":"2023-11-06T13:27:55.352406+0000","last_undegraded":"2023-11-06T13:27:55.352406+0000","last_fullsized":"2023-11-06T13:27:55.352406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917785+0000","last_change":"2023-11-06T13:27:41.917050+0000","last_active":"2023-11-06T13:27:45.917785+0000","last_peered":"2023-11-06T13:27:45.917785+0000","last_clean":"2023-11-06T13:27:45.917785+0000","last_became_active":"2023-11-06T13:27:41.916567+0000","last_became_peered":"2023-11-06T13:27:41.916567+0000","last_unstale":"2023-11-06T13:27:45.917785+0000","last_undegraded":"2023-11-06T13:27:45.917785+0000","last_fullsized":"2023-11-06T13:27:45.917785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.252478+0000","last_change":"2023-11-06T13:27:41.512762+0000","last_active":"2023-11-06T13:27:57.252478+0000","last_peered":"2023-11-06T13:27:57.252478+0000","last_clean":"2023-11-06T13:27:57.252478+0000","last_became_active":"2023-11-06T13:27:41.512146+0000","last_became_peered":"2023-11-06T13:27:41.512146+0000","last_unstale":"2023-11-06T13:27:57.252478+0000","last_undegraded":"2023-11-06T13:27:57.252478+0000","last_fullsized":"2023-11-06T13:27:57.252478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917786+0000","last_change":"2023-11-06T13:27:41.913128+0000","last_active":"2023-11-06T13:27:45.917786+0000","last_peered":"2023-11-06T13:27:45.917786+0000","last_clean":"2023-11-06T13:27:45.917786+0000","last_became_active":"2023-11-06T13:27:41.912976+0000","last_became_peered":"2023-11-06T13:27:41.912976+0000","last_unstale":"2023-11-06T13:27:45.917786+0000","last_undegraded":"2023-11-06T13:27:45.917786+0000","last_fullsized":"2023-11-06T13:27:45.917786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921123+0000","last_change":"2023-11-06T13:27:41.506915+0000","last_active":"2023-11-06T13:27:45.921123+0000","last_peered":"2023-11-06T13:27:45.921123+0000","last_clean":"2023-11-06T13:27:45.921123+0000","last_became_active":"2023-11-06T13:27:41.506608+0000","last_became_peered":"2023-11-06T13:27:41.506608+0000","last_unstale":"2023-11-06T13:27:45.921123+0000","last_undegraded":"2023-11-06T13:27:45.921123+0000","last_fullsized":"2023-11-06T13:27:45.921123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909659+0000","last_change":"2023-11-06T13:27:41.911808+0000","last_active":"2023-11-06T13:27:45.909659+0000","last_peered":"2023-11-06T13:27:45.909659+0000","last_clean":"2023-11-06T13:27:45.909659+0000","last_became_active":"2023-11-06T13:27:41.911077+0000","last_became_peered":"2023-11-06T13:27:41.911077+0000","last_unstale":"2023-11-06T13:27:45.909659+0000","last_undegraded":"2023-11-06T13:27:45.909659+0000","last_fullsized":"2023-11-06T13:27:45.909659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.344623+0000","last_change":"2023-11-06T13:27:41.515246+0000","last_active":"2023-11-06T13:27:54.344623+0000","last_peered":"2023-11-06T13:27:54.344623+0000","last_clean":"2023-11-06T13:27:54.344623+0000","last_became_active":"2023-11-06T13:27:41.514943+0000","last_became_peered":"2023-11-06T13:27:41.514943+0000","last_unstale":"2023-11-06T13:27:54.344623+0000","last_undegraded":"2023-11-06T13:27:54.344623+0000","last_fullsized":"2023-11-06T13:27:54.344623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913934+0000","last_change":"2023-11-06T13:27:41.913962+0000","last_active":"2023-11-06T13:27:45.913934+0000","last_peered":"2023-11-06T13:27:45.913934+0000","last_clean":"2023-11-06T13:27:45.913934+0000","last_became_active":"2023-11-06T13:27:41.911453+0000","last_became_peered":"2023-11-06T13:27:41.911453+0000","last_unstale":"2023-11-06T13:27:45.913934+0000","last_undegraded":"2023-11-06T13:27:45.913934+0000","last_fullsized":"2023-11-06T13:27:45.913934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.35","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304477+0000","last_change":"2023-11-06T13:27:41.513061+0000","last_active":"2023-11-06T13:27:46.304477+0000","last_peered":"2023-11-06T13:27:46.304477+0000","last_clean":"2023-11-06T13:27:46.304477+0000","last_became_active":"2023-11-06T13:27:41.512712+0000","last_became_peered":"2023-11-06T13:27:41.512712+0000","last_unstale":"2023-11-06T13:27:46.304477+0000","last_undegraded":"2023-11-06T13:27:46.304477+0000","last_fullsized":"2023-11-06T13:27:46.304477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921043+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.921043+0000","last_peered":"2023-11-06T13:27:45.921043+0000","last_clean":"2023-11-06T13:27:45.921043+0000","last_became_active":"2023-11-06T13:27:41.911342+0000","last_became_peered":"2023-11-06T13:27:41.911342+0000","last_unstale":"2023-11-06T13:27:45.921043+0000","last_undegraded":"2023-11-06T13:27:45.921043+0000","last_fullsized":"2023-11-06T13:27:45.921043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"31'29","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.293242+0000","last_change":"2023-11-06T13:27:41.516560+0000","last_active":"2023-11-06T13:28:16.293242+0000","last_peered":"2023-11-06T13:28:16.293242+0000","last_clean":"2023-11-06T13:28:16.293242+0000","last_became_active":"2023-11-06T13:27:41.516248+0000","last_became_peered":"2023-11-06T13:27:41.516248+0000","last_unstale":"2023-11-06T13:28:16.293242+0000","last_undegraded":"2023-11-06T13:28:16.293242+0000","last_fullsized":"2023-11-06T13:28:16.293242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57006,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":58,"num_write":31,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920512+0000","last_change":"2023-11-06T13:27:41.917281+0000","last_active":"2023-11-06T13:27:45.920512+0000","last_peered":"2023-11-06T13:27:45.920512+0000","last_clean":"2023-11-06T13:27:45.920512+0000","last_became_active":"2023-11-06T13:27:41.917021+0000","last_became_peered":"2023-11-06T13:27:41.917021+0000","last_unstale":"2023-11-06T13:27:45.920512+0000","last_undegraded":"2023-11-06T13:27:45.920512+0000","last_fullsized":"2023-11-06T13:27:45.920512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.350400+0000","last_change":"2023-11-06T13:27:41.514702+0000","last_active":"2023-11-06T13:27:55.350400+0000","last_peered":"2023-11-06T13:27:55.350400+0000","last_clean":"2023-11-06T13:27:55.350400+0000","last_became_active":"2023-11-06T13:27:41.514276+0000","last_became_peered":"2023-11-06T13:27:41.514276+0000","last_unstale":"2023-11-06T13:27:55.350400+0000","last_undegraded":"2023-11-06T13:27:55.350400+0000","last_fullsized":"2023-11-06T13:27:55.350400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916894+0000","last_change":"2023-11-06T13:27:41.908709+0000","last_active":"2023-11-06T13:27:45.916894+0000","last_peered":"2023-11-06T13:27:45.916894+0000","last_clean":"2023-11-06T13:27:45.916894+0000","last_became_active":"2023-11-06T13:27:41.908493+0000","last_became_peered":"2023-11-06T13:27:41.908493+0000","last_unstale":"2023-11-06T13:27:45.916894+0000","last_undegraded":"2023-11-06T13:27:45.916894+0000","last_fullsized":"2023-11-06T13:27:45.916894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260793+0000","last_change":"2023-11-06T13:27:41.513043+0000","last_active":"2023-11-06T13:27:57.260793+0000","last_peered":"2023-11-06T13:27:57.260793+0000","last_clean":"2023-11-06T13:27:57.260793+0000","last_became_active":"2023-11-06T13:27:41.512784+0000","last_became_peered":"2023-11-06T13:27:41.512784+0000","last_unstale":"2023-11-06T13:27:57.260793+0000","last_undegraded":"2023-11-06T13:27:57.260793+0000","last_fullsized":"2023-11-06T13:27:57.260793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910140+0000","last_change":"2023-11-06T13:27:41.911639+0000","last_active":"2023-11-06T13:27:45.910140+0000","last_peered":"2023-11-06T13:27:45.910140+0000","last_clean":"2023-11-06T13:27:45.910140+0000","last_became_active":"2023-11-06T13:27:41.911291+0000","last_became_peered":"2023-11-06T13:27:41.911291+0000","last_unstale":"2023-11-06T13:27:45.910140+0000","last_undegraded":"2023-11-06T13:27:45.910140+0000","last_fullsized":"2023-11-06T13:27:45.910140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914672+0000","last_change":"2023-11-06T13:27:41.520647+0000","last_active":"2023-11-06T13:27:45.914672+0000","last_peered":"2023-11-06T13:27:45.914672+0000","last_clean":"2023-11-06T13:27:45.914672+0000","last_became_active":"2023-11-06T13:27:41.520390+0000","last_became_peered":"2023-11-06T13:27:41.520390+0000","last_unstale":"2023-11-06T13:27:45.914672+0000","last_undegraded":"2023-11-06T13:27:45.914672+0000","last_fullsized":"2023-11-06T13:27:45.914672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911839+0000","last_change":"2023-11-06T13:27:41.911208+0000","last_active":"2023-11-06T13:27:45.911839+0000","last_peered":"2023-11-06T13:27:45.911839+0000","last_clean":"2023-11-06T13:27:45.911839+0000","last_became_active":"2023-11-06T13:27:41.910916+0000","last_became_peered":"2023-11-06T13:27:41.910916+0000","last_unstale":"2023-11-06T13:27:45.911839+0000","last_undegraded":"2023-11-06T13:27:45.911839+0000","last_fullsized":"2023-11-06T13:27:45.911839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"31'12","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.248919+0000","last_change":"2023-11-06T13:27:41.505249+0000","last_active":"2023-11-06T13:27:57.248919+0000","last_peered":"2023-11-06T13:27:57.248919+0000","last_clean":"2023-11-06T13:27:57.248919+0000","last_became_active":"2023-11-06T13:27:41.504582+0000","last_became_peered":"2023-11-06T13:27:41.504582+0000","last_unstale":"2023-11-06T13:27:57.248919+0000","last_undegraded":"2023-11-06T13:27:57.248919+0000","last_fullsized":"2023-11-06T13:27:57.248919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911339+0000","last_change":"2023-11-06T13:27:41.917482+0000","last_active":"2023-11-06T13:27:45.911339+0000","last_peered":"2023-11-06T13:27:45.911339+0000","last_clean":"2023-11-06T13:27:45.911339+0000","last_became_active":"2023-11-06T13:27:41.917224+0000","last_became_peered":"2023-11-06T13:27:41.917224+0000","last_unstale":"2023-11-06T13:27:45.911339+0000","last_undegraded":"2023-11-06T13:27:45.911339+0000","last_fullsized":"2023-11-06T13:27:45.911339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303875+0000","last_change":"2023-11-06T13:27:41.521859+0000","last_active":"2023-11-06T13:27:46.303875+0000","last_peered":"2023-11-06T13:27:46.303875+0000","last_clean":"2023-11-06T13:27:46.303875+0000","last_became_active":"2023-11-06T13:27:41.521564+0000","last_became_peered":"2023-11-06T13:27:41.521564+0000","last_unstale":"2023-11-06T13:27:46.303875+0000","last_undegraded":"2023-11-06T13:27:46.303875+0000","last_fullsized":"2023-11-06T13:27:46.303875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911587+0000","last_change":"2023-11-06T13:27:41.916184+0000","last_active":"2023-11-06T13:27:45.911587+0000","last_peered":"2023-11-06T13:27:45.911587+0000","last_clean":"2023-11-06T13:27:45.911587+0000","last_became_active":"2023-11-06T13:27:41.915834+0000","last_became_peered":"2023-11-06T13:27:41.915834+0000","last_unstale":"2023-11-06T13:27:45.911587+0000","last_undegraded":"2023-11-06T13:27:45.911587+0000","last_fullsized":"2023-11-06T13:27:45.911587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261535+0000","last_change":"2023-11-06T13:27:41.513818+0000","last_active":"2023-11-06T13:27:57.261535+0000","last_peered":"2023-11-06T13:27:57.261535+0000","last_clean":"2023-11-06T13:27:57.261535+0000","last_became_active":"2023-11-06T13:27:41.513524+0000","last_became_peered":"2023-11-06T13:27:41.513524+0000","last_unstale":"2023-11-06T13:27:57.261535+0000","last_undegraded":"2023-11-06T13:27:57.261535+0000","last_fullsized":"2023-11-06T13:27:57.261535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911491+0000","last_change":"2023-11-06T13:27:41.903000+0000","last_active":"2023-11-06T13:27:45.911491+0000","last_peered":"2023-11-06T13:27:45.911491+0000","last_clean":"2023-11-06T13:27:45.911491+0000","last_became_active":"2023-11-06T13:27:41.902717+0000","last_became_peered":"2023-11-06T13:27:41.902717+0000","last_unstale":"2023-11-06T13:27:45.911491+0000","last_undegraded":"2023-11-06T13:27:45.911491+0000","last_fullsized":"2023-11-06T13:27:45.911491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"31'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361775+0000","last_change":"2023-11-06T13:27:41.512585+0000","last_active":"2023-11-06T13:27:56.361775+0000","last_peered":"2023-11-06T13:27:56.361775+0000","last_clean":"2023-11-06T13:27:56.361775+0000","last_became_active":"2023-11-06T13:27:41.512252+0000","last_became_peered":"2023-11-06T13:27:41.512252+0000","last_unstale":"2023-11-06T13:27:56.361775+0000","last_undegraded":"2023-11-06T13:27:56.361775+0000","last_fullsized":"2023-11-06T13:27:56.361775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912600+0000","last_change":"2023-11-06T13:27:41.915024+0000","last_active":"2023-11-06T13:27:45.912600+0000","last_peered":"2023-11-06T13:27:45.912600+0000","last_clean":"2023-11-06T13:27:45.912600+0000","last_became_active":"2023-11-06T13:27:41.914304+0000","last_became_peered":"2023-11-06T13:27:41.914304+0000","last_unstale":"2023-11-06T13:27:45.912600+0000","last_undegraded":"2023-11-06T13:27:45.912600+0000","last_fullsized":"2023-11-06T13:27:45.912600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2c","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.282339+0000","last_change":"2023-11-06T13:27:41.521418+0000","last_active":"2023-11-06T13:28:17.282339+0000","last_peered":"2023-11-06T13:28:17.282339+0000","last_clean":"2023-11-06T13:28:17.282339+0000","last_became_active":"2023-11-06T13:27:41.521062+0000","last_became_peered":"2023-11-06T13:27:41.521062+0000","last_unstale":"2023-11-06T13:28:17.282339+0000","last_undegraded":"2023-11-06T13:28:17.282339+0000","last_fullsized":"2023-11-06T13:28:17.282339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1754,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911400+0000","last_change":"2023-11-06T13:27:41.916690+0000","last_active":"2023-11-06T13:27:45.911400+0000","last_peered":"2023-11-06T13:27:45.911400+0000","last_clean":"2023-11-06T13:27:45.911400+0000","last_became_active":"2023-11-06T13:27:41.916376+0000","last_became_peered":"2023-11-06T13:27:41.916376+0000","last_unstale":"2023-11-06T13:27:45.911400+0000","last_undegraded":"2023-11-06T13:27:45.911400+0000","last_fullsized":"2023-11-06T13:27:45.911400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.2b","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345347+0000","last_change":"2023-11-06T13:27:41.516950+0000","last_active":"2023-11-06T13:27:54.345347+0000","last_peered":"2023-11-06T13:27:54.345347+0000","last_clean":"2023-11-06T13:27:54.345347+0000","last_became_active":"2023-11-06T13:27:41.516673+0000","last_became_peered":"2023-11-06T13:27:41.516673+0000","last_unstale":"2023-11-06T13:27:54.345347+0000","last_undegraded":"2023-11-06T13:27:54.345347+0000","last_fullsized":"2023-11-06T13:27:54.345347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920962+0000","last_change":"2023-11-06T13:27:41.921129+0000","last_active":"2023-11-06T13:27:45.920962+0000","last_peered":"2023-11-06T13:27:45.920962+0000","last_clean":"2023-11-06T13:27:45.920962+0000","last_became_active":"2023-11-06T13:27:41.920886+0000","last_became_peered":"2023-11-06T13:27:41.920886+0000","last_unstale":"2023-11-06T13:27:45.920962+0000","last_undegraded":"2023-11-06T13:27:45.920962+0000","last_fullsized":"2023-11-06T13:27:45.920962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.484484+0000","last_change":"2023-11-06T13:27:41.502728+0000","last_active":"2023-11-06T13:27:57.484484+0000","last_peered":"2023-11-06T13:27:57.484484+0000","last_clean":"2023-11-06T13:27:57.484484+0000","last_became_active":"2023-11-06T13:27:41.501859+0000","last_became_peered":"2023-11-06T13:27:41.501859+0000","last_unstale":"2023-11-06T13:27:57.484484+0000","last_undegraded":"2023-11-06T13:27:57.484484+0000","last_fullsized":"2023-11-06T13:27:57.484484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163471+0000","last_change":"2023-11-06T13:27:41.907714+0000","last_active":"2023-11-06T13:27:46.163471+0000","last_peered":"2023-11-06T13:27:46.163471+0000","last_clean":"2023-11-06T13:27:46.163471+0000","last_became_active":"2023-11-06T13:27:41.907437+0000","last_became_peered":"2023-11-06T13:27:41.907437+0000","last_unstale":"2023-11-06T13:27:46.163471+0000","last_undegraded":"2023-11-06T13:27:46.163471+0000","last_fullsized":"2023-11-06T13:27:46.163471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.29","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260326+0000","last_change":"2023-11-06T13:27:41.512170+0000","last_active":"2023-11-06T13:27:57.260326+0000","last_peered":"2023-11-06T13:27:57.260326+0000","last_clean":"2023-11-06T13:27:57.260326+0000","last_became_active":"2023-11-06T13:27:41.511858+0000","last_became_peered":"2023-11-06T13:27:41.511858+0000","last_unstale":"2023-11-06T13:27:57.260326+0000","last_undegraded":"2023-11-06T13:27:57.260326+0000","last_fullsized":"2023-11-06T13:27:57.260326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917871+0000","last_change":"2023-11-06T13:27:41.912649+0000","last_active":"2023-11-06T13:27:45.917871+0000","last_peered":"2023-11-06T13:27:45.917871+0000","last_clean":"2023-11-06T13:27:45.917871+0000","last_became_active":"2023-11-06T13:27:41.912388+0000","last_became_peered":"2023-11-06T13:27:41.912388+0000","last_unstale":"2023-11-06T13:27:45.917871+0000","last_undegraded":"2023-11-06T13:27:45.917871+0000","last_fullsized":"2023-11-06T13:27:45.917871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.342287+0000","last_change":"2023-11-06T13:27:41.513882+0000","last_active":"2023-11-06T13:27:54.342287+0000","last_peered":"2023-11-06T13:27:54.342287+0000","last_clean":"2023-11-06T13:27:54.342287+0000","last_became_active":"2023-11-06T13:27:41.513398+0000","last_became_peered":"2023-11-06T13:27:41.513398+0000","last_unstale":"2023-11-06T13:27:54.342287+0000","last_undegraded":"2023-11-06T13:27:54.342287+0000","last_fullsized":"2023-11-06T13:27:54.342287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916216+0000","last_change":"2023-11-06T13:27:41.916812+0000","last_active":"2023-11-06T13:27:45.916216+0000","last_peered":"2023-11-06T13:27:45.916216+0000","last_clean":"2023-11-06T13:27:45.916216+0000","last_became_active":"2023-11-06T13:27:41.916583+0000","last_became_peered":"2023-11-06T13:27:41.916583+0000","last_unstale":"2023-11-06T13:27:45.916216+0000","last_undegraded":"2023-11-06T13:27:45.916216+0000","last_fullsized":"2023-11-06T13:27:45.916216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.361422+0000","last_change":"2023-11-06T13:27:41.517558+0000","last_active":"2023-11-06T13:27:56.361422+0000","last_peered":"2023-11-06T13:27:56.361422+0000","last_clean":"2023-11-06T13:27:56.361422+0000","last_became_active":"2023-11-06T13:27:41.517318+0000","last_became_peered":"2023-11-06T13:27:41.517318+0000","last_unstale":"2023-11-06T13:27:56.361422+0000","last_undegraded":"2023-11-06T13:27:56.361422+0000","last_fullsized":"2023-11-06T13:27:56.361422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911075+0000","last_change":"2023-11-06T13:27:41.906605+0000","last_active":"2023-11-06T13:27:45.911075+0000","last_peered":"2023-11-06T13:27:45.911075+0000","last_clean":"2023-11-06T13:27:45.911075+0000","last_became_active":"2023-11-06T13:27:41.906319+0000","last_became_peered":"2023-11-06T13:27:41.906319+0000","last_unstale":"2023-11-06T13:27:45.911075+0000","last_undegraded":"2023-11-06T13:27:45.911075+0000","last_fullsized":"2023-11-06T13:27:45.911075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.26","version":"31'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:02.491266+0000","last_change":"2023-11-06T13:27:41.511048+0000","last_active":"2023-11-06T13:28:02.491266+0000","last_peered":"2023-11-06T13:28:02.491266+0000","last_clean":"2023-11-06T13:28:02.491266+0000","last_became_active":"2023-11-06T13:27:41.510755+0000","last_became_peered":"2023-11-06T13:27:41.510755+0000","last_unstale":"2023-11-06T13:28:02.491266+0000","last_undegraded":"2023-11-06T13:28:02.491266+0000","last_fullsized":"2023-11-06T13:28:02.491266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.162876+0000","last_change":"2023-11-06T13:27:41.916789+0000","last_active":"2023-11-06T13:27:46.162876+0000","last_peered":"2023-11-06T13:27:46.162876+0000","last_clean":"2023-11-06T13:27:46.162876+0000","last_became_active":"2023-11-06T13:27:41.916468+0000","last_became_peered":"2023-11-06T13:27:41.916468+0000","last_unstale":"2023-11-06T13:27:46.162876+0000","last_undegraded":"2023-11-06T13:27:46.162876+0000","last_fullsized":"2023-11-06T13:27:46.162876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246912+0000","last_change":"2023-11-06T13:27:41.521351+0000","last_active":"2023-11-06T13:27:57.246912+0000","last_peered":"2023-11-06T13:27:57.246912+0000","last_clean":"2023-11-06T13:27:57.246912+0000","last_became_active":"2023-11-06T13:27:41.521070+0000","last_became_peered":"2023-11-06T13:27:41.521070+0000","last_unstale":"2023-11-06T13:27:57.246912+0000","last_undegraded":"2023-11-06T13:27:57.246912+0000","last_fullsized":"2023-11-06T13:27:57.246912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912508+0000","last_change":"2023-11-06T13:27:41.915196+0000","last_active":"2023-11-06T13:27:45.912508+0000","last_peered":"2023-11-06T13:27:45.912508+0000","last_clean":"2023-11-06T13:27:45.912508+0000","last_became_active":"2023-11-06T13:27:41.914754+0000","last_became_peered":"2023-11-06T13:27:41.914754+0000","last_unstale":"2023-11-06T13:27:45.912508+0000","last_undegraded":"2023-11-06T13:27:45.912508+0000","last_fullsized":"2023-11-06T13:27:45.912508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163356+0000","last_change":"2023-11-06T13:27:41.521449+0000","last_active":"2023-11-06T13:27:46.163356+0000","last_peered":"2023-11-06T13:27:46.163356+0000","last_clean":"2023-11-06T13:27:46.163356+0000","last_became_active":"2023-11-06T13:27:41.521174+0000","last_became_peered":"2023-11-06T13:27:41.521174+0000","last_unstale":"2023-11-06T13:27:46.163356+0000","last_undegraded":"2023-11-06T13:27:46.163356+0000","last_fullsized":"2023-11-06T13:27:46.163356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913163+0000","last_change":"2023-11-06T13:27:41.916127+0000","last_active":"2023-11-06T13:27:45.913163+0000","last_peered":"2023-11-06T13:27:45.913163+0000","last_clean":"2023-11-06T13:27:45.913163+0000","last_became_active":"2023-11-06T13:27:41.915746+0000","last_became_peered":"2023-11-06T13:27:41.915746+0000","last_unstale":"2023-11-06T13:27:45.913163+0000","last_undegraded":"2023-11-06T13:27:45.913163+0000","last_fullsized":"2023-11-06T13:27:45.913163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259454+0000","last_change":"2023-11-06T13:27:41.514285+0000","last_active":"2023-11-06T13:27:57.259454+0000","last_peered":"2023-11-06T13:27:57.259454+0000","last_clean":"2023-11-06T13:27:57.259454+0000","last_became_active":"2023-11-06T13:27:41.514004+0000","last_became_peered":"2023-11-06T13:27:41.514004+0000","last_unstale":"2023-11-06T13:27:57.259454+0000","last_undegraded":"2023-11-06T13:27:57.259454+0000","last_fullsized":"2023-11-06T13:27:57.259454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919125+0000","last_change":"2023-11-06T13:27:41.914450+0000","last_active":"2023-11-06T13:27:45.919125+0000","last_peered":"2023-11-06T13:27:45.919125+0000","last_clean":"2023-11-06T13:27:45.919125+0000","last_became_active":"2023-11-06T13:27:41.914170+0000","last_became_peered":"2023-11-06T13:27:41.914170+0000","last_unstale":"2023-11-06T13:27:45.919125+0000","last_undegraded":"2023-11-06T13:27:45.919125+0000","last_fullsized":"2023-11-06T13:27:45.919125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260037+0000","last_change":"2023-11-06T13:27:41.512448+0000","last_active":"2023-11-06T13:27:57.260037+0000","last_peered":"2023-11-06T13:27:57.260037+0000","last_clean":"2023-11-06T13:27:57.260037+0000","last_became_active":"2023-11-06T13:27:41.512166+0000","last_became_peered":"2023-11-06T13:27:41.512166+0000","last_unstale":"2023-11-06T13:27:57.260037+0000","last_undegraded":"2023-11-06T13:27:57.260037+0000","last_fullsized":"2023-11-06T13:27:57.260037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911508+0000","last_change":"2023-11-06T13:27:41.908609+0000","last_active":"2023-11-06T13:27:45.911508+0000","last_peered":"2023-11-06T13:27:45.911508+0000","last_clean":"2023-11-06T13:27:45.911508+0000","last_became_active":"2023-11-06T13:27:41.908310+0000","last_became_peered":"2023-11-06T13:27:41.908310+0000","last_unstale":"2023-11-06T13:27:45.911508+0000","last_undegraded":"2023-11-06T13:27:45.911508+0000","last_fullsized":"2023-11-06T13:27:45.911508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.21","version":"31'1","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.281048+0000","last_change":"2023-11-06T13:27:41.514423+0000","last_active":"2023-11-06T13:28:16.281048+0000","last_peered":"2023-11-06T13:28:16.281048+0000","last_clean":"2023-11-06T13:28:16.281048+0000","last_became_active":"2023-11-06T13:27:41.513955+0000","last_became_peered":"2023-11-06T13:27:41.513955+0000","last_unstale":"2023-11-06T13:28:16.281048+0000","last_undegraded":"2023-11-06T13:28:16.281048+0000","last_fullsized":"2023-11-06T13:28:16.281048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163615+0000","last_change":"2023-11-06T13:27:41.906647+0000","last_active":"2023-11-06T13:27:46.163615+0000","last_peered":"2023-11-06T13:27:46.163615+0000","last_clean":"2023-11-06T13:27:46.163615+0000","last_became_active":"2023-11-06T13:27:41.906364+0000","last_became_peered":"2023-11-06T13:27:41.906364+0000","last_unstale":"2023-11-06T13:27:46.163615+0000","last_undegraded":"2023-11-06T13:27:46.163615+0000","last_fullsized":"2023-11-06T13:27:46.163615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911720+0000","last_change":"2023-11-06T13:27:41.521774+0000","last_active":"2023-11-06T13:27:45.911720+0000","last_peered":"2023-11-06T13:27:45.911720+0000","last_clean":"2023-11-06T13:27:45.911720+0000","last_became_active":"2023-11-06T13:27:41.521498+0000","last_became_peered":"2023-11-06T13:27:41.521498+0000","last_unstale":"2023-11-06T13:27:45.911720+0000","last_undegraded":"2023-11-06T13:27:45.911720+0000","last_fullsized":"2023-11-06T13:27:45.911720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917693+0000","last_change":"2023-11-06T13:27:41.908607+0000","last_active":"2023-11-06T13:27:45.917693+0000","last_peered":"2023-11-06T13:27:45.917693+0000","last_clean":"2023-11-06T13:27:45.917693+0000","last_became_active":"2023-11-06T13:27:41.906458+0000","last_became_peered":"2023-11-06T13:27:41.906458+0000","last_unstale":"2023-11-06T13:27:45.917693+0000","last_undegraded":"2023-11-06T13:27:45.917693+0000","last_fullsized":"2023-11-06T13:27:45.917693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.277365+0000","last_change":"2023-11-06T13:27:41.513775+0000","last_active":"2023-11-06T13:28:17.277365+0000","last_peered":"2023-11-06T13:28:17.277365+0000","last_clean":"2023-11-06T13:28:17.277365+0000","last_became_active":"2023-11-06T13:27:41.513484+0000","last_became_peered":"2023-11-06T13:27:41.513484+0000","last_unstale":"2023-11-06T13:28:17.277365+0000","last_undegraded":"2023-11-06T13:28:17.277365+0000","last_fullsized":"2023-11-06T13:28:17.277365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909539+0000","last_change":"2023-11-06T13:27:41.912007+0000","last_active":"2023-11-06T13:27:45.909539+0000","last_peered":"2023-11-06T13:27:45.909539+0000","last_clean":"2023-11-06T13:27:45.909539+0000","last_became_active":"2023-11-06T13:27:41.911486+0000","last_became_peered":"2023-11-06T13:27:41.911486+0000","last_unstale":"2023-11-06T13:27:45.909539+0000","last_undegraded":"2023-11-06T13:27:45.909539+0000","last_fullsized":"2023-11-06T13:27:45.909539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173947+0000","last_change":"2023-11-06T13:27:46.169014+0000","last_active":"2023-11-06T13:27:46.173947+0000","last_peered":"2023-11-06T13:27:46.173947+0000","last_clean":"2023-11-06T13:27:46.173947+0000","last_became_active":"2023-11-06T13:27:46.168560+0000","last_became_peered":"2023-11-06T13:27:46.168560+0000","last_unstale":"2023-11-06T13:27:46.173947+0000","last_undegraded":"2023-11-06T13:27:46.173947+0000","last_fullsized":"2023-11-06T13:27:46.173947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,6,8],"acting":[9,7,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"26'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913232+0000","last_change":"2023-11-06T13:27:41.513843+0000","last_active":"2023-11-06T13:27:45.913232+0000","last_peered":"2023-11-06T13:27:45.913232+0000","last_clean":"2023-11-06T13:27:45.913232+0000","last_became_active":"2023-11-06T13:27:41.513491+0000","last_became_peered":"2023-11-06T13:27:41.513491+0000","last_unstale":"2023-11-06T13:27:45.913232+0000","last_undegraded":"2023-11-06T13:27:45.913232+0000","last_fullsized":"2023-11-06T13:27:45.913232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916153+0000","last_change":"2023-11-06T13:27:41.917535+0000","last_active":"2023-11-06T13:27:45.916153+0000","last_peered":"2023-11-06T13:27:45.916153+0000","last_clean":"2023-11-06T13:27:45.916153+0000","last_became_active":"2023-11-06T13:27:41.916611+0000","last_became_peered":"2023-11-06T13:27:41.916611+0000","last_unstale":"2023-11-06T13:27:45.916153+0000","last_undegraded":"2023-11-06T13:27:45.916153+0000","last_fullsized":"2023-11-06T13:27:45.916153+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927208+0000","last_change":"2023-11-06T13:27:45.922469+0000","last_active":"2023-11-06T13:27:45.927208+0000","last_peered":"2023-11-06T13:27:45.927208+0000","last_clean":"2023-11-06T13:27:45.927208+0000","last_became_active":"2023-11-06T13:27:45.922030+0000","last_became_peered":"2023-11-06T13:27:45.922030+0000","last_unstale":"2023-11-06T13:27:45.927208+0000","last_undegraded":"2023-11-06T13:27:45.927208+0000","last_fullsized":"2023-11-06T13:27:45.927208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,9,8],"acting":[4,11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"31'8","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261513+0000","last_change":"2023-11-06T13:27:41.517069+0000","last_active":"2023-11-06T13:27:57.261513+0000","last_peered":"2023-11-06T13:27:57.261513+0000","last_clean":"2023-11-06T13:27:57.261513+0000","last_became_active":"2023-11-06T13:27:41.516771+0000","last_became_peered":"2023-11-06T13:27:41.516771+0000","last_unstale":"2023-11-06T13:27:57.261513+0000","last_undegraded":"2023-11-06T13:27:57.261513+0000","last_fullsized":"2023-11-06T13:27:57.261513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909005+0000","last_change":"2023-11-06T13:27:41.904714+0000","last_active":"2023-11-06T13:27:45.909005+0000","last_peered":"2023-11-06T13:27:45.909005+0000","last_clean":"2023-11-06T13:27:45.909005+0000","last_became_active":"2023-11-06T13:27:41.904312+0000","last_became_peered":"2023-11-06T13:27:41.904312+0000","last_unstale":"2023-11-06T13:27:45.909005+0000","last_undegraded":"2023-11-06T13:27:45.909005+0000","last_fullsized":"2023-11-06T13:27:45.909005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926973+0000","last_change":"2023-11-06T13:27:45.926312+0000","last_active":"2023-11-06T13:27:45.926973+0000","last_peered":"2023-11-06T13:27:45.926973+0000","last_clean":"2023-11-06T13:27:45.926973+0000","last_became_active":"2023-11-06T13:27:45.925968+0000","last_became_peered":"2023-11-06T13:27:45.925968+0000","last_unstale":"2023-11-06T13:27:45.926973+0000","last_undegraded":"2023-11-06T13:27:45.926973+0000","last_fullsized":"2023-11-06T13:27:45.926973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,10,4],"acting":[1,0,10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"31'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261499+0000","last_change":"2023-11-06T13:27:41.514714+0000","last_active":"2023-11-06T13:27:57.261499+0000","last_peered":"2023-11-06T13:27:57.261499+0000","last_clean":"2023-11-06T13:27:57.261499+0000","last_became_active":"2023-11-06T13:27:41.514394+0000","last_became_peered":"2023-11-06T13:27:41.514394+0000","last_unstale":"2023-11-06T13:27:57.261499+0000","last_undegraded":"2023-11-06T13:27:57.261499+0000","last_fullsized":"2023-11-06T13:27:57.261499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.908874+0000","last_change":"2023-11-06T13:27:41.916422+0000","last_active":"2023-11-06T13:27:45.908874+0000","last_peered":"2023-11-06T13:27:45.908874+0000","last_clean":"2023-11-06T13:27:45.908874+0000","last_became_active":"2023-11-06T13:27:41.916130+0000","last_became_peered":"2023-11-06T13:27:41.916130+0000","last_unstale":"2023-11-06T13:27:45.908874+0000","last_undegraded":"2023-11-06T13:27:45.908874+0000","last_fullsized":"2023-11-06T13:27:45.908874+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170861+0000","last_change":"2023-11-06T13:27:46.169218+0000","last_active":"2023-11-06T13:27:46.170861+0000","last_peered":"2023-11-06T13:27:46.170861+0000","last_clean":"2023-11-06T13:27:46.170861+0000","last_became_active":"2023-11-06T13:27:46.168783+0000","last_became_peered":"2023-11-06T13:27:46.168783+0000","last_unstale":"2023-11-06T13:27:46.170861+0000","last_undegraded":"2023-11-06T13:27:46.170861+0000","last_fullsized":"2023-11-06T13:27:46.170861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,6,7],"acting":[8,10,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173528+0000","last_change":"2023-11-06T13:27:46.170499+0000","last_active":"2023-11-06T13:27:46.173528+0000","last_peered":"2023-11-06T13:27:46.173528+0000","last_clean":"2023-11-06T13:27:46.173528+0000","last_became_active":"2023-11-06T13:27:46.170081+0000","last_became_peered":"2023-11-06T13:27:46.170081+0000","last_unstale":"2023-11-06T13:27:46.173528+0000","last_undegraded":"2023-11-06T13:27:46.173528+0000","last_fullsized":"2023-11-06T13:27:46.173528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,11],"acting":[3,6,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.275549+0000","last_change":"2023-11-06T13:27:41.518231+0000","last_active":"2023-11-06T13:28:17.275549+0000","last_peered":"2023-11-06T13:28:17.275549+0000","last_clean":"2023-11-06T13:28:17.275549+0000","last_became_active":"2023-11-06T13:27:41.517933+0000","last_became_peered":"2023-11-06T13:27:41.517933+0000","last_unstale":"2023-11-06T13:28:17.275549+0000","last_undegraded":"2023-11-06T13:28:17.275549+0000","last_fullsized":"2023-11-06T13:28:17.275549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":974,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916799+0000","last_change":"2023-11-06T13:27:41.912784+0000","last_active":"2023-11-06T13:27:45.916799+0000","last_peered":"2023-11-06T13:27:45.916799+0000","last_clean":"2023-11-06T13:27:45.916799+0000","last_became_active":"2023-11-06T13:27:41.912537+0000","last_became_peered":"2023-11-06T13:27:41.912537+0000","last_unstale":"2023-11-06T13:27:45.916799+0000","last_undegraded":"2023-11-06T13:27:45.916799+0000","last_fullsized":"2023-11-06T13:27:45.916799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.916270+0000","last_change":"2023-11-06T13:27:41.912408+0000","last_active":"2023-11-06T13:27:45.916270+0000","last_peered":"2023-11-06T13:27:45.916270+0000","last_clean":"2023-11-06T13:27:45.916270+0000","last_became_active":"2023-11-06T13:27:41.912154+0000","last_became_peered":"2023-11-06T13:27:41.912154+0000","last_unstale":"2023-11-06T13:27:45.916270+0000","last_undegraded":"2023-11-06T13:27:45.916270+0000","last_fullsized":"2023-11-06T13:27:45.916270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360855+0000","last_change":"2023-11-06T13:27:41.518968+0000","last_active":"2023-11-06T13:27:56.360855+0000","last_peered":"2023-11-06T13:27:56.360855+0000","last_clean":"2023-11-06T13:27:56.360855+0000","last_became_active":"2023-11-06T13:27:41.518692+0000","last_became_peered":"2023-11-06T13:27:41.518692+0000","last_unstale":"2023-11-06T13:27:56.360855+0000","last_undegraded":"2023-11-06T13:27:56.360855+0000","last_fullsized":"2023-11-06T13:27:56.360855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909955+0000","last_change":"2023-11-06T13:27:37.346695+0000","last_active":"2023-11-06T13:27:45.909955+0000","last_peered":"2023-11-06T13:27:45.909955+0000","last_clean":"2023-11-06T13:27:45.909955+0000","last_became_active":"2023-11-06T13:27:37.346390+0000","last_became_peered":"2023-11-06T13:27:37.346390+0000","last_unstale":"2023-11-06T13:27:45.909955+0000","last_undegraded":"2023-11-06T13:27:45.909955+0000","last_fullsized":"2023-11-06T13:27:45.909955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.925401+0000","last_change":"2023-11-06T13:27:45.923649+0000","last_active":"2023-11-06T13:27:45.925401+0000","last_peered":"2023-11-06T13:27:45.925401+0000","last_clean":"2023-11-06T13:27:45.925401+0000","last_became_active":"2023-11-06T13:27:45.923211+0000","last_became_peered":"2023-11-06T13:27:45.923211+0000","last_unstale":"2023-11-06T13:27:45.925401+0000","last_undegraded":"2023-11-06T13:27:45.925401+0000","last_fullsized":"2023-11-06T13:27:45.925401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,9],"acting":[2,3,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912719+0000","last_change":"2023-11-06T13:27:41.913817+0000","last_active":"2023-11-06T13:27:45.912719+0000","last_peered":"2023-11-06T13:27:45.912719+0000","last_clean":"2023-11-06T13:27:45.912719+0000","last_became_active":"2023-11-06T13:27:41.913596+0000","last_became_peered":"2023-11-06T13:27:41.913596+0000","last_unstale":"2023-11-06T13:27:45.912719+0000","last_undegraded":"2023-11-06T13:27:45.912719+0000","last_fullsized":"2023-11-06T13:27:45.912719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10],"acting":[3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911215+0000","last_change":"2023-11-06T13:27:37.352014+0000","last_active":"2023-11-06T13:27:45.911215+0000","last_peered":"2023-11-06T13:27:45.911215+0000","last_clean":"2023-11-06T13:27:45.911215+0000","last_became_active":"2023-11-06T13:27:37.351648+0000","last_became_peered":"2023-11-06T13:27:37.351648+0000","last_unstale":"2023-11-06T13:27:45.911215+0000","last_undegraded":"2023-11-06T13:27:45.911215+0000","last_fullsized":"2023-11-06T13:27:45.911215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260278+0000","last_change":"2023-11-06T13:27:41.512578+0000","last_active":"2023-11-06T13:27:57.260278+0000","last_peered":"2023-11-06T13:27:57.260278+0000","last_clean":"2023-11-06T13:27:57.260278+0000","last_became_active":"2023-11-06T13:27:41.512223+0000","last_became_peered":"2023-11-06T13:27:41.512223+0000","last_unstale":"2023-11-06T13:27:57.260278+0000","last_undegraded":"2023-11-06T13:27:57.260278+0000","last_fullsized":"2023-11-06T13:27:57.260278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.926200+0000","last_change":"2023-11-06T13:27:45.923587+0000","last_active":"2023-11-06T13:27:45.926200+0000","last_peered":"2023-11-06T13:27:45.926200+0000","last_clean":"2023-11-06T13:27:45.926200+0000","last_became_active":"2023-11-06T13:27:45.923253+0000","last_became_peered":"2023-11-06T13:27:45.923253+0000","last_unstale":"2023-11-06T13:27:45.926200+0000","last_undegraded":"2023-11-06T13:27:45.926200+0000","last_fullsized":"2023-11-06T13:27:45.926200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,8],"acting":[4,3,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911875+0000","last_change":"2023-11-06T13:27:41.917127+0000","last_active":"2023-11-06T13:27:45.911875+0000","last_peered":"2023-11-06T13:27:45.911875+0000","last_clean":"2023-11-06T13:27:45.911875+0000","last_became_active":"2023-11-06T13:27:41.916247+0000","last_became_peered":"2023-11-06T13:27:41.916247+0000","last_unstale":"2023-11-06T13:27:45.911875+0000","last_undegraded":"2023-11-06T13:27:45.911875+0000","last_fullsized":"2023-11-06T13:27:45.911875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.306958+0000","last_change":"2023-11-06T13:27:41.515684+0000","last_active":"2023-11-06T13:27:46.306958+0000","last_peered":"2023-11-06T13:27:46.306958+0000","last_clean":"2023-11-06T13:27:46.306958+0000","last_became_active":"2023-11-06T13:27:41.515276+0000","last_became_peered":"2023-11-06T13:27:41.515276+0000","last_unstale":"2023-11-06T13:27:46.306958+0000","last_undegraded":"2023-11-06T13:27:46.306958+0000","last_fullsized":"2023-11-06T13:27:46.306958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917564+0000","last_change":"2023-11-06T13:27:37.352326+0000","last_active":"2023-11-06T13:27:45.917564+0000","last_peered":"2023-11-06T13:27:45.917564+0000","last_clean":"2023-11-06T13:27:45.917564+0000","last_became_active":"2023-11-06T13:27:37.352014+0000","last_became_peered":"2023-11-06T13:27:37.352014+0000","last_unstale":"2023-11-06T13:27:45.917564+0000","last_undegraded":"2023-11-06T13:27:45.917564+0000","last_fullsized":"2023-11-06T13:27:45.917564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928135+0000","last_change":"2023-11-06T13:27:45.922218+0000","last_active":"2023-11-06T13:27:45.928135+0000","last_peered":"2023-11-06T13:27:45.928135+0000","last_clean":"2023-11-06T13:27:45.928135+0000","last_became_active":"2023-11-06T13:27:45.921722+0000","last_became_peered":"2023-11-06T13:27:45.921722+0000","last_unstale":"2023-11-06T13:27:45.928135+0000","last_undegraded":"2023-11-06T13:27:45.928135+0000","last_fullsized":"2023-11-06T13:27:45.928135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,11,9],"acting":[10,0,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.260681+0000","last_change":"2023-11-06T13:27:41.521841+0000","last_active":"2023-11-06T13:27:57.260681+0000","last_peered":"2023-11-06T13:27:57.260681+0000","last_clean":"2023-11-06T13:27:57.260681+0000","last_became_active":"2023-11-06T13:27:41.521489+0000","last_became_peered":"2023-11-06T13:27:41.521489+0000","last_unstale":"2023-11-06T13:27:57.260681+0000","last_undegraded":"2023-11-06T13:27:57.260681+0000","last_fullsized":"2023-11-06T13:27:57.260681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914409+0000","last_change":"2023-11-06T13:27:38.124542+0000","last_active":"2023-11-06T13:27:45.914409+0000","last_peered":"2023-11-06T13:27:45.914409+0000","last_clean":"2023-11-06T13:27:45.914409+0000","last_became_active":"2023-11-06T13:27:38.124213+0000","last_became_peered":"2023-11-06T13:27:38.124213+0000","last_unstale":"2023-11-06T13:27:45.914409+0000","last_undegraded":"2023-11-06T13:27:45.914409+0000","last_fullsized":"2023-11-06T13:27:45.914409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919865+0000","last_change":"2023-11-06T13:27:41.915821+0000","last_active":"2023-11-06T13:27:45.919865+0000","last_peered":"2023-11-06T13:27:45.919865+0000","last_clean":"2023-11-06T13:27:45.919865+0000","last_became_active":"2023-11-06T13:27:41.915575+0000","last_became_peered":"2023-11-06T13:27:41.915575+0000","last_unstale":"2023-11-06T13:27:45.919865+0000","last_undegraded":"2023-11-06T13:27:45.919865+0000","last_fullsized":"2023-11-06T13:27:45.919865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930494+0000","last_change":"2023-11-06T13:27:45.928971+0000","last_active":"2023-11-06T13:27:45.930494+0000","last_peered":"2023-11-06T13:27:45.930494+0000","last_clean":"2023-11-06T13:27:45.930494+0000","last_became_active":"2023-11-06T13:27:45.928524+0000","last_became_peered":"2023-11-06T13:27:45.928524+0000","last_unstale":"2023-11-06T13:27:45.930494+0000","last_undegraded":"2023-11-06T13:27:45.930494+0000","last_fullsized":"2023-11-06T13:27:45.930494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5,2],"acting":[7,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'3","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.277676+0000","last_change":"2023-11-06T13:27:41.509397+0000","last_active":"2023-11-06T13:28:17.277676+0000","last_peered":"2023-11-06T13:28:17.277676+0000","last_clean":"2023-11-06T13:28:17.277676+0000","last_became_active":"2023-11-06T13:27:41.508913+0000","last_became_peered":"2023-11-06T13:27:41.508913+0000","last_unstale":"2023-11-06T13:28:17.277676+0000","last_undegraded":"2023-11-06T13:28:17.277676+0000","last_fullsized":"2023-11-06T13:28:17.277676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":540,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914312+0000","last_change":"2023-11-06T13:27:35.163623+0000","last_active":"2023-11-06T13:27:45.914312+0000","last_peered":"2023-11-06T13:27:45.914312+0000","last_clean":"2023-11-06T13:27:45.914312+0000","last_became_active":"2023-11-06T13:27:35.163299+0000","last_became_peered":"2023-11-06T13:27:35.163299+0000","last_unstale":"2023-11-06T13:27:45.914312+0000","last_undegraded":"2023-11-06T13:27:45.914312+0000","last_fullsized":"2023-11-06T13:27:45.914312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:33.286457+0000","last_clean_scrub_stamp":"2023-11-06T13:27:33.286457+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909056+0000","last_change":"2023-11-06T13:27:38.052762+0000","last_active":"2023-11-06T13:27:45.909056+0000","last_peered":"2023-11-06T13:27:45.909056+0000","last_clean":"2023-11-06T13:27:45.909056+0000","last_became_active":"2023-11-06T13:27:38.052396+0000","last_became_peered":"2023-11-06T13:27:38.052396+0000","last_unstale":"2023-11-06T13:27:45.909056+0000","last_undegraded":"2023-11-06T13:27:45.909056+0000","last_fullsized":"2023-11-06T13:27:45.909056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914786+0000","last_change":"2023-11-06T13:27:41.917427+0000","last_active":"2023-11-06T13:27:45.914786+0000","last_peered":"2023-11-06T13:27:45.914786+0000","last_clean":"2023-11-06T13:27:45.914786+0000","last_became_active":"2023-11-06T13:27:41.917130+0000","last_became_peered":"2023-11-06T13:27:41.917130+0000","last_unstale":"2023-11-06T13:27:45.914786+0000","last_undegraded":"2023-11-06T13:27:45.914786+0000","last_fullsized":"2023-11-06T13:27:45.914786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172446+0000","last_change":"2023-11-06T13:27:46.171208+0000","last_active":"2023-11-06T13:27:46.172446+0000","last_peered":"2023-11-06T13:27:46.172446+0000","last_clean":"2023-11-06T13:27:46.172446+0000","last_became_active":"2023-11-06T13:27:46.170743+0000","last_became_peered":"2023-11-06T13:27:46.170743+0000","last_unstale":"2023-11-06T13:27:46.172446+0000","last_undegraded":"2023-11-06T13:27:46.172446+0000","last_fullsized":"2023-11-06T13:27:46.172446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,4,1],"acting":[8,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.0","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:55.354547+0000","last_change":"2023-11-06T13:27:41.507617+0000","last_active":"2023-11-06T13:27:55.354547+0000","last_peered":"2023-11-06T13:27:55.354547+0000","last_clean":"2023-11-06T13:27:55.354547+0000","last_became_active":"2023-11-06T13:27:41.507297+0000","last_became_peered":"2023-11-06T13:27:41.507297+0000","last_unstale":"2023-11-06T13:27:55.354547+0000","last_undegraded":"2023-11-06T13:27:55.354547+0000","last_fullsized":"2023-11-06T13:27:55.354547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.161564+0000","last_change":"2023-11-06T13:27:38.089519+0000","last_active":"2023-11-06T13:27:46.161564+0000","last_peered":"2023-11-06T13:27:46.161564+0000","last_clean":"2023-11-06T13:27:46.161564+0000","last_became_active":"2023-11-06T13:27:38.089237+0000","last_became_peered":"2023-11-06T13:27:38.089237+0000","last_unstale":"2023-11-06T13:27:46.161564+0000","last_undegraded":"2023-11-06T13:27:46.161564+0000","last_fullsized":"2023-11-06T13:27:46.161564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163451+0000","last_change":"2023-11-06T13:27:41.916370+0000","last_active":"2023-11-06T13:27:46.163451+0000","last_peered":"2023-11-06T13:27:46.163451+0000","last_clean":"2023-11-06T13:27:46.163451+0000","last_became_active":"2023-11-06T13:27:41.916089+0000","last_became_peered":"2023-11-06T13:27:41.916089+0000","last_unstale":"2023-11-06T13:27:46.163451+0000","last_undegraded":"2023-11-06T13:27:46.163451+0000","last_fullsized":"2023-11-06T13:27:46.163451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.174029+0000","last_change":"2023-11-06T13:27:46.172056+0000","last_active":"2023-11-06T13:27:46.174029+0000","last_peered":"2023-11-06T13:27:46.174029+0000","last_clean":"2023-11-06T13:27:46.174029+0000","last_became_active":"2023-11-06T13:27:46.171629+0000","last_became_peered":"2023-11-06T13:27:46.171629+0000","last_unstale":"2023-11-06T13:27:46.174029+0000","last_undegraded":"2023-11-06T13:27:46.174029+0000","last_fullsized":"2023-11-06T13:27:46.174029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,6,1],"acting":[9,10,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163264+0000","last_change":"2023-11-06T13:27:41.910506+0000","last_active":"2023-11-06T13:27:46.163264+0000","last_peered":"2023-11-06T13:27:46.163264+0000","last_clean":"2023-11-06T13:27:46.163264+0000","last_became_active":"2023-11-06T13:27:41.910224+0000","last_became_peered":"2023-11-06T13:27:41.910224+0000","last_unstale":"2023-11-06T13:27:46.163264+0000","last_undegraded":"2023-11-06T13:27:46.163264+0000","last_fullsized":"2023-11-06T13:27:46.163264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"31'5","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.246931+0000","last_change":"2023-11-06T13:27:41.520173+0000","last_active":"2023-11-06T13:27:57.246931+0000","last_peered":"2023-11-06T13:27:57.246931+0000","last_clean":"2023-11-06T13:27:57.246931+0000","last_became_active":"2023-11-06T13:27:41.519910+0000","last_became_peered":"2023-11-06T13:27:41.519910+0000","last_unstale":"2023-11-06T13:27:57.246931+0000","last_undegraded":"2023-11-06T13:27:57.246931+0000","last_fullsized":"2023-11-06T13:27:57.246931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914501+0000","last_change":"2023-11-06T13:27:37.351638+0000","last_active":"2023-11-06T13:27:45.914501+0000","last_peered":"2023-11-06T13:27:45.914501+0000","last_clean":"2023-11-06T13:27:45.914501+0000","last_became_active":"2023-11-06T13:27:37.351360+0000","last_became_peered":"2023-11-06T13:27:37.351360+0000","last_unstale":"2023-11-06T13:27:45.914501+0000","last_undegraded":"2023-11-06T13:27:45.914501+0000","last_fullsized":"2023-11-06T13:27:45.914501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545073+0000","last_change":"2023-11-06T13:27:46.169324+0000","last_active":"2023-11-06T13:27:46.545073+0000","last_peered":"2023-11-06T13:27:46.545073+0000","last_clean":"2023-11-06T13:27:46.545073+0000","last_became_active":"2023-11-06T13:27:46.168589+0000","last_became_peered":"2023-11-06T13:27:46.168589+0000","last_unstale":"2023-11-06T13:27:46.545073+0000","last_undegraded":"2023-11-06T13:27:46.545073+0000","last_fullsized":"2023-11-06T13:27:46.545073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,4,2],"acting":[9,6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917692+0000","last_change":"2023-11-06T13:27:41.913788+0000","last_active":"2023-11-06T13:27:45.917692+0000","last_peered":"2023-11-06T13:27:45.917692+0000","last_clean":"2023-11-06T13:27:45.917692+0000","last_became_active":"2023-11-06T13:27:41.913503+0000","last_became_peered":"2023-11-06T13:27:41.913503+0000","last_unstale":"2023-11-06T13:27:45.917692+0000","last_undegraded":"2023-11-06T13:27:45.917692+0000","last_fullsized":"2023-11-06T13:27:45.917692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911568+0000","last_change":"2023-11-06T13:27:41.518564+0000","last_active":"2023-11-06T13:27:45.911568+0000","last_peered":"2023-11-06T13:27:45.911568+0000","last_clean":"2023-11-06T13:27:45.911568+0000","last_became_active":"2023-11-06T13:27:41.518249+0000","last_became_peered":"2023-11-06T13:27:41.518249+0000","last_unstale":"2023-11-06T13:27:45.911568+0000","last_undegraded":"2023-11-06T13:27:45.911568+0000","last_fullsized":"2023-11-06T13:27:45.911568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911485+0000","last_change":"2023-11-06T13:27:38.303677+0000","last_active":"2023-11-06T13:27:45.911485+0000","last_peered":"2023-11-06T13:27:45.911485+0000","last_clean":"2023-11-06T13:27:45.911485+0000","last_became_active":"2023-11-06T13:27:38.303385+0000","last_became_peered":"2023-11-06T13:27:38.303385+0000","last_unstale":"2023-11-06T13:27:45.911485+0000","last_undegraded":"2023-11-06T13:27:45.911485+0000","last_fullsized":"2023-11-06T13:27:45.911485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:36.322782+0000","last_clean_scrub_stamp":"2023-11-06T13:27:36.322782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.173782+0000","last_change":"2023-11-06T13:27:46.169081+0000","last_active":"2023-11-06T13:27:46.173782+0000","last_peered":"2023-11-06T13:27:46.173782+0000","last_clean":"2023-11-06T13:27:46.173782+0000","last_became_active":"2023-11-06T13:27:46.168663+0000","last_became_peered":"2023-11-06T13:27:46.168663+0000","last_unstale":"2023-11-06T13:27:46.173782+0000","last_undegraded":"2023-11-06T13:27:46.173782+0000","last_fullsized":"2023-11-06T13:27:46.173782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,10,1],"acting":[0,6,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911704+0000","last_change":"2023-11-06T13:27:41.518358+0000","last_active":"2023-11-06T13:27:45.911704+0000","last_peered":"2023-11-06T13:27:45.911704+0000","last_clean":"2023-11-06T13:27:45.911704+0000","last_became_active":"2023-11-06T13:27:41.518078+0000","last_became_peered":"2023-11-06T13:27:41.518078+0000","last_unstale":"2023-11-06T13:27:45.911704+0000","last_undegraded":"2023-11-06T13:27:45.911704+0000","last_fullsized":"2023-11-06T13:27:45.911704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911448+0000","last_change":"2023-11-06T13:27:41.917750+0000","last_active":"2023-11-06T13:27:45.911448+0000","last_peered":"2023-11-06T13:27:45.911448+0000","last_clean":"2023-11-06T13:27:45.911448+0000","last_became_active":"2023-11-06T13:27:41.917424+0000","last_became_peered":"2023-11-06T13:27:41.917424+0000","last_unstale":"2023-11-06T13:27:45.911448+0000","last_undegraded":"2023-11-06T13:27:45.911448+0000","last_fullsized":"2023-11-06T13:27:45.911448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.172282+0000","last_change":"2023-11-06T13:27:46.170534+0000","last_active":"2023-11-06T13:27:46.172282+0000","last_peered":"2023-11-06T13:27:46.172282+0000","last_clean":"2023-11-06T13:27:46.172282+0000","last_became_active":"2023-11-06T13:27:46.169964+0000","last_became_peered":"2023-11-06T13:27:46.169964+0000","last_unstale":"2023-11-06T13:27:46.172282+0000","last_undegraded":"2023-11-06T13:27:46.172282+0000","last_fullsized":"2023-11-06T13:27:46.172282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,0,6],"acting":[2,8,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347446+0000","last_change":"2023-11-06T13:27:41.516099+0000","last_active":"2023-11-06T13:27:54.347446+0000","last_peered":"2023-11-06T13:27:54.347446+0000","last_clean":"2023-11-06T13:27:54.347446+0000","last_became_active":"2023-11-06T13:27:41.515787+0000","last_became_peered":"2023-11-06T13:27:41.515787+0000","last_unstale":"2023-11-06T13:27:54.347446+0000","last_undegraded":"2023-11-06T13:27:54.347446+0000","last_fullsized":"2023-11-06T13:27:54.347446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909835+0000","last_change":"2023-11-06T13:27:41.916170+0000","last_active":"2023-11-06T13:27:45.909835+0000","last_peered":"2023-11-06T13:27:45.909835+0000","last_clean":"2023-11-06T13:27:45.909835+0000","last_became_active":"2023-11-06T13:27:41.915806+0000","last_became_peered":"2023-11-06T13:27:41.915806+0000","last_unstale":"2023-11-06T13:27:45.909835+0000","last_undegraded":"2023-11-06T13:27:45.909835+0000","last_fullsized":"2023-11-06T13:27:45.909835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930988+0000","last_change":"2023-11-06T13:27:45.926172+0000","last_active":"2023-11-06T13:27:45.930988+0000","last_peered":"2023-11-06T13:27:45.930988+0000","last_clean":"2023-11-06T13:27:45.930988+0000","last_became_active":"2023-11-06T13:27:45.925675+0000","last_became_peered":"2023-11-06T13:27:45.925675+0000","last_unstale":"2023-11-06T13:27:45.930988+0000","last_undegraded":"2023-11-06T13:27:45.930988+0000","last_fullsized":"2023-11-06T13:27:45.930988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,3],"acting":[4,0,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914605+0000","last_change":"2023-11-06T13:27:41.505959+0000","last_active":"2023-11-06T13:27:45.914605+0000","last_peered":"2023-11-06T13:27:45.914605+0000","last_clean":"2023-11-06T13:27:45.914605+0000","last_became_active":"2023-11-06T13:27:41.505647+0000","last_became_peered":"2023-11-06T13:27:41.505647+0000","last_unstale":"2023-11-06T13:27:45.914605+0000","last_undegraded":"2023-11-06T13:27:45.914605+0000","last_fullsized":"2023-11-06T13:27:45.914605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.909953+0000","last_change":"2023-11-06T13:27:41.910873+0000","last_active":"2023-11-06T13:27:45.909953+0000","last_peered":"2023-11-06T13:27:45.909953+0000","last_clean":"2023-11-06T13:27:45.909953+0000","last_became_active":"2023-11-06T13:27:41.909289+0000","last_became_peered":"2023-11-06T13:27:41.909289+0000","last_unstale":"2023-11-06T13:27:45.909953+0000","last_undegraded":"2023-11-06T13:27:45.909953+0000","last_fullsized":"2023-11-06T13:27:45.909953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.546100+0000","last_change":"2023-11-06T13:27:45.919780+0000","last_active":"2023-11-06T13:27:46.546100+0000","last_peered":"2023-11-06T13:27:46.546100+0000","last_clean":"2023-11-06T13:27:46.546100+0000","last_became_active":"2023-11-06T13:27:45.919239+0000","last_became_peered":"2023-11-06T13:27:45.919239+0000","last_unstale":"2023-11-06T13:27:46.546100+0000","last_undegraded":"2023-11-06T13:27:46.546100+0000","last_fullsized":"2023-11-06T13:27:46.546100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,10],"acting":[3,4,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.545801+0000","last_change":"2023-11-06T13:27:41.515393+0000","last_active":"2023-11-06T13:27:46.545801+0000","last_peered":"2023-11-06T13:27:46.545801+0000","last_clean":"2023-11-06T13:27:46.545801+0000","last_became_active":"2023-11-06T13:27:41.515090+0000","last_became_peered":"2023-11-06T13:27:41.515090+0000","last_unstale":"2023-11-06T13:27:46.545801+0000","last_undegraded":"2023-11-06T13:27:46.545801+0000","last_fullsized":"2023-11-06T13:27:46.545801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910378+0000","last_change":"2023-11-06T13:27:41.905922+0000","last_active":"2023-11-06T13:27:45.910378+0000","last_peered":"2023-11-06T13:27:45.910378+0000","last_clean":"2023-11-06T13:27:45.910378+0000","last_became_active":"2023-11-06T13:27:41.905581+0000","last_became_peered":"2023-11-06T13:27:41.905581+0000","last_unstale":"2023-11-06T13:27:45.910378+0000","last_undegraded":"2023-11-06T13:27:45.910378+0000","last_fullsized":"2023-11-06T13:27:45.910378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9],"acting":[4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.922420+0000","last_change":"2023-11-06T13:27:45.921093+0000","last_active":"2023-11-06T13:27:45.922420+0000","last_peered":"2023-11-06T13:27:45.922420+0000","last_clean":"2023-11-06T13:27:45.922420+0000","last_became_active":"2023-11-06T13:27:45.920625+0000","last_became_peered":"2023-11-06T13:27:45.920625+0000","last_unstale":"2023-11-06T13:27:45.922420+0000","last_undegraded":"2023-11-06T13:27:45.922420+0000","last_fullsized":"2023-11-06T13:27:45.922420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,4,7],"acting":[11,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914117+0000","last_change":"2023-11-06T13:27:41.512401+0000","last_active":"2023-11-06T13:27:45.914117+0000","last_peered":"2023-11-06T13:27:45.914117+0000","last_clean":"2023-11-06T13:27:45.914117+0000","last_became_active":"2023-11-06T13:27:41.512029+0000","last_became_peered":"2023-11-06T13:27:41.512029+0000","last_unstale":"2023-11-06T13:27:45.914117+0000","last_undegraded":"2023-11-06T13:27:45.914117+0000","last_fullsized":"2023-11-06T13:27:45.914117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914818+0000","last_change":"2023-11-06T13:27:41.906645+0000","last_active":"2023-11-06T13:27:45.914818+0000","last_peered":"2023-11-06T13:27:45.914818+0000","last_clean":"2023-11-06T13:27:45.914818+0000","last_became_active":"2023-11-06T13:27:41.906401+0000","last_became_peered":"2023-11-06T13:27:41.906401+0000","last_unstale":"2023-11-06T13:27:45.914818+0000","last_undegraded":"2023-11-06T13:27:45.914818+0000","last_fullsized":"2023-11-06T13:27:45.914818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9],"acting":[0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.933305+0000","last_change":"2023-11-06T13:27:45.931959+0000","last_active":"2023-11-06T13:27:45.933305+0000","last_peered":"2023-11-06T13:27:45.933305+0000","last_clean":"2023-11-06T13:27:45.933305+0000","last_became_active":"2023-11-06T13:27:45.931629+0000","last_became_peered":"2023-11-06T13:27:45.931629+0000","last_unstale":"2023-11-06T13:27:45.933305+0000","last_undegraded":"2023-11-06T13:27:45.933305+0000","last_fullsized":"2023-11-06T13:27:45.933305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5,2],"acting":[0,8,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304405+0000","last_change":"2023-11-06T13:27:41.506812+0000","last_active":"2023-11-06T13:27:46.304405+0000","last_peered":"2023-11-06T13:27:46.304405+0000","last_clean":"2023-11-06T13:27:46.304405+0000","last_became_active":"2023-11-06T13:27:41.506533+0000","last_became_peered":"2023-11-06T13:27:41.506533+0000","last_unstale":"2023-11-06T13:27:46.304405+0000","last_undegraded":"2023-11-06T13:27:46.304405+0000","last_fullsized":"2023-11-06T13:27:46.304405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921172+0000","last_change":"2023-11-06T13:27:41.917285+0000","last_active":"2023-11-06T13:27:45.921172+0000","last_peered":"2023-11-06T13:27:45.921172+0000","last_clean":"2023-11-06T13:27:45.921172+0000","last_became_active":"2023-11-06T13:27:41.916478+0000","last_became_peered":"2023-11-06T13:27:41.916478+0000","last_unstale":"2023-11-06T13:27:45.921172+0000","last_undegraded":"2023-11-06T13:27:45.921172+0000","last_fullsized":"2023-11-06T13:27:45.921172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928148+0000","last_change":"2023-11-06T13:27:45.926797+0000","last_active":"2023-11-06T13:27:45.928148+0000","last_peered":"2023-11-06T13:27:45.928148+0000","last_clean":"2023-11-06T13:27:45.928148+0000","last_became_active":"2023-11-06T13:27:45.926133+0000","last_became_peered":"2023-11-06T13:27:45.926133+0000","last_unstale":"2023-11-06T13:27:45.928148+0000","last_undegraded":"2023-11-06T13:27:45.928148+0000","last_fullsized":"2023-11-06T13:27:45.928148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,8],"acting":[5,0,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"31'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303982+0000","last_change":"2023-11-06T13:27:41.522044+0000","last_active":"2023-11-06T13:27:46.303982+0000","last_peered":"2023-11-06T13:27:46.303982+0000","last_clean":"2023-11-06T13:27:46.303982+0000","last_became_active":"2023-11-06T13:27:41.521666+0000","last_became_peered":"2023-11-06T13:27:41.521666+0000","last_unstale":"2023-11-06T13:27:46.303982+0000","last_undegraded":"2023-11-06T13:27:46.303982+0000","last_fullsized":"2023-11-06T13:27:46.303982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.915685+0000","last_change":"2023-11-06T13:27:41.917525+0000","last_active":"2023-11-06T13:27:45.915685+0000","last_peered":"2023-11-06T13:27:45.915685+0000","last_clean":"2023-11-06T13:27:45.915685+0000","last_became_active":"2023-11-06T13:27:41.916955+0000","last_became_peered":"2023-11-06T13:27:41.916955+0000","last_unstale":"2023-11-06T13:27:45.915685+0000","last_undegraded":"2023-11-06T13:27:45.915685+0000","last_fullsized":"2023-11-06T13:27:45.915685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.931354+0000","last_change":"2023-11-06T13:27:45.930226+0000","last_active":"2023-11-06T13:27:45.931354+0000","last_peered":"2023-11-06T13:27:45.931354+0000","last_clean":"2023-11-06T13:27:45.931354+0000","last_became_active":"2023-11-06T13:27:45.928730+0000","last_became_peered":"2023-11-06T13:27:45.928730+0000","last_unstale":"2023-11-06T13:27:45.931354+0000","last_undegraded":"2023-11-06T13:27:45.931354+0000","last_fullsized":"2023-11-06T13:27:45.931354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,11,5],"acting":[2,0,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"26'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.304573+0000","last_change":"2023-11-06T13:27:41.514304+0000","last_active":"2023-11-06T13:27:46.304573+0000","last_peered":"2023-11-06T13:27:46.304573+0000","last_clean":"2023-11-06T13:27:46.304573+0000","last_became_active":"2023-11-06T13:27:41.514026+0000","last_became_peered":"2023-11-06T13:27:41.514026+0000","last_unstale":"2023-11-06T13:27:46.304573+0000","last_undegraded":"2023-11-06T13:27:46.304573+0000","last_fullsized":"2023-11-06T13:27:46.304573+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.920029+0000","last_change":"2023-11-06T13:27:41.913958+0000","last_active":"2023-11-06T13:27:45.920029+0000","last_peered":"2023-11-06T13:27:45.920029+0000","last_clean":"2023-11-06T13:27:45.920029+0000","last_became_active":"2023-11-06T13:27:41.913549+0000","last_became_peered":"2023-11-06T13:27:41.913549+0000","last_unstale":"2023-11-06T13:27:45.920029+0000","last_undegraded":"2023-11-06T13:27:45.920029+0000","last_fullsized":"2023-11-06T13:27:45.920029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.929808+0000","last_change":"2023-11-06T13:27:45.927848+0000","last_active":"2023-11-06T13:27:45.929808+0000","last_peered":"2023-11-06T13:27:45.929808+0000","last_clean":"2023-11-06T13:27:45.929808+0000","last_became_active":"2023-11-06T13:27:45.926818+0000","last_became_peered":"2023-11-06T13:27:45.926818+0000","last_unstale":"2023-11-06T13:27:45.929808+0000","last_undegraded":"2023-11-06T13:27:45.929808+0000","last_fullsized":"2023-11-06T13:27:45.929808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,5,2],"acting":[1,10,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"31'5","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.303618+0000","last_change":"2023-11-06T13:27:41.507772+0000","last_active":"2023-11-06T13:27:46.303618+0000","last_peered":"2023-11-06T13:27:46.303618+0000","last_clean":"2023-11-06T13:27:46.303618+0000","last_became_active":"2023-11-06T13:27:41.507478+0000","last_became_peered":"2023-11-06T13:27:41.507478+0000","last_unstale":"2023-11-06T13:27:46.303618+0000","last_undegraded":"2023-11-06T13:27:46.303618+0000","last_fullsized":"2023-11-06T13:27:46.303618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911442+0000","last_change":"2023-11-06T13:27:41.908661+0000","last_active":"2023-11-06T13:27:45.911442+0000","last_peered":"2023-11-06T13:27:45.911442+0000","last_clean":"2023-11-06T13:27:45.911442+0000","last_became_active":"2023-11-06T13:27:41.908403+0000","last_became_peered":"2023-11-06T13:27:41.908403+0000","last_unstale":"2023-11-06T13:27:45.911442+0000","last_undegraded":"2023-11-06T13:27:45.911442+0000","last_fullsized":"2023-11-06T13:27:45.911442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.171646+0000","last_change":"2023-11-06T13:27:46.170209+0000","last_active":"2023-11-06T13:27:46.171646+0000","last_peered":"2023-11-06T13:27:46.171646+0000","last_clean":"2023-11-06T13:27:46.171646+0000","last_became_active":"2023-11-06T13:27:46.169716+0000","last_became_peered":"2023-11-06T13:27:46.169716+0000","last_unstale":"2023-11-06T13:27:46.171646+0000","last_undegraded":"2023-11-06T13:27:46.171646+0000","last_fullsized":"2023-11-06T13:27:46.171646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,9,2],"acting":[1,6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"31'6","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.281560+0000","last_change":"2023-11-06T13:27:41.520280+0000","last_active":"2023-11-06T13:28:16.281560+0000","last_peered":"2023-11-06T13:28:16.281560+0000","last_clean":"2023-11-06T13:28:16.281560+0000","last_became_active":"2023-11-06T13:27:41.520040+0000","last_became_peered":"2023-11-06T13:27:41.520040+0000","last_unstale":"2023-11-06T13:28:16.281560+0000","last_undegraded":"2023-11-06T13:28:16.281560+0000","last_fullsized":"2023-11-06T13:28:16.281560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.163555+0000","last_change":"2023-11-06T13:27:41.916016+0000","last_active":"2023-11-06T13:27:46.163555+0000","last_peered":"2023-11-06T13:27:46.163555+0000","last_clean":"2023-11-06T13:27:46.163555+0000","last_became_active":"2023-11-06T13:27:41.915743+0000","last_became_peered":"2023-11-06T13:27:41.915743+0000","last_unstale":"2023-11-06T13:27:46.163555+0000","last_undegraded":"2023-11-06T13:27:46.163555+0000","last_fullsized":"2023-11-06T13:27:46.163555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927534+0000","last_change":"2023-11-06T13:27:45.926254+0000","last_active":"2023-11-06T13:27:45.927534+0000","last_peered":"2023-11-06T13:27:45.927534+0000","last_clean":"2023-11-06T13:27:45.927534+0000","last_became_active":"2023-11-06T13:27:45.925734+0000","last_became_peered":"2023-11-06T13:27:45.925734+0000","last_unstale":"2023-11-06T13:27:45.927534+0000","last_undegraded":"2023-11-06T13:27:45.927534+0000","last_fullsized":"2023-11-06T13:27:45.927534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,11,0],"acting":[3,5,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"31'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.345498+0000","last_change":"2023-11-06T13:27:41.513362+0000","last_active":"2023-11-06T13:27:54.345498+0000","last_peered":"2023-11-06T13:27:54.345498+0000","last_clean":"2023-11-06T13:27:54.345498+0000","last_became_active":"2023-11-06T13:27:41.512991+0000","last_became_peered":"2023-11-06T13:27:41.512991+0000","last_unstale":"2023-11-06T13:27:54.345498+0000","last_undegraded":"2023-11-06T13:27:54.345498+0000","last_fullsized":"2023-11-06T13:27:54.345498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.919525+0000","last_change":"2023-11-06T13:27:41.910718+0000","last_active":"2023-11-06T13:27:45.919525+0000","last_peered":"2023-11-06T13:27:45.919525+0000","last_clean":"2023-11-06T13:27:45.919525+0000","last_became_active":"2023-11-06T13:27:41.910431+0000","last_became_peered":"2023-11-06T13:27:41.910431+0000","last_unstale":"2023-11-06T13:27:45.919525+0000","last_undegraded":"2023-11-06T13:27:45.919525+0000","last_fullsized":"2023-11-06T13:27:45.919525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927229+0000","last_change":"2023-11-06T13:27:45.925894+0000","last_active":"2023-11-06T13:27:45.927229+0000","last_peered":"2023-11-06T13:27:45.927229+0000","last_clean":"2023-11-06T13:27:45.927229+0000","last_became_active":"2023-11-06T13:27:45.925412+0000","last_became_peered":"2023-11-06T13:27:45.925412+0000","last_unstale":"2023-11-06T13:27:45.927229+0000","last_undegraded":"2023-11-06T13:27:45.927229+0000","last_fullsized":"2023-11-06T13:27:45.927229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,8],"acting":[3,2,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"31'6","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.261047+0000","last_change":"2023-11-06T13:27:41.517150+0000","last_active":"2023-11-06T13:27:57.261047+0000","last_peered":"2023-11-06T13:27:57.261047+0000","last_clean":"2023-11-06T13:27:57.261047+0000","last_became_active":"2023-11-06T13:27:41.516855+0000","last_became_peered":"2023-11-06T13:27:41.516855+0000","last_unstale":"2023-11-06T13:27:57.261047+0000","last_undegraded":"2023-11-06T13:27:57.261047+0000","last_fullsized":"2023-11-06T13:27:57.261047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912716+0000","last_change":"2023-11-06T13:27:41.911445+0000","last_active":"2023-11-06T13:27:45.912716+0000","last_peered":"2023-11-06T13:27:45.912716+0000","last_clean":"2023-11-06T13:27:45.912716+0000","last_became_active":"2023-11-06T13:27:41.911167+0000","last_became_peered":"2023-11-06T13:27:41.911167+0000","last_unstale":"2023-11-06T13:27:45.912716+0000","last_undegraded":"2023-11-06T13:27:45.912716+0000","last_fullsized":"2023-11-06T13:27:45.912716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928887+0000","last_change":"2023-11-06T13:27:45.925367+0000","last_active":"2023-11-06T13:27:45.928887+0000","last_peered":"2023-11-06T13:27:45.928887+0000","last_clean":"2023-11-06T13:27:45.928887+0000","last_became_active":"2023-11-06T13:27:45.924672+0000","last_became_peered":"2023-11-06T13:27:45.924672+0000","last_unstale":"2023-11-06T13:27:45.928887+0000","last_undegraded":"2023-11-06T13:27:45.928887+0000","last_fullsized":"2023-11-06T13:27:45.928887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8,0],"acting":[7,9,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:16.292759+0000","last_change":"2023-11-06T13:27:41.512846+0000","last_active":"2023-11-06T13:28:16.292759+0000","last_peered":"2023-11-06T13:28:16.292759+0000","last_clean":"2023-11-06T13:28:16.292759+0000","last_became_active":"2023-11-06T13:27:41.512307+0000","last_became_peered":"2023-11-06T13:27:41.512307+0000","last_unstale":"2023-11-06T13:28:16.292759+0000","last_undegraded":"2023-11-06T13:28:16.292759+0000","last_fullsized":"2023-11-06T13:28:16.292759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.910054+0000","last_change":"2023-11-06T13:27:41.909770+0000","last_active":"2023-11-06T13:27:45.910054+0000","last_peered":"2023-11-06T13:27:45.910054+0000","last_clean":"2023-11-06T13:27:45.910054+0000","last_became_active":"2023-11-06T13:27:41.909541+0000","last_became_peered":"2023-11-06T13:27:41.909541+0000","last_unstale":"2023-11-06T13:27:45.910054+0000","last_undegraded":"2023-11-06T13:27:45.910054+0000","last_fullsized":"2023-11-06T13:27:45.910054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.932246+0000","last_change":"2023-11-06T13:27:45.930893+0000","last_active":"2023-11-06T13:27:45.932246+0000","last_peered":"2023-11-06T13:27:45.932246+0000","last_clean":"2023-11-06T13:27:45.932246+0000","last_became_active":"2023-11-06T13:27:45.930615+0000","last_became_peered":"2023-11-06T13:27:45.930615+0000","last_unstale":"2023-11-06T13:27:45.932246+0000","last_undegraded":"2023-11-06T13:27:45.932246+0000","last_fullsized":"2023-11-06T13:27:45.932246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,3,10],"acting":[8,1,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.15","version":"31'4","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:54.347432+0000","last_change":"2023-11-06T13:27:41.515898+0000","last_active":"2023-11-06T13:27:54.347432+0000","last_peered":"2023-11-06T13:27:54.347432+0000","last_clean":"2023-11-06T13:27:54.347432+0000","last_became_active":"2023-11-06T13:27:41.515607+0000","last_became_peered":"2023-11-06T13:27:41.515607+0000","last_unstale":"2023-11-06T13:27:54.347432+0000","last_undegraded":"2023-11-06T13:27:54.347432+0000","last_fullsized":"2023-11-06T13:27:54.347432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911403+0000","last_change":"2023-11-06T13:27:41.908100+0000","last_active":"2023-11-06T13:27:45.911403+0000","last_peered":"2023-11-06T13:27:45.911403+0000","last_clean":"2023-11-06T13:27:45.911403+0000","last_became_active":"2023-11-06T13:27:41.907811+0000","last_became_peered":"2023-11-06T13:27:41.907811+0000","last_unstale":"2023-11-06T13:27:45.911403+0000","last_undegraded":"2023-11-06T13:27:45.911403+0000","last_fullsized":"2023-11-06T13:27:45.911403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.928170+0000","last_change":"2023-11-06T13:27:45.926835+0000","last_active":"2023-11-06T13:27:45.928170+0000","last_peered":"2023-11-06T13:27:45.928170+0000","last_clean":"2023-11-06T13:27:45.928170+0000","last_became_active":"2023-11-06T13:27:45.926361+0000","last_became_peered":"2023-11-06T13:27:45.926361+0000","last_unstale":"2023-11-06T13:27:45.928170+0000","last_undegraded":"2023-11-06T13:27:45.928170+0000","last_fullsized":"2023-11-06T13:27:45.928170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10,1],"acting":[5,0,10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:57.259826+0000","last_change":"2023-11-06T13:27:41.514902+0000","last_active":"2023-11-06T13:27:57.259826+0000","last_peered":"2023-11-06T13:27:57.259826+0000","last_clean":"2023-11-06T13:27:57.259826+0000","last_became_active":"2023-11-06T13:27:41.514425+0000","last_became_peered":"2023-11-06T13:27:41.514425+0000","last_unstale":"2023-11-06T13:27:57.259826+0000","last_undegraded":"2023-11-06T13:27:57.259826+0000","last_fullsized":"2023-11-06T13:27:57.259826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912554+0000","last_change":"2023-11-06T13:27:41.909400+0000","last_active":"2023-11-06T13:27:45.912554+0000","last_peered":"2023-11-06T13:27:45.912554+0000","last_clean":"2023-11-06T13:27:45.912554+0000","last_became_active":"2023-11-06T13:27:41.909169+0000","last_became_peered":"2023-11-06T13:27:41.909169+0000","last_unstale":"2023-11-06T13:27:45.912554+0000","last_undegraded":"2023-11-06T13:27:45.912554+0000","last_fullsized":"2023-11-06T13:27:45.912554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930343+0000","last_change":"2023-11-06T13:27:45.928008+0000","last_active":"2023-11-06T13:27:45.930343+0000","last_peered":"2023-11-06T13:27:45.930343+0000","last_clean":"2023-11-06T13:27:45.930343+0000","last_became_active":"2023-11-06T13:27:45.927506+0000","last_became_peered":"2023-11-06T13:27:45.927506+0000","last_unstale":"2023-11-06T13:27:45.930343+0000","last_undegraded":"2023-11-06T13:27:45.930343+0000","last_fullsized":"2023-11-06T13:27:45.930343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"31'5","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:28:17.281736+0000","last_change":"2023-11-06T13:27:41.521318+0000","last_active":"2023-11-06T13:28:17.281736+0000","last_peered":"2023-11-06T13:28:17.281736+0000","last_clean":"2023-11-06T13:28:17.281736+0000","last_became_active":"2023-11-06T13:27:41.521108+0000","last_became_peered":"2023-11-06T13:27:41.521108+0000","last_unstale":"2023-11-06T13:28:17.281736+0000","last_undegraded":"2023-11-06T13:28:17.281736+0000","last_fullsized":"2023-11-06T13:28:17.281736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911036+0000","last_change":"2023-11-06T13:27:41.914507+0000","last_active":"2023-11-06T13:27:45.911036+0000","last_peered":"2023-11-06T13:27:45.911036+0000","last_clean":"2023-11-06T13:27:45.911036+0000","last_became_active":"2023-11-06T13:27:41.914220+0000","last_became_peered":"2023-11-06T13:27:41.914220+0000","last_unstale":"2023-11-06T13:27:45.911036+0000","last_undegraded":"2023-11-06T13:27:45.911036+0000","last_fullsized":"2023-11-06T13:27:45.911036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.930593+0000","last_change":"2023-11-06T13:27:45.928268+0000","last_active":"2023-11-06T13:27:45.930593+0000","last_peered":"2023-11-06T13:27:45.930593+0000","last_clean":"2023-11-06T13:27:45.930593+0000","last_became_active":"2023-11-06T13:27:45.927875+0000","last_became_peered":"2023-11-06T13:27:45.927875+0000","last_unstale":"2023-11-06T13:27:45.930593+0000","last_undegraded":"2023-11-06T13:27:45.930593+0000","last_fullsized":"2023-11-06T13:27:45.930593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,8,7],"acting":[1,10,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.921881+0000","last_change":"2023-11-06T13:27:45.921251+0000","last_active":"2023-11-06T13:27:45.921881+0000","last_peered":"2023-11-06T13:27:45.921881+0000","last_clean":"2023-11-06T13:27:45.921881+0000","last_became_active":"2023-11-06T13:27:45.920805+0000","last_became_peered":"2023-11-06T13:27:45.920805+0000","last_unstale":"2023-11-06T13:27:45.921881+0000","last_undegraded":"2023-11-06T13:27:45.921881+0000","last_fullsized":"2023-11-06T13:27:45.921881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,11,2],"acting":[9,7,11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.912597+0000","last_change":"2023-11-06T13:27:41.517435+0000","last_active":"2023-11-06T13:27:45.912597+0000","last_peered":"2023-11-06T13:27:45.912597+0000","last_clean":"2023-11-06T13:27:45.912597+0000","last_became_active":"2023-11-06T13:27:41.517118+0000","last_became_peered":"2023-11-06T13:27:41.517118+0000","last_unstale":"2023-11-06T13:27:45.912597+0000","last_undegraded":"2023-11-06T13:27:45.912597+0000","last_fullsized":"2023-11-06T13:27:45.912597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.913206+0000","last_change":"2023-11-06T13:27:41.909710+0000","last_active":"2023-11-06T13:27:45.913206+0000","last_peered":"2023-11-06T13:27:45.913206+0000","last_clean":"2023-11-06T13:27:45.913206+0000","last_became_active":"2023-11-06T13:27:41.909422+0000","last_became_peered":"2023-11-06T13:27:41.909422+0000","last_unstale":"2023-11-06T13:27:45.913206+0000","last_undegraded":"2023-11-06T13:27:45.913206+0000","last_fullsized":"2023-11-06T13:27:45.913206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.927576+0000","last_change":"2023-11-06T13:27:45.924892+0000","last_active":"2023-11-06T13:27:45.927576+0000","last_peered":"2023-11-06T13:27:45.927576+0000","last_clean":"2023-11-06T13:27:45.927576+0000","last_became_active":"2023-11-06T13:27:45.923918+0000","last_became_peered":"2023-11-06T13:27:45.923918+0000","last_unstale":"2023-11-06T13:27:45.927576+0000","last_undegraded":"2023-11-06T13:27:45.927576+0000","last_fullsized":"2023-11-06T13:27:45.927576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10,4,8],"acting":[7,10,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.911147+0000","last_change":"2023-11-06T13:27:41.514237+0000","last_active":"2023-11-06T13:27:45.911147+0000","last_peered":"2023-11-06T13:27:45.911147+0000","last_clean":"2023-11-06T13:27:45.911147+0000","last_became_active":"2023-11-06T13:27:41.513638+0000","last_became_peered":"2023-11-06T13:27:41.513638+0000","last_unstale":"2023-11-06T13:27:45.911147+0000","last_undegraded":"2023-11-06T13:27:45.911147+0000","last_fullsized":"2023-11-06T13:27:45.911147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.914863+0000","last_change":"2023-11-06T13:27:41.909717+0000","last_active":"2023-11-06T13:27:45.914863+0000","last_peered":"2023-11-06T13:27:45.914863+0000","last_clean":"2023-11-06T13:27:45.914863+0000","last_became_active":"2023-11-06T13:27:41.909495+0000","last_became_peered":"2023-11-06T13:27:41.909495+0000","last_unstale":"2023-11-06T13:27:45.914863+0000","last_undegraded":"2023-11-06T13:27:45.914863+0000","last_fullsized":"2023-11-06T13:27:45.914863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-06T13:27:56.360415+0000","last_change":"2023-11-06T13:27:41.517119+0000","last_active":"2023-11-06T13:27:56.360415+0000","last_peered":"2023-11-06T13:27:56.360415+0000","last_clean":"2023-11-06T13:27:56.360415+0000","last_became_active":"2023-11-06T13:27:41.516835+0000","last_became_peered":"2023-11-06T13:27:41.516835+0000","last_unstale":"2023-11-06T13:27:56.360415+0000","last_undegraded":"2023-11-06T13:27:56.360415+0000","last_fullsized":"2023-11-06T13:27:56.360415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:40.475287+0000","last_clean_scrub_stamp":"2023-11-06T13:27:40.475287+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:45.917531+0000","last_change":"2023-11-06T13:27:41.916986+0000","last_active":"2023-11-06T13:27:45.917531+0000","last_peered":"2023-11-06T13:27:45.917531+0000","last_clean":"2023-11-06T13:27:45.917531+0000","last_became_active":"2023-11-06T13:27:41.916663+0000","last_became_peered":"2023-11-06T13:27:41.916663+0000","last_unstale":"2023-11-06T13:27:45.917531+0000","last_undegraded":"2023-11-06T13:27:45.917531+0000","last_fullsized":"2023-11-06T13:27:45.917531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:41.481437+0000","last_clean_scrub_stamp":"2023-11-06T13:27:41.481437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-06T13:27:46.170754+0000","last_change":"2023-11-06T13:27:46.169365+0000","last_active":"2023-11-06T13:27:46.170754+0000","last_peered":"2023-11-06T13:27:46.170754+0000","last_clean":"2023-11-06T13:27:46.170754+0000","last_became_active":"2023-11-06T13:27:46.168910+0000","last_became_peered":"2023-11-06T13:27:46.168910+0000","last_unstale":"2023-11-06T13:27:46.170754+0000","last_undegraded":"2023-11-06T13:27:46.170754+0000","last_fullsized":"2023-11-06T13:27:46.170754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-06T13:27:44.900621+0000","last_clean_scrub_stamp":"2023-11-06T13:27:44.900621+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6,1],"acting":[4,11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":65200,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":251,"num_read_kb":198,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":130400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":128,"acting":128,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":164343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.383}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":10,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":222857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":348160,"data_stored":165263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":8,"up_from":17,"seq":73014444043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":372736,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":161459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297448,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074392,"statfs":{"total":96636764160,"available":96332177408,"internally_reserved":0,"allocated":360448,"data_stored":165409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":165567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297444,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074396,"statfs":{"total":96636764160,"available":96332181504,"internally_reserved":0,"allocated":356352,"data_stored":165423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":364544,"data_stored":166449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":458752,"data_stored":230359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297456,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074384,"statfs":{"total":96636764160,"available":96332169216,"internally_reserved":0,"allocated":368640,"data_stored":163127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":61000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-06T13:28:22.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:22.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.312+0000 7f961ce90700 1 Processor -- start 2023-11-06T13:28:22.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.312+0000 7f961ce90700 1 -- start start 2023-11-06T13:28:22.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961ce90700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f96181756e0 0x7f96180640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961ce90700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961817d9d0 con 0x7f96180645d0 2023-11-06T13:28:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961ce90700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9618064a50 con 0x7f961817e570 2023-11-06T13:28:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961ce90700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180c8560 con 0x7f96181756e0 2023-11-06T13:28:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f9615d9b700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f96180645d0 0x7f961817de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50072/0 (socket says 172.21.15.38:50072) 2023-11-06T13:28:22.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f9615d9b700 1 -- 172.21.15.38:0/1926892774 learned_addr learned my addr 172.21.15.38:0/1926892774 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:22.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961659c700 1 --2- 172.21.15.38:0/1926892774 >> v2:172.21.15.44:3300/0 conn(0x7f96181756e0 0x7f96180640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630637840 0 0) 0x7f961817d9d0 con 0x7f96180645d0 2023-11-06T13:28:22.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.313+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96040033f0 con 0x7f96180645d0 2023-11-06T13:28:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 52307276 0 0) 0x7f96040033f0 con 0x7f96180645d0 2023-11-06T13:28:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 >> v2:172.21.15.44:3300/0 conn(0x7f96181756e0 msgr2=0x7f96180640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 --2- 172.21.15.38:0/1926892774 >> v2:172.21.15.44:3300/0 conn(0x7f96181756e0 0x7f96180640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 >> v1:172.21.15.163:6789/0 conn(0x7f961817e570 legacy=0x7f9618185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961817c800 con 0x7f96180645d0 2023-11-06T13:28:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f9600001470 con 0x7f96180645d0 2023-11-06T13:28:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 >> v1:172.21.15.38:6789/0 conn(0x7f96180645d0 legacy=0x7f961817de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9604003930 0x7f9604003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604004690 0x7f9604004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9604005000 0x7f960400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960400bf00 con 0x7f9604003930 2023-11-06T13:28:22.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960400c070 con 0x7f9604004690 2023-11-06T13:28:22.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960400c230 con 0x7f9604005000 2023-11-06T13:28:22.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9604003930 0x7f9604003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f9615d9b700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604004690 0x7f9604004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f9616d9d700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9604005000 0x7f960400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 -- 172.21.15.38:0/1926892774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9604005000 msgr2=0x7f960400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9604005000 0x7f960400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 -- 172.21.15.38:0/1926892774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604004690 msgr2=0x7f9604004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604004690 0x7f9604004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 -- 172.21.15.38:0/1926892774 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040033f0 con 0x7f9604003930 2023-11-06T13:28:22.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f9616d9d700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9604005000 0x7f960400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f9616d9d700 1 -- 172.21.15.38:0/1926892774 reap_dead start 2023-11-06T13:28:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961659c700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9604003930 0x7f9604003d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f961000e1c0 tx=0x7f961000b040).ready entity=mon.0 client_cookie=9570ed3bfc0cede server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.314+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9610009ac0 con 0x7f9604003930 2023-11-06T13:28:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961000f040 con 0x7f9604003930 2023-11-06T13:28:22.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961559a700 1 -- 172.21.15.38:0/1926892774 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000eca0 con 0x7f9604003930 2023-11-06T13:28:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 -- 172.21.15.38:0/1926892774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9604003930 msgr2=0x7f9604003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9604003930 0x7f9604003d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f961000e1c0 tx=0x7f961000b040).stop 2023-11-06T13:28:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 -- 172.21.15.38:0/1926892774 shutdown_connections 2023-11-06T13:28:22.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 --2- 172.21.15.38:0/1926892774 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9604003930 0x7f9604003d50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 -- 172.21.15.38:0/1926892774 >> 172.21.15.38:0/1926892774 conn(0x7f9618069ea0 msgr2=0x7f961806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:22.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 -- 172.21.15.38:0/1926892774 shutdown_connections 2023-11-06T13:28:22.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.315+0000 7f961ce90700 1 -- 172.21.15.38:0/1926892774 wait complete. 2023-11-06T13:28:22.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.316+0000 7f961ce90700 1 Processor -- start 2023-11-06T13:28:22.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 -- start start 2023-11-06T13:28:22.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604003930 0x7f96181502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 0x7f96180cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96180cb2d0 0x7f961817a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180cbf60 con 0x7f96181507c0 2023-11-06T13:28:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180cbc80 con 0x7f9604003930 2023-11-06T13:28:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.317+0000 7f961ce90700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618179420 con 0x7f96180cb2d0 2023-11-06T13:28:22.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 0x7f96180cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 0x7f96180cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48480/0 (socket says 172.21.15.38:48480) 2023-11-06T13:28:22.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 -- 172.21.15.38:0/1669664505 learned_addr learned my addr 172.21.15.38:0/1669664505 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:22.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f961659c700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604003930 0x7f96181502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9616d9d700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96180cb2d0 0x7f961817a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 -- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96180cb2d0 msgr2=0x7f961817a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96180cb2d0 0x7f961817a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 -- 172.21.15.38:0/1669664505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604003930 msgr2=0x7f96181502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604003930 0x7f96181502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 -- 172.21.15.38:0/1669664505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618179700 con 0x7f96181507c0 2023-11-06T13:28:22.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9616d9d700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96180cb2d0 0x7f961817a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:22.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f9615d9b700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 0x7f96180cade0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f96000047e0 tx=0x7f9600001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011590 con 0x7f96181507c0 2023-11-06T13:28:22.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96000116f0 con 0x7f96181507c0 2023-11-06T13:28:22.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96181799e0 con 0x7f96181507c0 2023-11-06T13:28:22.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011a70 con 0x7f96181507c0 2023-11-06T13:28:22.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.318+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180cb750 con 0x7f96181507c0 2023-11-06T13:28:22.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.319+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961806c580 con 0x7f96181507c0 2023-11-06T13:28:22.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.320+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f960001d3b0 con 0x7f96181507c0 2023-11-06T13:28:22.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.321+0000 7f960e7fc700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f95f808cbd0 0x7f95f808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.321+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f96000b19c0 con 0x7f96181507c0 2023-11-06T13:28:22.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.321+0000 7f961659c700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f95f808cbd0 0x7f95f808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.321+0000 7f961659c700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f95f808cbd0 0x7f95f808f090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f961000f010 tx=0x7f961001a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.325+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9600081f00 con 0x7f96181507c0 2023-11-06T13:28:22.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.500+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f961817cae0 con 0x7f96181507c0 2023-11-06T13:28:22.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.501+0000 7f960e7fc700 1 -- 172.21.15.38:0/1669664505 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f9600019020 con 0x7f96181507c0 2023-11-06T13:28:22.505 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:22.506 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:22.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f95f808cbd0 msgr2=0x7f95f808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f95f808cbd0 0x7f95f808f090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f961000f010 tx=0x7f961001a000).stop 2023-11-06T13:28:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 msgr2=0x7f96180cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 0x7f96180cade0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f96000047e0 tx=0x7f9600001e50).stop 2023-11-06T13:28:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 shutdown_connections 2023-11-06T13:28:22.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96180cb2d0 0x7f961817a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f95f808cbd0 0x7f95f808f090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9604003930 0x7f96181502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 --2- 172.21.15.38:0/1669664505 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f96181507c0 0x7f96180cade0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 >> 172.21.15.38:0/1669664505 conn(0x7f9618069ea0 msgr2=0x7f9618184be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:22.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 shutdown_connections 2023-11-06T13:28:22.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.503+0000 7f961ce90700 1 -- 172.21.15.38:0/1669664505 wait complete. 2023-11-06T13:28:22.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-06T13:27:40.368418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-06T13:27:40.848313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-06T13:27:43.934481+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-06T13:28:22.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:28:22.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.638+0000 7f26a5e76700 1 Processor -- start 2023-11-06T13:28:22.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.638+0000 7f26a5e76700 1 -- start start 2023-11-06T13:28:22.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.639+0000 7f26a5e76700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f26a017c3f0 0x7f26a006a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.639+0000 7f26a5e76700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f26a017c7d0 0x7f26a017cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.639+0000 7f26a5e76700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a017dd60 con 0x7f26a00edcb0 2023-11-06T13:28:22.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.639+0000 7f26a5e76700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00ca950 con 0x7f26a017c3f0 2023-11-06T13:28:22.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.639+0000 7f26a5e76700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00ecc10 con 0x7f26a017c7d0 2023-11-06T13:28:22.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f26a017c3f0 0x7f26a006a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f26a017c3f0 0x7f26a006a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:53398/0 (socket says 172.21.15.38:53398) 2023-11-06T13:28:22.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 -- 172.21.15.38:0/3291025370 learned_addr learned my addr 172.21.15.38:0/3291025370 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:22.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a5675700 1 --2- 172.21.15.38:0/3291025370 >> v2:172.21.15.163:3300/0 conn(0x7f26a017c7d0 0x7f26a017cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 -- 172.21.15.38:0/3291025370 >> v2:172.21.15.163:3300/0 conn(0x7f26a017c7d0 msgr2=0x7f26a017cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:22.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 --2- 172.21.15.38:0/3291025370 >> v2:172.21.15.163:3300/0 conn(0x7f26a017c7d0 0x7f26a017cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 -- 172.21.15.38:0/3291025370 >> v1:172.21.15.163:6789/0 conn(0x7f26a00edcb0 legacy=0x7f26a00ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 -- 172.21.15.38:0/3291025370 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00ecef0 con 0x7f26a017c3f0 2023-11-06T13:28:22.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f26a4e74700 1 --2- 172.21.15.38:0/3291025370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a006a690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f26a00ec6d0 tx=0x7f2698009840).ready entity=mon.1 client_cookie=2a6c33c1a1c67b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f269f7fe700 1 -- 172.21.15.38:0/3291025370 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800e070 con 0x7f26a017c3f0 2023-11-06T13:28:22.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f269f7fe700 1 -- 172.21.15.38:0/3291025370 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269800ba20 con 0x7f26a017c3f0 2023-11-06T13:28:22.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.640+0000 7f269f7fe700 1 -- 172.21.15.38:0/3291025370 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800bda0 con 0x7f26a017c3f0 2023-11-06T13:28:22.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 -- 172.21.15.38:0/3291025370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 msgr2=0x7f26a006a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3291025370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a006a690 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f26a00ec6d0 tx=0x7f2698009840).stop 2023-11-06T13:28:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 -- 172.21.15.38:0/3291025370 shutdown_connections 2023-11-06T13:28:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3291025370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a006a690 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3291025370 >> v2:172.21.15.163:3300/0 conn(0x7f26a017c7d0 0x7f26a017cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 -- 172.21.15.38:0/3291025370 >> 172.21.15.38:0/3291025370 conn(0x7f26a005e1b0 msgr2=0x7f26a005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:22.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 -- 172.21.15.38:0/3291025370 shutdown_connections 2023-11-06T13:28:22.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.641+0000 7f26a5e76700 1 -- 172.21.15.38:0/3291025370 wait complete. 2023-11-06T13:28:22.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.642+0000 7f26a5e76700 1 Processor -- start 2023-11-06T13:28:22.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.642+0000 7f26a5e76700 1 -- start start 2023-11-06T13:28:22.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.643+0000 7f26a5e76700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26a00edcb0 0x7f26a016b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.643+0000 7f26a5e76700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a017ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.643+0000 7f26a5e76700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 0x7f26a017d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.643+0000 7f26a5e76700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00c4690 con 0x7f26a017c7d0 2023-11-06T13:28:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.643+0000 7f26a5e76700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00c4360 con 0x7f26a017c3f0 2023-11-06T13:28:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.643+0000 7f26a5e76700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a016d980 con 0x7f26a00edcb0 2023-11-06T13:28:22.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 0x7f26a017d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 0x7f26a017d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48490/0 (socket says 172.21.15.38:48490) 2023-11-06T13:28:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 -- 172.21.15.38:0/3210112715 learned_addr learned my addr 172.21.15.38:0/3210112715 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a4e74700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26a00edcb0 0x7f26a016b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f269ffff700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a017ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 -- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26a00edcb0 msgr2=0x7f26a016b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26a00edcb0 0x7f26a016b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 -- 172.21.15.38:0/3210112715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 msgr2=0x7f26a017ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a017ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 -- 172.21.15.38:0/3210112715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698009ae0 con 0x7f26a017c7d0 2023-11-06T13:28:22.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f269ffff700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a017ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5675700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 0x7f26a017d2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f268800e900 tx=0x7f2688009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688012600 con 0x7f26a017c7d0 2023-11-06T13:28:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2688012760 con 0x7f26a017c7d0 2023-11-06T13:28:22.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a016dc60 con 0x7f26a017c7d0 2023-11-06T13:28:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2688012ae0 con 0x7f26a017c7d0 2023-11-06T13:28:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.644+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a016e220 con 0x7f26a017c7d0 2023-11-06T13:28:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.645+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a00475a0 con 0x7f26a017c7d0 2023-11-06T13:28:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.646+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f268801b400 con 0x7f26a017c7d0 2023-11-06T13:28:22.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.647+0000 7f269cff9700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f268008cbd0 0x7f268008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.647+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f26880b2440 con 0x7f26a017c7d0 2023-11-06T13:28:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.647+0000 7f26a4e74700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f268008cbd0 0x7f268008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.648+0000 7f26a4e74700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f268008cbd0 0x7f268008f090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f269800c010 tx=0x7f2698009840).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.651+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2688082980 con 0x7f26a017c7d0 2023-11-06T13:28:22.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.823+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f26a00ed1d0 con 0x7f26a017c7d0 2023-11-06T13:28:22.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.823+0000 7f269cff9700 1 -- 172.21.15.38:0/3210112715 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v31) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2688016070 con 0x7f26a017c7d0 2023-11-06T13:28:22.828 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:28:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f268008cbd0 msgr2=0x7f268008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f268008cbd0 0x7f268008f090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f269800c010 tx=0x7f2698009840).stop 2023-11-06T13:28:22.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 msgr2=0x7f26a017d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 0x7f26a017d2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f268800e900 tx=0x7f2688009060).stop 2023-11-06T13:28:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 shutdown_connections 2023-11-06T13:28:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f26a017c7d0 0x7f26a017d2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26a00edcb0 0x7f26a016b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f268008cbd0 0x7f268008f090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 --2- 172.21.15.38:0/3210112715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26a017c3f0 0x7f26a017ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 >> 172.21.15.38:0/3210112715 conn(0x7f26a005e1b0 msgr2=0x7f26a00ee160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 shutdown_connections 2023-11-06T13:28:22.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.825+0000 7f26a5e76700 1 -- 172.21.15.38:0/3210112715 wait complete. 2023-11-06T13:28:22.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:28:22.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.958+0000 7ff1e2518700 1 Processor -- start 2023-11-06T13:28:22.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.958+0000 7ff1e2518700 1 -- start start 2023-11-06T13:28:22.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1e2518700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff1dc17e260 0x7ff1dc17e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1e2518700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc17ddd0 con 0x7ff1dc175a40 2023-11-06T13:28:22.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1e2518700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc064780 con 0x7ff1dc183830 2023-11-06T13:28:22.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1e2518700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c4c20 con 0x7ff1dc17e260 2023-11-06T13:28:22.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1dbfff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff1dc175a40 0x7ff1dc17f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50088/0 (socket says 172.21.15.38:50088) 2023-11-06T13:28:22.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1dbfff700 1 -- 172.21.15.38:0/155468241 learned_addr learned my addr 172.21.15.38:0/155468241 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:22.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1db7fe700 1 --2- 172.21.15.38:0/155468241 >> v2:172.21.15.44:3300/0 conn(0x7ff1dc17e260 0x7ff1dc17e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819960612 0 0) 0x7ff1dc17ddd0 con 0x7ff1dc175a40 2023-11-06T13:28:22.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c40033f0 con 0x7ff1dc175a40 2023-11-06T13:28:22.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517524308 0 0) 0x7ff1dc064780 con 0x7ff1dc183830 2023-11-06T13:28:22.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1dc17ddd0 con 0x7ff1dc183830 2023-11-06T13:28:22.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1db7fe700 1 -- 172.21.15.38:0/155468241 >> v1:172.21.15.44:6789/0 conn(0x7ff1dc183830 legacy=0x7ff1dc185c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1db7fe700 1 -- 172.21.15.38:0/155468241 >> v1:172.21.15.38:6789/0 conn(0x7ff1dc175a40 legacy=0x7ff1dc17f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.959+0000 7ff1db7fe700 1 -- 172.21.15.38:0/155468241 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc17fda0 con 0x7ff1dc17e260 2023-11-06T13:28:22.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1db7fe700 1 --2- 172.21.15.38:0/155468241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc17e6e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff1d0009760 tx=0x7ff1d0009060).ready entity=mon.1 client_cookie=db11dc7776fe523e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000d4a0 con 0x7ff1dc17e260 2023-11-06T13:28:22.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000d600 con 0x7ff1dc17e260 2023-11-06T13:28:22.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1daffd700 1 -- 172.21.15.38:0/155468241 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000d980 con 0x7ff1dc17e260 2023-11-06T13:28:22.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 -- 172.21.15.38:0/155468241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 msgr2=0x7ff1dc17e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 --2- 172.21.15.38:0/155468241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc17e6e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7ff1d0009760 tx=0x7ff1d0009060).stop 2023-11-06T13:28:22.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 -- 172.21.15.38:0/155468241 shutdown_connections 2023-11-06T13:28:22.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 --2- 172.21.15.38:0/155468241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc17e6e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 -- 172.21.15.38:0/155468241 >> 172.21.15.38:0/155468241 conn(0x7ff1dc06a970 msgr2=0x7ff1dc0f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:22.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 -- 172.21.15.38:0/155468241 shutdown_connections 2023-11-06T13:28:22.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.960+0000 7ff1e2518700 1 -- 172.21.15.38:0/155468241 wait complete. 2023-11-06T13:28:22.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.962+0000 7ff1e2518700 1 Processor -- start 2023-11-06T13:28:22.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.962+0000 7ff1e2518700 1 -- start start 2023-11-06T13:28:22.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e2518700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 0x7ff1dc18f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e2518700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc18fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e2518700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1dc183830 0x7ff1dc156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e2518700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc16df10 con 0x7ff1dc175a40 2023-11-06T13:28:22.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e2518700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc16d340 con 0x7ff1dc17e260 2023-11-06T13:28:22.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e2518700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc16d5e0 con 0x7ff1dc183830 2023-11-06T13:28:22.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 0x7ff1dc18f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 0x7ff1dc18f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48502/0 (socket says 172.21.15.38:48502) 2023-11-06T13:28:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 -- 172.21.15.38:0/3011759349 learned_addr learned my addr 172.21.15.38:0/3011759349 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1db7fe700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc18fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e0ab5700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1dc183830 0x7ff1dc156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 -- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1dc183830 msgr2=0x7ff1dc156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1dc183830 0x7ff1dc156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 -- 172.21.15.38:0/3011759349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 msgr2=0x7ff1dc18fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc18fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 -- 172.21.15.38:0/3011759349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00092a0 con 0x7ff1dc175a40 2023-11-06T13:28:22.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1db7fe700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc18fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1e0ab5700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1dc183830 0x7ff1dc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.963+0000 7ff1dbfff700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 0x7ff1dc18f6f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7ff1cc00c470 tx=0x7ff1cc007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.964+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0072e0 con 0x7ff1dc175a40 2023-11-06T13:28:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.964+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc007440 con 0x7ff1dc175a40 2023-11-06T13:28:22.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.964+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0057a0 con 0x7ff1dc175a40 2023-11-06T13:28:22.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.964+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc16d8c0 con 0x7ff1dc175a40 2023-11-06T13:28:22.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.964+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc190560 con 0x7ff1dc175a40 2023-11-06T13:28:22.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.965+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc06c580 con 0x7ff1dc175a40 2023-11-06T13:28:22.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.965+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff1cc005b90 con 0x7ff1dc175a40 2023-11-06T13:28:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.966+0000 7ff1c3fff700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1c808cbd0 0x7ff1c808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.966+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7ff1cc0b1850 con 0x7ff1dc175a40 2023-11-06T13:28:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.966+0000 7ff1db7fe700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1c808cbd0 0x7ff1c808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:22.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.967+0000 7ff1db7fe700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1c808cbd0 0x7ff1c808f090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff1d0006d60 tx=0x7ff1d0016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:22.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:22.970+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7ff1cc081d90 con 0x7ff1dc175a40 2023-11-06T13:28:23.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.143+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1dc17cee0 con 0x7ff1dc175a40 2023-11-06T13:28:23.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.144+0000 7ff1c3fff700 1 -- 172.21.15.38:0/3011759349 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1dc17cee0 con 0x7ff1dc175a40 2023-11-06T13:28:23.147 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:28:23.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1c808cbd0 msgr2=0x7ff1c808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1c808cbd0 0x7ff1c808f090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff1d0006d60 tx=0x7ff1d0016000).stop 2023-11-06T13:28:23.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 msgr2=0x7ff1dc18f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 0x7ff1dc18f6f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7ff1cc00c470 tx=0x7ff1cc007d20).stop 2023-11-06T13:28:23.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 shutdown_connections 2023-11-06T13:28:23.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1dc183830 0x7ff1dc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff1dc175a40 0x7ff1dc18f6f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff1c808cbd0 0x7ff1c808f090 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 --2- 172.21.15.38:0/3011759349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1dc17e260 0x7ff1dc18fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.145+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 >> 172.21.15.38:0/3011759349 conn(0x7ff1dc06a970 msgr2=0x7ff1dc0c6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:23.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.146+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 shutdown_connections 2023-11-06T13:28:23.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.146+0000 7ff1e2518700 1 -- 172.21.15.38:0/3011759349 wait complete. 2023-11-06T13:28:23.161 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-06T13:28:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.279+0000 7f2bb941b700 1 Processor -- start 2023-11-06T13:28:23.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.279+0000 7f2bb941b700 1 -- start start 2023-11-06T13:28:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb941b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2bb417f450 0x7f2bb40c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb941b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb4064780 con 0x7f2bb4178ca0 2023-11-06T13:28:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb941b700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb4063e70 con 0x7f2bb4064300 2023-11-06T13:28:23.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb941b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb417f8f0 con 0x7f2bb417f450 2023-11-06T13:28:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb2ffd700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f2bb4178ca0 0x7f2bb4180210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50098/0 (socket says 172.21.15.38:50098) 2023-11-06T13:28:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb2ffd700 1 -- 172.21.15.38:0/1962473036 learned_addr learned my addr 172.21.15.38:0/1962473036 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb37fe700 1 --2- 172.21.15.38:0/1962473036 >> v2:172.21.15.163:3300/0 conn(0x7f2bb417f450 0x7f2bb40c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb1ffb700 1 -- 172.21.15.38:0/1962473036 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275937859 0 0) 0x7f2ba4001110 con 0x7f2bb4178ca0 2023-11-06T13:28:23.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb1ffb700 1 -- 172.21.15.38:0/1962473036 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b9c0033f0 con 0x7f2bb4178ca0 2023-11-06T13:28:23.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb37fe700 1 -- 172.21.15.38:0/1962473036 >> v1:172.21.15.163:6789/0 conn(0x7f2bb4064300 legacy=0x7f2bb417ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb37fe700 1 -- 172.21.15.38:0/1962473036 >> v1:172.21.15.38:6789/0 conn(0x7f2bb4178ca0 legacy=0x7f2bb4180210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.280+0000 7f2bb37fe700 1 -- 172.21.15.38:0/1962473036 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb417fbd0 con 0x7f2bb417f450 2023-11-06T13:28:23.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb37fe700 1 --2- 172.21.15.38:0/1962473036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb417f450 0x7f2bb40c71d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2bac009de0 tx=0x7f2bac009780).ready entity=mon.2 client_cookie=9a4641588bc196df server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb1ffb700 1 -- 172.21.15.38:0/1962473036 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00e070 con 0x7f2bb417f450 2023-11-06T13:28:23.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb1ffb700 1 -- 172.21.15.38:0/1962473036 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00bae0 con 0x7f2bb417f450 2023-11-06T13:28:23.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb1ffb700 1 -- 172.21.15.38:0/1962473036 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00be60 con 0x7f2bb417f450 2023-11-06T13:28:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 -- 172.21.15.38:0/1962473036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb417f450 msgr2=0x7f2bb40c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 --2- 172.21.15.38:0/1962473036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb417f450 0x7f2bb40c71d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2bac009de0 tx=0x7f2bac009780).stop 2023-11-06T13:28:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 -- 172.21.15.38:0/1962473036 shutdown_connections 2023-11-06T13:28:23.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 --2- 172.21.15.38:0/1962473036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb417f450 0x7f2bb40c71d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 -- 172.21.15.38:0/1962473036 >> 172.21.15.38:0/1962473036 conn(0x7f2bb40eed10 msgr2=0x7f2bb405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 -- 172.21.15.38:0/1962473036 shutdown_connections 2023-11-06T13:28:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.281+0000 7f2bb941b700 1 -- 172.21.15.38:0/1962473036 wait complete. 2023-11-06T13:28:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.283+0000 7f2bb941b700 1 Processor -- start 2023-11-06T13:28:23.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.283+0000 7f2bb941b700 1 -- start start 2023-11-06T13:28:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb941b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb4064300 0x7f2bb4174be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb941b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bb4178ca0 0x7f2bb4191550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb941b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 0x7f2bb4191a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb941b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb417e580 con 0x7f2bb417f450 2023-11-06T13:28:23.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb941b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb41904b0 con 0x7f2bb4178ca0 2023-11-06T13:28:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb941b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4190790 con 0x7f2bb4064300 2023-11-06T13:28:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 0x7f2bb4191a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 0x7f2bb4191a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48514/0 (socket says 172.21.15.38:48514) 2023-11-06T13:28:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 -- 172.21.15.38:0/760609720 learned_addr learned my addr 172.21.15.38:0/760609720 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:23.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb2ffd700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb4064300 0x7f2bb4174be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb27fc700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bb4178ca0 0x7f2bb4191550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 -- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb4064300 msgr2=0x7f2bb4174be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb4064300 0x7f2bb4174be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 -- 172.21.15.38:0/760609720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bb4178ca0 msgr2=0x7f2bb4191550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bb4178ca0 0x7f2bb4191550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.284+0000 7f2bb37fe700 1 -- 172.21.15.38:0/760609720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009a20 con 0x7f2bb417f450 2023-11-06T13:28:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.285+0000 7f2bb37fe700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 0x7f2bb4191a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f2bac00b6c0 tx=0x7f2bb4063de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.285+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac013e10 con 0x7f2bb417f450 2023-11-06T13:28:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.285+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac01c620 con 0x7f2bb417f450 2023-11-06T13:28:23.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.285+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb4190a70 con 0x7f2bb417f450 2023-11-06T13:28:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.285+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac01c9e0 con 0x7f2bb417f450 2023-11-06T13:28:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.285+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb4191030 con 0x7f2bb417f450 2023-11-06T13:28:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.286+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb406c580 con 0x7f2bb417f450 2023-11-06T13:28:23.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.287+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f2bac019030 con 0x7f2bb417f450 2023-11-06T13:28:23.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.287+0000 7f2b9affd700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2ba008cba0 0x7f2ba008f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.287+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f2bac0b38a0 con 0x7f2bb417f450 2023-11-06T13:28:23.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.288+0000 7f2bb2ffd700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2ba008cba0 0x7f2ba008f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.288+0000 7f2bb2ffd700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2ba008cba0 0x7f2ba008f060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f2ba4001270 tx=0x7f2ba4007a70).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.291+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2bac083d60 con 0x7f2bb417f450 2023-11-06T13:28:23.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.464+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bb4176f20 con 0x7f2bb417f450 2023-11-06T13:28:23.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.465+0000 7f2b9affd700 1 -- 172.21.15.38:0/760609720 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bac017020 con 0x7f2bb417f450 2023-11-06T13:28:23.468 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2ba008cba0 msgr2=0x7f2ba008f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2ba008cba0 0x7f2ba008f060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f2ba4001270 tx=0x7f2ba4007a70).stop 2023-11-06T13:28:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 msgr2=0x7f2bb4191a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 0x7f2bb4191a40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f2bac00b6c0 tx=0x7f2bb4063de0).stop 2023-11-06T13:28:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 shutdown_connections 2023-11-06T13:28:23.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2bb417f450 0x7f2bb4191a40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb4064300 0x7f2bb4174be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2ba008cba0 0x7f2ba008f060 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 --2- 172.21.15.38:0/760609720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2bb4178ca0 0x7f2bb4191550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 >> 172.21.15.38:0/760609720 conn(0x7f2bb40eed10 msgr2=0x7f2bb4180040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:23.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 shutdown_connections 2023-11-06T13:28:23.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.467+0000 7f2bb941b700 1 -- 172.21.15.38:0/760609720 wait complete. 2023-11-06T13:28:23.482 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-06T13:28:23.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.600+0000 7f69952bd700 1 Processor -- start 2023-11-06T13:28:23.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.600+0000 7f69952bd700 1 -- start start 2023-11-06T13:28:23.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f69952bd700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6990175590 0x7f699017d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f69952bd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f6990175970 0x7f699017ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f69952bd700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699017d550 con 0x7f699017e3c0 2023-11-06T13:28:23.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f69952bd700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699017fad0 con 0x7f6990175590 2023-11-06T13:28:23.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f69952bd700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6990085ad0 con 0x7f6990175970 2023-11-06T13:28:23.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f6994abc700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f699017e3c0 0x7f69901823f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50102/0 (socket says 172.21.15.38:50102) 2023-11-06T13:28:23.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.601+0000 7f6994abc700 1 -- 172.21.15.38:0/1371488554 learned_addr learned my addr 172.21.15.38:0/1371488554 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:23.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698f7fe700 1 --2- 172.21.15.38:0/1371488554 >> v2:172.21.15.163:3300/0 conn(0x7f6990175970 0x7f699017ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312661344 0 0) 0x7f699017d550 con 0x7f699017e3c0 2023-11-06T13:28:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 --2- 172.21.15.38:0/1371488554 >> v2:172.21.15.44:3300/0 conn(0x7f6990175590 0x7f699017d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69780033f0 con 0x7f699017e3c0 2023-11-06T13:28:23.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104961981 0 0) 0x7f69780033f0 con 0x7f699017e3c0 2023-11-06T13:28:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 >> v2:172.21.15.163:3300/0 conn(0x7f6990175970 msgr2=0x7f699017ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 --2- 172.21.15.38:0/1371488554 >> v2:172.21.15.163:3300/0 conn(0x7f6990175970 0x7f699017ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 >> v2:172.21.15.44:3300/0 conn(0x7f6990175590 msgr2=0x7f699017d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:23.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 --2- 172.21.15.38:0/1371488554 >> v2:172.21.15.44:3300/0 conn(0x7f6990175590 0x7f699017d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699017c940 con 0x7f699017e3c0 2023-11-06T13:28:23.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f69880017f0 con 0x7f699017e3c0 2023-11-06T13:28:23.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 >> v1:172.21.15.38:6789/0 conn(0x7f699017e3c0 legacy=0x7f69901823f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6978003930 0x7f6978003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6978004690 0x7f6978004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978005000 0x7f697800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699017fad0 con 0x7f6978003930 2023-11-06T13:28:23.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990085ad0 con 0x7f6978004690 2023-11-06T13:28:23.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697800be80 con 0x7f6978005000 2023-11-06T13:28:23.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6978003930 0x7f6978003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698f7fe700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6978004690 0x7f6978004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f6994abc700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978005000 0x7f697800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 -- 172.21.15.38:0/1371488554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978005000 msgr2=0x7f697800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:23.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978005000 0x7f697800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 -- 172.21.15.38:0/1371488554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6978004690 msgr2=0x7f6978004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:23.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6978004690 0x7f6978004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f698ffff700 1 -- 172.21.15.38:0/1371488554 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780033f0 con 0x7f6978003930 2023-11-06T13:28:23.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f6994abc700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978005000 0x7f697800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:23.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.602+0000 7f6994abc700 1 -- 172.21.15.38:0/1371488554 reap_dead start 2023-11-06T13:28:23.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f698ffff700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6978003930 0x7f6978003d50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f6980009a80 tx=0x7f6980009060).ready entity=mon.0 client_cookie=a136143c45ff3fe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980009430 con 0x7f6978003930 2023-11-06T13:28:23.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698000e640 con 0x7f6978003930 2023-11-06T13:28:23.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f698effd700 1 -- 172.21.15.38:0/1371488554 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000e9c0 con 0x7f6978003930 2023-11-06T13:28:23.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 -- 172.21.15.38:0/1371488554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6978003930 msgr2=0x7f6978003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6978003930 0x7f6978003d50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f6980009a80 tx=0x7f6980009060).stop 2023-11-06T13:28:23.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 -- 172.21.15.38:0/1371488554 shutdown_connections 2023-11-06T13:28:23.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 --2- 172.21.15.38:0/1371488554 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6978003930 0x7f6978003d50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 -- 172.21.15.38:0/1371488554 >> 172.21.15.38:0/1371488554 conn(0x7f69900f5d10 msgr2=0x7f69900f1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:23.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 -- 172.21.15.38:0/1371488554 shutdown_connections 2023-11-06T13:28:23.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.603+0000 7f69952bd700 1 -- 172.21.15.38:0/1371488554 wait complete. 2023-11-06T13:28:23.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.605+0000 7f69952bd700 1 Processor -- start 2023-11-06T13:28:23.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.605+0000 7f69952bd700 1 -- start start 2023-11-06T13:28:23.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f69952bd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978003930 0x7f699018ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f69952bd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 0x7f6990170260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f69952bd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6990064260 0x7f6990170750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f69952bd700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990063950 con 0x7f6990063de0 2023-11-06T13:28:23.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f69952bd700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990084f10 con 0x7f6990064260 2023-11-06T13:28:23.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f69952bd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990084c30 con 0x7f6978003930 2023-11-06T13:28:23.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 0x7f6990170260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 0x7f6990170260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48530/0 (socket says 172.21.15.38:48530) 2023-11-06T13:28:23.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 -- 172.21.15.38:0/822964773 learned_addr learned my addr 172.21.15.38:0/822964773 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:23.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698ffff700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978003930 0x7f699018ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 -- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978003930 msgr2=0x7f699018ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978003930 0x7f699018ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f6994abc700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6990064260 0x7f6990170750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 -- 172.21.15.38:0/822964773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6990064260 msgr2=0x7f6990170750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6990064260 0x7f6990170750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 -- 172.21.15.38:0/822964773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990063020 con 0x7f6990063de0 2023-11-06T13:28:23.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698ffff700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978003930 0x7f699018ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:23.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.606+0000 7f698f7fe700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 0x7f6990170260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f6984011a20 tx=0x7f6984009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.607+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984009560 con 0x7f6990063de0 2023-11-06T13:28:23.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.607+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698400f940 con 0x7f6990063de0 2023-11-06T13:28:23.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.607+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990063300 con 0x7f6990063de0 2023-11-06T13:28:23.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.607+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698400fcc0 con 0x7f6990063de0 2023-11-06T13:28:23.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.607+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699018f010 con 0x7f6990063de0 2023-11-06T13:28:23.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.608+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69900637a0 con 0x7f6990063de0 2023-11-06T13:28:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.608+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f6984014650 con 0x7f6990063de0 2023-11-06T13:28:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.609+0000 7f6977fff700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f697c08cbd0 0x7f697c08f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.609+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f69840b2c80 con 0x7f6990063de0 2023-11-06T13:28:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.609+0000 7f698ffff700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f697c08cbd0 0x7f697c08f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.610+0000 7f698ffff700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f697c08cbd0 0x7f697c08f090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f6980006d50 tx=0x7f698001a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.613+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f69840831c0 con 0x7f6990063de0 2023-11-06T13:28:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.785+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f699017cc20 con 0x7f6990063de0 2023-11-06T13:28:23.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.786+0000 7f6977fff700 1 -- 172.21.15.38:0/822964773 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69840867e0 con 0x7f6990063de0 2023-11-06T13:28:23.789 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:28:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f697c08cbd0 msgr2=0x7f697c08f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f697c08cbd0 0x7f697c08f090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f6980006d50 tx=0x7f698001a000).stop 2023-11-06T13:28:23.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 msgr2=0x7f6990170260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 0x7f6990170260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f6984011a20 tx=0x7f6984009060).stop 2023-11-06T13:28:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 shutdown_connections 2023-11-06T13:28:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f697c08cbd0 0x7f697c08f090 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0x7f6980006d50 tx=0x7f698001a000).stop 2023-11-06T13:28:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6990064260 0x7f6990170750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6978003930 0x7f699018ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 --2- 172.21.15.38:0/822964773 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f6990063de0 0x7f6990170260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 >> 172.21.15.38:0/822964773 conn(0x7f69900f5d10 msgr2=0x7f69901721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 shutdown_connections 2023-11-06T13:28:23.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.788+0000 7f69952bd700 1 -- 172.21.15.38:0/822964773 wait complete. 2023-11-06T13:28:23.803 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-06T13:28:23.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.921+0000 7f0e8cd0a700 1 Processor -- start 2023-11-06T13:28:23.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.921+0000 7f0e8cd0a700 1 -- start start 2023-11-06T13:28:23.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.922+0000 7f0e8cd0a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0e881756e0 0x7f0e880c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8cd0a700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e881814b0 con 0x7f0e88182540 2023-11-06T13:28:23.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8cd0a700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e881805c0 con 0x7f0e88180140 2023-11-06T13:28:23.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8cd0a700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880c8c40 con 0x7f0e881756e0 2023-11-06T13:28:23.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e86d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f0e88182540 0x7f0e88182990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50106/0 (socket says 172.21.15.38:50106) 2023-11-06T13:28:23.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e86d9d700 1 -- 172.21.15.38:0/1622205296 learned_addr learned my addr 172.21.15.38:0/1622205296 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:23.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8659c700 1 --2- 172.21.15.38:0/1622205296 >> v2:172.21.15.44:3300/0 conn(0x7f0e881756e0 0x7f0e880c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663640749 0 0) 0x7f0e881814b0 con 0x7f0e88182540 2023-11-06T13:28:23.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e740033f0 con 0x7f0e88182540 2023-11-06T13:28:23.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453858987 0 0) 0x7f0e881805c0 con 0x7f0e88180140 2023-11-06T13:28:23.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e881814b0 con 0x7f0e88180140 2023-11-06T13:28:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8659c700 1 -- 172.21.15.38:0/1622205296 >> v1:172.21.15.44:6789/0 conn(0x7f0e88180140 legacy=0x7f0e88181940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8659c700 1 -- 172.21.15.38:0/1622205296 >> v1:172.21.15.38:6789/0 conn(0x7f0e88182540 legacy=0x7f0e88182990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3585732433 0 0) 0x7f0e740033f0 con 0x7f0e88182540 2023-11-06T13:28:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8659c700 1 -- 172.21.15.38:0/1622205296 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e881808a0 con 0x7f0e881756e0 2023-11-06T13:28:23.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.923+0000 7f0e8659c700 1 --2- 172.21.15.38:0/1622205296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881756e0 0x7f0e880c8750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0e80009e60 tx=0x7f0e80009780).ready entity=mon.1 client_cookie=3e3b39f24bc69abb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000e070 con 0x7f0e881756e0 2023-11-06T13:28:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000b7a0 con 0x7f0e881756e0 2023-11-06T13:28:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8559a700 1 -- 172.21.15.38:0/1622205296 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78001470 con 0x7f0e881756e0 2023-11-06T13:28:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/1622205296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881756e0 msgr2=0x7f0e880c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/1622205296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881756e0 0x7f0e880c8750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0e80009e60 tx=0x7f0e80009780).stop 2023-11-06T13:28:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/1622205296 shutdown_connections 2023-11-06T13:28:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/1622205296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881756e0 0x7f0e880c8750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/1622205296 >> 172.21.15.38:0/1622205296 conn(0x7f0e8805eeb0 msgr2=0x7f0e88069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/1622205296 shutdown_connections 2023-11-06T13:28:23.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.924+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/1622205296 wait complete. 2023-11-06T13:28:23.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.926+0000 7f0e8cd0a700 1 Processor -- start 2023-11-06T13:28:23.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.926+0000 7f0e8cd0a700 1 -- start start 2023-11-06T13:28:23.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e88180140 0x7f0e880f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 0x7f0e88191ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881924e0 0x7f0e8816c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88191b60 con 0x7f0e88182540 2023-11-06T13:28:23.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880f5080 con 0x7f0e881924e0 2023-11-06T13:28:23.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88192940 con 0x7f0e88180140 2023-11-06T13:28:23.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 0x7f0e88191ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 0x7f0e88191ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48532/0 (socket says 172.21.15.38:48532) 2023-11-06T13:28:23.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 -- 172.21.15.38:0/3731548919 learned_addr learned my addr 172.21.15.38:0/3731548919 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:23.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8659c700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e88180140 0x7f0e880f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e86d9d700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881924e0 0x7f0e8816c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 -- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e88180140 msgr2=0x7f0e880f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e88180140 0x7f0e880f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 -- 172.21.15.38:0/3731548919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881924e0 msgr2=0x7f0e8816c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:23.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881924e0 0x7f0e8816c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 -- 172.21.15.38:0/3731548919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009a20 con 0x7f0e88182540 2023-11-06T13:28:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e85d9b700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 0x7f0e88191ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f0e7000c440 tx=0x7f0e70007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000f470 con 0x7f0e88182540 2023-11-06T13:28:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7000f5d0 con 0x7f0e88182540 2023-11-06T13:28:23.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.927+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88190c70 con 0x7f0e88182540 2023-11-06T13:28:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.928+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000f990 con 0x7f0e88182540 2023-11-06T13:28:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.928+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e88191230 con 0x7f0e88182540 2023-11-06T13:28:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.928+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e88190a00 con 0x7f0e88182540 2023-11-06T13:28:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.929+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f0e7000fd40 con 0x7f0e88182540 2023-11-06T13:28:23.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.930+0000 7f0e7e7fc700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e6808cba0 0x7f0e6808f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.930+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0e700b1650 con 0x7f0e88182540 2023-11-06T13:28:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.930+0000 7f0e8659c700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e6808cba0 0x7f0e6808f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:23.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.930+0000 7f0e8659c700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e6808cba0 0x7f0e6808f060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0e80009870 tx=0x7f0e80009780).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:23.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:23.934+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0e70081b90 con 0x7f0e88182540 2023-11-06T13:28:24.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.103+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0e8806c580 con 0x7f0e88182540 2023-11-06T13:28:24.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.103+0000 7f0e7e7fc700 1 -- 172.21.15.38:0/3731548919 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0e70017030 con 0x7f0e88182540 2023-11-06T13:28:24.167 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-11-06T13:28:24.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e6808cba0 msgr2=0x7f0e6808f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e6808cba0 0x7f0e6808f060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f0e80009870 tx=0x7f0e80009780).stop 2023-11-06T13:28:24.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 msgr2=0x7f0e88191ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 0x7f0e88191ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f0e7000c440 tx=0x7f0e70007c90).stop 2023-11-06T13:28:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 shutdown_connections 2023-11-06T13:28:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0e6808cba0 0x7f0e6808f060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0e881924e0 0x7f0e8816c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e88180140 0x7f0e880f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 --2- 172.21.15.38:0/3731548919 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0e88182540 0x7f0e88191ff0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 >> 172.21.15.38:0/3731548919 conn(0x7f0e881756e0 msgr2=0x7f0e88170050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 shutdown_connections 2023-11-06T13:28:24.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.105+0000 7f0e8cd0a700 1 -- 172.21.15.38:0/3731548919 wait complete. 2023-11-06T13:28:24.172 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-06T13:28:24.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.287+0000 7f09ef59e700 1 Processor -- start 2023-11-06T13:28:24.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.287+0000 7f09ef59e700 1 -- start start 2023-11-06T13:28:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.288+0000 7f09ef59e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f09f01752a0 0x7f09f0182a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.288+0000 7f09ef59e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00871b0 con 0x7f09f0175680 2023-11-06T13:28:24.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.288+0000 7f09ef59e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00882f0 con 0x7f09f0180640 2023-11-06T13:28:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.288+0000 7f09ef59e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f0182ef0 con 0x7f09f01752a0 2023-11-06T13:28:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f09f01752a0 0x7f09f0182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f09f01752a0 0x7f09f0182a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:58902/0 (socket says 172.21.15.38:58902) 2023-11-06T13:28:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 -- 172.21.15.38:0/966606536 learned_addr learned my addr 172.21.15.38:0/966606536 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:24.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09edd9b700 1 --1- 172.21.15.38:0/966606536 >> v1:172.21.15.44:6789/0 conn(0x7f09f0175680 0x7f09f017ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:38454/0 (socket says 172.21.15.38:38454) 2023-11-06T13:28:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09eed9d700 1 --1- 172.21.15.38:0/966606536 >> v1:172.21.15.163:6789/0 conn(0x7f09f0180640 0x7f09f0085d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:51830/0 (socket says 172.21.15.38:51830) 2023-11-06T13:28:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 -- 172.21.15.38:0/966606536 >> v1:172.21.15.163:6789/0 conn(0x7f09f0180640 legacy=0x7f09f0085d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 -- 172.21.15.38:0/966606536 >> v1:172.21.15.44:6789/0 conn(0x7f09f0175680 legacy=0x7f09f017ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 -- 172.21.15.38:0/966606536 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0087400 con 0x7f09f01752a0 2023-11-06T13:28:24.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ee59c700 1 --2- 172.21.15.38:0/966606536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f01752a0 0x7f09f0182a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f09e0006fd0 tx=0x7f09e00090f0).ready entity=mon.2 client_cookie=d810056aa76ac00c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ed59a700 1 -- 172.21.15.38:0/966606536 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000b600 con 0x7f09f01752a0 2023-11-06T13:28:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ed59a700 1 -- 172.21.15.38:0/966606536 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000b760 con 0x7f09f01752a0 2023-11-06T13:28:24.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.289+0000 7f09ed59a700 1 -- 172.21.15.38:0/966606536 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000bb00 con 0x7f09f01752a0 2023-11-06T13:28:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 -- 172.21.15.38:0/966606536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f01752a0 msgr2=0x7f09f0182a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 --2- 172.21.15.38:0/966606536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f01752a0 0x7f09f0182a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f09e0006fd0 tx=0x7f09e00090f0).stop 2023-11-06T13:28:24.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 -- 172.21.15.38:0/966606536 shutdown_connections 2023-11-06T13:28:24.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 --2- 172.21.15.38:0/966606536 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f01752a0 0x7f09f0182a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 -- 172.21.15.38:0/966606536 >> 172.21.15.38:0/966606536 conn(0x7f09f00f51f0 msgr2=0x7f09f00f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:24.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 -- 172.21.15.38:0/966606536 shutdown_connections 2023-11-06T13:28:24.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.290+0000 7f09ef59e700 1 -- 172.21.15.38:0/966606536 wait complete. 2023-11-06T13:28:24.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.291+0000 7f09ef59e700 1 Processor -- start 2023-11-06T13:28:24.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.291+0000 7f09ef59e700 1 -- start start 2023-11-06T13:28:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 0x7f09f0173810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09f0175680 0x7f09f0192970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ef59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f0180640 0x7f09f0192e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ef59e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0176470 con 0x7f09f01752a0 2023-11-06T13:28:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ef59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0175b80 con 0x7f09f0175680 2023-11-06T13:28:24.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ef59e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00c8970 con 0x7f09f0180640 2023-11-06T13:28:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ee59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 0x7f09f0173810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ee59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 0x7f09f0173810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48548/0 (socket says 172.21.15.38:48548) 2023-11-06T13:28:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09ee59c700 1 -- 172.21.15.38:0/2822866539 learned_addr learned my addr 172.21.15.38:0/2822866539 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:24.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09edd9b700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09f0175680 0x7f09f0192970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.292+0000 7f09eed9d700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f0180640 0x7f09f0192e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ee59c700 1 -- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f0180640 msgr2=0x7f09f0192e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ee59c700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f0180640 0x7f09f0192e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ee59c700 1 -- 172.21.15.38:0/2822866539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09f0175680 msgr2=0x7f09f0192970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ee59c700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09f0175680 0x7f09f0192970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ee59c700 1 -- 172.21.15.38:0/2822866539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0009370 con 0x7f09f01752a0 2023-11-06T13:28:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ee59c700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 0x7f09f0173810 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f09e0009f50 tx=0x7f09e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000bec0 con 0x7f09f01752a0 2023-11-06T13:28:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e0006910 con 0x7f09f01752a0 2023-11-06T13:28:24.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f0175e20 con 0x7f09f01752a0 2023-11-06T13:28:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000b8d0 con 0x7f09f01752a0 2023-11-06T13:28:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.293+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f0173d00 con 0x7f09f01752a0 2023-11-06T13:28:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.294+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0176750 con 0x7f09f01752a0 2023-11-06T13:28:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.295+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f09e0021020 con 0x7f09f01752a0 2023-11-06T13:28:24.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.295+0000 7f09e67fc700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f09d008cbd0 0x7f09d008f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.295+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f09e00b34f0 con 0x7f09f01752a0 2023-11-06T13:28:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.295+0000 7f09edd9b700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f09d008cbd0 0x7f09d008f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.296+0000 7f09edd9b700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f09d008cbd0 0x7f09d008f090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f09f00c70b0 tx=0x7f09d8000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:24.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.299+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f09e0083a30 con 0x7f09f01752a0 2023-11-06T13:28:24.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.512+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f00475a0 con 0x7f09f01752a0 2023-11-06T13:28:24.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.513+0000 7f09e67fc700 1 -- 172.21.15.38:0/2822866539 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10635 (secure 0 0 0) 0x7f09e0029030 con 0x7f09f01752a0 2023-11-06T13:28:24.516 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:24.516 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6833/3482103193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6832","nonce":3482103193},{"type":"v1","addr":"172.21.15.38:6833","nonce":3482103193}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.38:6835/291890475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6834","nonce":291890475},{"type":"v1","addr":"172.21.15.38:6835","nonce":291890475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-11-06T13:27:41.889379+0000","modified":"2023-11-06T13:27:58.254004+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4361,"mds_1":4355,"mds_2":4352,"mds_3":4349,"mds_4":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6837/1353911715","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6836","nonce":1353911715},{"type":"v1","addr":"172.21.15.38:6837","nonce":1353911715}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"b","rank":4,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6833/2545049944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2545049944},{"type":"v1","addr":"172.21.15.44:6833","nonce":2545049944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4315":{"gid":4315,"name":"e","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6835/2658188248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2658188248},{"type":"v1","addr":"172.21.15.44:6835","nonce":2658188248}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4321":{"gid":4321,"name":"h","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6837/2388946102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":2388946102},{"type":"v1","addr":"172.21.15.44:6837","nonce":2388946102}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4323":{"gid":4323,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.38:6839/749779916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6838","nonce":749779916},{"type":"v1","addr":"172.21.15.38:6839","nonce":749779916}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4326":{"gid":4326,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/2634383348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":2634383348},{"type":"v1","addr":"172.21.15.44:6839","nonce":2634383348}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4349":{"gid":4349,"name":"f","rank":3,"incarnation":13,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6836/657311284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":657311284},{"type":"v1","addr":"172.21.15.163:6836","nonce":657311284}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4352":{"gid":4352,"name":"c","rank":2,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6837/2986446701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6835","nonce":2986446701},{"type":"v1","addr":"172.21.15.163:6837","nonce":2986446701}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4355":{"gid":4355,"name":"i","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.163:6839/3927893034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":3927893034},{"type":"v1","addr":"172.21.15.163:6839","nonce":3927893034}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4361":{"gid":4361,"name":"l","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.163:6841/2794564975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":2794564975},{"type":"v1","addr":"172.21.15.163:6841","nonce":2794564975}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-11-06T13:28:24.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f09d008cbd0 msgr2=0x7f09d008f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f09d008cbd0 0x7f09d008f090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f09f00c70b0 tx=0x7f09d8000bc0).stop 2023-11-06T13:28:24.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 msgr2=0x7f09f0173810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 0x7f09f0173810 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f09e0009f50 tx=0x7f09e0017000).stop 2023-11-06T13:28:24.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 shutdown_connections 2023-11-06T13:28:24.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f09f0180640 0x7f09f0192e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f09f01752a0 0x7f09f0173810 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f09d008cbd0 0x7f09d008f090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 --2- 172.21.15.38:0/2822866539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09f0175680 0x7f09f0192970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.514+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 >> 172.21.15.38:0/2822866539 conn(0x7f09f00f51f0 msgr2=0x7f09f017ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.515+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 shutdown_connections 2023-11-06T13:28:24.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.515+0000 7f09ef59e700 1 -- 172.21.15.38:0/2822866539 wait complete. 2023-11-06T13:28:24.521 INFO:teuthology.orchestra.run.smithi038.stderr:dumped fsmap epoch 17 2023-11-06T13:28:24.530 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:28:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.645+0000 7f0f6d40c700 1 Processor -- start 2023-11-06T13:28:24.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.645+0000 7f0f6d40c700 1 -- start start 2023-11-06T13:28:24.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f6d40c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f680cb4b0 0x7f0f681758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f6d40c700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6817e680 con 0x7f0f6817c950 2023-11-06T13:28:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f6d40c700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6817d4f0 con 0x7f0f68175510 2023-11-06T13:28:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f6d40c700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6817d790 con 0x7f0f680cb4b0 2023-11-06T13:28:24.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f667fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f680cb4b0 0x7f0f681758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f667fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f0f680cb4b0 0x7f0f681758f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48560/0 (socket says 172.21.15.38:48560) 2023-11-06T13:28:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f667fc700 1 -- 172.21.15.38:0/1945451071 learned_addr learned my addr 172.21.15.38:0/1945451071 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f667fc700 1 -- 172.21.15.38:0/1945451071 >> v1:172.21.15.163:6789/0 conn(0x7f0f68175510 legacy=0x7f0f680cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f667fc700 1 -- 172.21.15.38:0/1945451071 >> v1:172.21.15.44:6789/0 conn(0x7f0f6817c950 legacy=0x7f0f6817cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:24.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.646+0000 7f0f667fc700 1 -- 172.21.15.38:0/1945451071 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6817da70 con 0x7f0f680cb4b0 2023-11-06T13:28:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f667fc700 1 --2- 172.21.15.38:0/1945451071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f681758f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f0f5c009830 tx=0x7f0f5c0090f0).ready entity=mon.0 client_cookie=12abe9fc5e6e2d4b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f65ffb700 1 -- 172.21.15.38:0/1945451071 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00b600 con 0x7f0f680cb4b0 2023-11-06T13:28:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f65ffb700 1 -- 172.21.15.38:0/1945451071 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00b760 con 0x7f0f680cb4b0 2023-11-06T13:28:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f65ffb700 1 -- 172.21.15.38:0/1945451071 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00bae0 con 0x7f0f680cb4b0 2023-11-06T13:28:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1945451071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 msgr2=0x7f0f681758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1945451071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f681758f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f0f5c009830 tx=0x7f0f5c0090f0).stop 2023-11-06T13:28:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1945451071 shutdown_connections 2023-11-06T13:28:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1945451071 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f681758f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1945451071 >> 172.21.15.38:0/1945451071 conn(0x7f0f680f28b0 msgr2=0x7f0f68069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1945451071 shutdown_connections 2023-11-06T13:28:24.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.647+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1945451071 wait complete. 2023-11-06T13:28:24.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.649+0000 7f0f6d40c700 1 Processor -- start 2023-11-06T13:28:24.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.649+0000 7f0f6d40c700 1 -- start start 2023-11-06T13:28:24.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f6d40c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f68062cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f6d40c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f68175510 0x7f0f680cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f6d40c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f6817c950 0x7f0f680f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f6d40c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6817a380 con 0x7f0f680cb4b0 2023-11-06T13:28:24.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f6d40c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68181110 con 0x7f0f6817c950 2023-11-06T13:28:24.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f6d40c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68154360 con 0x7f0f68175510 2023-11-06T13:28:24.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f68062cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f68062cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48570/0 (socket says 172.21.15.38:48570) 2023-11-06T13:28:24.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 -- 172.21.15.38:0/1587318883 learned_addr learned my addr 172.21.15.38:0/1587318883 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:24.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f667fc700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f68175510 0x7f0f680cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f677fe700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f6817c950 0x7f0f680f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 -- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f68175510 msgr2=0x7f0f680cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f68175510 0x7f0f680cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 -- 172.21.15.38:0/1587318883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f6817c950 msgr2=0x7f0f680f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f6817c950 0x7f0f680f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 -- 172.21.15.38:0/1587318883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c009370 con 0x7f0f680cb4b0 2023-11-06T13:28:24.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f667fc700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f68175510 0x7f0f680cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:24.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f677fe700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f6817c950 0x7f0f680f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:24.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.650+0000 7f0f66ffd700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f68062cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0f5800c470 tx=0x7f0f58007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:24.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.651+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800f470 con 0x7f0f680cb4b0 2023-11-06T13:28:24.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.651+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800f5d0 con 0x7f0f680cb4b0 2023-11-06T13:28:24.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.651+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6817a0a0 con 0x7f0f680cb4b0 2023-11-06T13:28:24.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.651+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800f970 con 0x7f0f680cb4b0 2023-11-06T13:28:24.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.651+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f68180ac0 con 0x7f0f680cb4b0 2023-11-06T13:28:24.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.652+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6806c580 con 0x7f0f680cb4b0 2023-11-06T13:28:24.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.653+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f0f5801b3b0 con 0x7f0f680cb4b0 2023-11-06T13:28:24.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.653+0000 7f0f4effd700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0f5408cbd0 0x7f0f5408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:24.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.653+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f0f580b1750 con 0x7f0f680cb4b0 2023-11-06T13:28:24.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.653+0000 7f0f667fc700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0f5408cbd0 0x7f0f5408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:24.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.654+0000 7f0f667fc700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0f5408cbd0 0x7f0f5408f090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0f5c009fd0 tx=0x7f0f5c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:24.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.657+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f0f58081c90 con 0x7f0f680cb4b0 2023-11-06T13:28:24.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.827+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f6817dd50 con 0x7f0f680cb4b0 2023-11-06T13:28:24.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.829+0000 7f0f4effd700 1 -- 172.21.15.38:0/1587318883 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23509 (secure 0 0 0) 0x7f0f58017030 con 0x7f0f680cb4b0 2023-11-06T13:28:24.832 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:28:24.832 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":31,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:27:46.298951+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:28:24.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0f5408cbd0 msgr2=0x7f0f5408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0f5408cbd0 0x7f0f5408f090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0f5c009fd0 tx=0x7f0f5c017000).stop 2023-11-06T13:28:24.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 msgr2=0x7f0f68062cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:24.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f68062cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0f5800c470 tx=0x7f0f58007dc0).stop 2023-11-06T13:28:24.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 shutdown_connections 2023-11-06T13:28:24.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f0f5408cbd0 0x7f0f5408f090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f6817c950 0x7f0f680f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f0f680cb4b0 0x7f0f68062cd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 --2- 172.21.15.38:0/1587318883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f68175510 0x7f0f680cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:24.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 >> 172.21.15.38:0/1587318883 conn(0x7f0f680f28b0 msgr2=0x7f0f68170380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:24.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 shutdown_connections 2023-11-06T13:28:24.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:24.831+0000 7f0f6d40c700 1 -- 172.21.15.38:0/1587318883 wait complete. 2023-11-06T13:28:24.847 DEBUG:tasks.fwd_scrub:Yielding 2023-11-06T13:28:24.847 INFO:teuthology.run_tasks:Running task check-counter... 2023-11-06T13:28:24.859 INFO:teuthology.run_tasks:Running task workunit... 2023-11-06T13:28:24.880 INFO:tasks.workunit:Pulling workunits from ref 4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:28:24.880 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-06T13:28:24.881 INFO:tasks.workunit:timeout=3h 2023-11-06T13:28:24.881 INFO:tasks.workunit:cleanup=True 2023-11-06T13:28:24.881 DEBUG:teuthology.orchestra.run.smithi038:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-06T13:28:24.882 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-11-06T13:28:24.882 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:28:24.883 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:28:24.898 INFO:teuthology.orchestra.run.smithi038.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-11-06T13:28:24.898 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-11-06T13:28:24.899 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 2eh/46d Inode: 1 Links: 3 2023-11-06T13:28:24.899 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-06T13:28:24.899 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:cephfs_t:s0 2023-11-06T13:28:24.899 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-11-06T13:28:24.900 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2023-11-06 13:27:57.264163162 +0000 2023-11-06T13:28:24.900 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2023-11-06 13:27:57.264163162 +0000 2023-11-06T13:28:24.900 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2023-11-06T13:28:24.900 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-11-06T13:28:24.901 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-11-06T13:28:24.976 DEBUG:teuthology.orchestra.run.smithi038:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4e03306bd00b0abb2be37dbc132f82d281f8973d 2023-11-06T13:28:25.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.003+0000 7f28f8a33700 1 Processor -- start 2023-11-06T13:28:25.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.003+0000 7f28f8a33700 1 -- start start 2023-11-06T13:28:25.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f8a33700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f28f4181a30 0x7f28f40c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f8a33700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40c9a40 con 0x7f28f4175420 2023-11-06T13:28:25.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f8a33700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f40c8b50 con 0x7f28f40ca3c0 2023-11-06T13:28:25.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f8a33700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40c8e30 con 0x7f28f4181a30 2023-11-06T13:28:25.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f2d9d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f28f4175420 0x7f28f40c82d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50118/0 (socket says 172.21.15.38:50118) 2023-11-06T13:28:25.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f2d9d700 1 -- 172.21.15.38:0/3302382103 learned_addr learned my addr 172.21.15.38:0/3302382103 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:25.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.004+0000 7f28f259c700 1 --2- 172.21.15.38:0/3302382103 >> v2:172.21.15.44:3300/0 conn(0x7f28f4181a30 0x7f28f40c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f1d9b700 1 -- 172.21.15.38:0/3302382103 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609287768 0 0) 0x7f28f40c9a40 con 0x7f28f4175420 2023-11-06T13:28:25.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f1d9b700 1 -- 172.21.15.38:0/3302382103 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e00033f0 con 0x7f28f4175420 2023-11-06T13:28:25.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f259c700 1 -- 172.21.15.38:0/3302382103 >> v1:172.21.15.163:6789/0 conn(0x7f28f40ca3c0 legacy=0x7f28f4182010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f1d9b700 1 -- 172.21.15.38:0/3302382103 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921564576 0 0) 0x7f28f40c8b50 con 0x7f28f40ca3c0 2023-11-06T13:28:25.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f259c700 1 -- 172.21.15.38:0/3302382103 >> v1:172.21.15.38:6789/0 conn(0x7f28f4175420 legacy=0x7f28f40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f259c700 1 -- 172.21.15.38:0/3302382103 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f40c9110 con 0x7f28f4181a30 2023-11-06T13:28:25.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f259c700 1 --2- 172.21.15.38:0/3302382103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f40c9ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f28dc009760 tx=0x7f28dc009060).ready entity=mon.1 client_cookie=fddac51054183ecc server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f1d9b700 1 -- 172.21.15.38:0/3302382103 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00f510 con 0x7f28f4181a30 2023-11-06T13:28:25.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f1d9b700 1 -- 172.21.15.38:0/3302382103 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc00f670 con 0x7f28f4181a30 2023-11-06T13:28:25.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.005+0000 7f28f1d9b700 1 -- 172.21.15.38:0/3302382103 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00f9f0 con 0x7f28f4181a30 2023-11-06T13:28:25.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 -- 172.21.15.38:0/3302382103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 msgr2=0x7f28f40c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 --2- 172.21.15.38:0/3302382103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f40c9ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f28dc009760 tx=0x7f28dc009060).stop 2023-11-06T13:28:25.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 -- 172.21.15.38:0/3302382103 shutdown_connections 2023-11-06T13:28:25.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 --2- 172.21.15.38:0/3302382103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f40c9ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 -- 172.21.15.38:0/3302382103 >> 172.21.15.38:0/3302382103 conn(0x7f28f40f2720 msgr2=0x7f28f4069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 -- 172.21.15.38:0/3302382103 shutdown_connections 2023-11-06T13:28:25.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.006+0000 7f28f8a33700 1 -- 172.21.15.38:0/3302382103 wait complete. 2023-11-06T13:28:25.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.007+0000 7f28f8a33700 1 Processor -- start 2023-11-06T13:28:25.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.007+0000 7f28f8a33700 1 -- start start 2023-11-06T13:28:25.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.008+0000 7f28f8a33700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28f40ca3c0 0x7f28f4192af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.008+0000 7f28f8a33700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 0x7f28f416bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.008+0000 7f28f8a33700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f416c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.008+0000 7f28f8a33700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f417d6e0 con 0x7f28f4175420 2023-11-06T13:28:25.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.008+0000 7f28f8a33700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40ee130 con 0x7f28f4181a30 2023-11-06T13:28:25.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.008+0000 7f28f8a33700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40ee410 con 0x7f28f40ca3c0 2023-11-06T13:28:25.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 0x7f28f416bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 0x7f28f416bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48582/0 (socket says 172.21.15.38:48582) 2023-11-06T13:28:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 -- 172.21.15.38:0/1319299227 learned_addr learned my addr 172.21.15.38:0/1319299227 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28f40ca3c0 0x7f28f4192af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f359e700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f416c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 -- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28f40ca3c0 msgr2=0x7f28f4192af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28f40ca3c0 0x7f28f4192af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 -- 172.21.15.38:0/1319299227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 msgr2=0x7f28f416c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f416c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 -- 172.21.15.38:0/1319299227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0092a0 con 0x7f28f4175420 2023-11-06T13:28:25.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f359e700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f416c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:25.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f259c700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 0x7f28f416bf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f28dc009e00 tx=0x7f28dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28eaffd700 1 -- 172.21.15.38:0/1319299227 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00f7e0 con 0x7f28f4175420 2023-11-06T13:28:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28eaffd700 1 -- 172.21.15.38:0/1319299227 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc00f940 con 0x7f28f4175420 2023-11-06T13:28:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28eaffd700 1 -- 172.21.15.38:0/1319299227 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc01c650 con 0x7f28f4175420 2023-11-06T13:28:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40ee6f0 con 0x7f28f4175420 2023-11-06T13:28:25.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.009+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f417d370 con 0x7f28f4175420 2023-11-06T13:28:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.011+0000 7f28eaffd700 1 -- 172.21.15.38:0/1319299227 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f28dc01ca00 con 0x7f28f4175420 2023-11-06T13:28:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.012+0000 7f28eaffd700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f28d408cbd0 0x7f28d408f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.012+0000 7f28eaffd700 1 -- 172.21.15.38:0/1319299227 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f28dc0b3db0 con 0x7f28f4175420 2023-11-06T13:28:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.012+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f28d408cbd0 0x7f28d408f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.012+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f28d408cbd0 0x7f28d408f090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f28ec005750 tx=0x7f28ec009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.014+0000 7f290abccb80 1 Processor -- start 2023-11-06T13:28:25.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.014+0000 7f290abccb80 1 -- start start 2023-11-06T13:28:25.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f290abccb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f290abccb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c551a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f290abccb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 0x55d2c551acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f290abccb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c5497050 con 0x55d2c551a870 2023-11-06T13:28:25.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f290abccb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c540e2c0 con 0x55d2c528df10 2023-11-06T13:28:25.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f290abccb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c5423510 con 0x55d2c5512a20 2023-11-06T13:28:25.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 0x55d2c551acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 0x55d2c551acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48584/0 (socket says 172.21.15.38:48584) 2023-11-06T13:28:25.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f359e700 1 -- 172.21.15.38:0/4283891470 learned_addr learned my addr 172.21.15.38:0/4283891470 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f259c700 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c551a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f359e700 1 -- 172.21.15.38:0/4283891470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 msgr2=0x55d2c551a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.015+0000 7f28f359e700 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c551a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28f359e700 1 -- 172.21.15.38:0/4283891470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 msgr2=0x55d2c5512530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28f359e700 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28f359e700 1 -- 172.21.15.38:0/4283891470 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c541c6f0 con 0x55d2c551a870 2023-11-06T13:28:25.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28f259c700 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c551a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:25.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28f359e700 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 0x55d2c551acf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f28e4001c50 tx=0x7f28e4009040).ready entity=mon.0 client_cookie=7ae265c45f86be98 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28d3fff700 1 -- 172.21.15.38:0/4283891470 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40020e0 con 0x55d2c551a870 2023-11-06T13:28:25.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28d3fff700 1 -- 172.21.15.38:0/4283891470 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400e800 con 0x55d2c551a870 2023-11-06T13:28:25.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.016+0000 7f28d3fff700 1 -- 172.21.15.38:0/4283891470 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400eb80 con 0x55d2c551a870 2023-11-06T13:28:25.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 -- 172.21.15.38:0/4283891470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 msgr2=0x55d2c551acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 0x55d2c551acf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f28e4001c50 tx=0x7f28e4009040).stop 2023-11-06T13:28:25.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 -- 172.21.15.38:0/4283891470 shutdown_connections 2023-11-06T13:28:25.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c551a870 0x55d2c551acf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 --2- 172.21.15.38:0/4283891470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c551a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.017+0000 7f290abccb80 1 -- 172.21.15.38:0/4283891470 >> 172.21.15.38:0/4283891470 conn(0x55d2c533b570 msgr2=0x55d2c54d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.018+0000 7f290abccb80 1 -- 172.21.15.38:0/4283891470 shutdown_connections 2023-11-06T13:28:25.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.018+0000 7f290abccb80 1 -- 172.21.15.38:0/4283891470 wait complete. 2023-11-06T13:28:25.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.019+0000 7f290abccb80 1 -- start start 2023-11-06T13:28:25.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.019+0000 7f290abccb80 1 Processor -- start 2023-11-06T13:28:25.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 0x55d2c55034c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.032 INFO:tasks.workunit.client.0.smithi038.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-06T13:28:25.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c5512a20 0x55d2c551c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c551a870 0x55d2c550f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c5423650 con 0x55d2c528df10 2023-11-06T13:28:25.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c54238d0 con 0x55d2c5512a20 2023-11-06T13:28:25.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c53eeee0 con 0x55d2c551a870 2023-11-06T13:28:25.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f290abccb80 10 client.0 ll_register_callbacks cb 0x55d2c5491630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:25.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 0x55d2c55034c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 0x55d2c55034c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48590/0 (socket says 172.21.15.38:48590) 2023-11-06T13:28:25.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 -- 172.21.15.38:0/2943428393 learned_addr learned my addr 172.21.15.38:0/2943428393 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f259c700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c5512a20 0x55d2c551c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f359e700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c551a870 0x55d2c550f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 -- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c551a870 msgr2=0x55d2c550f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c551a870 0x55d2c550f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 -- 172.21.15.38:0/2943428393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c5512a20 msgr2=0x55d2c551c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c5512a20 0x55d2c551c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f2d9d700 1 -- 172.21.15.38:0/2943428393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e400f040 con 0x55d2c528df10 2023-11-06T13:28:25.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f259c700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c5512a20 0x55d2c551c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:25.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.020+0000 7f28f359e700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c551a870 0x55d2c550f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:25.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 0x55d2c55034c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f28ec0147e0 tx=0x7f28ec013000).ready entity=mon.0 client_cookie=d930f2145409e6b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:25.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28d17fa700 1 -- 172.21.15.38:0/2943428393 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec014e00 con 0x55d2c528df10 2023-11-06T13:28:25.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28d17fa700 1 -- 172.21.15.38:0/2943428393 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f28ec005240 con 0x55d2c528df10 2023-11-06T13:28:25.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2c54c5710 con 0x55d2c528df10 2023-11-06T13:28:25.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28d17fa700 1 -- 172.21.15.38:0/2943428393 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28ec0046b0 con 0x55d2c528df10 2023-11-06T13:28:25.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 10 client.5118 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:25.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d2c5417a90 con 0x55d2c528df10 2023-11-06T13:28:25.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28d17fa700 1 -- 172.21.15.38:0/2943428393 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2c54c5710 con 0x55d2c528df10 2023-11-06T13:28:25.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f28d17fa700 1 -- 172.21.15.38:0/2943428393 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f28ec01f070 con 0x55d2c528df10 2023-11-06T13:28:25.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 10 client.5118 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:25.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 10 client.5118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:25.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 20 client.5118 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:25.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c550eaa0 0x55d2c54cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 4 client.5118 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:25.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.021+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2c5289d70 con 0x55d2c550eaa0 2023-11-06T13:28:25.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.022+0000 7f28f259c700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c550eaa0 0x55d2c54cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.022+0000 7f28d17fa700 10 client.5118 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.022+0000 7f28f259c700 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c550eaa0 0x55d2c54cf9a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9cd8286ef32ee983 server_cookie=f8e2db5507d3b700 in_seq=0 out_seq=0 2023-11-06T13:28:25.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.022+0000 7f28d17fa700 1 -- 172.21.15.38:0/2943428393 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d2c5289d70 con 0x55d2c550eaa0 2023-11-06T13:28:25.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.022+0000 7f28d17fa700 10 client.5118 handle_command_reply: tid=0 2023-11-06T13:28:25.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 client.5118 shutdown 2023-11-06T13:28:25.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 msgr2=0x55d2c55034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 0x55d2c55034c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f28ec0147e0 tx=0x7f28ec013000).stop 2023-11-06T13:28:25.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 shutdown_connections 2023-11-06T13:28:25.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c550eaa0 0x55d2c54cf9a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c551a870 0x55d2c550f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c528df10 0x55d2c55034c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f28d17fa700 0 client.5118 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 --2- 172.21.15.38:0/2943428393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c5512a20 0x55d2c551c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 >> 172.21.15.38:0/2943428393 conn(0x55d2c533b570 msgr2=0x55d2c550e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 shutdown_connections 2023-11-06T13:28:25.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 1 -- 172.21.15.38:0/2943428393 wait complete. 2023-11-06T13:28:25.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.023+0000 7f290abccb80 20 client.5118 trim_cache size 0 max 16384 2023-11-06T13:28:25.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.040+0000 7f290abccb80 1 Processor -- start 2023-11-06T13:28:25.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.040+0000 7f290abccb80 1 -- start start 2023-11-06T13:28:25.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f290abccb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f290abccb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c550eaa0 0x55d2c551c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f290abccb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 0x55d2c559c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f290abccb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c559e100 con 0x55d2c5512a20 2023-11-06T13:28:25.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f290abccb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c54cb910 con 0x55d2c528df10 2023-11-06T13:28:25.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f290abccb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c551c5f0 con 0x55d2c550eaa0 2023-11-06T13:28:25.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 0x55d2c559c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 0x55d2c559c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48594/0 (socket says 172.21.15.38:48594) 2023-11-06T13:28:25.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 -- 172.21.15.38:0/4212367846 learned_addr learned my addr 172.21.15.38:0/4212367846 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f259c700 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c550eaa0 0x55d2c551c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 -- 172.21.15.38:0/4212367846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c550eaa0 msgr2=0x55d2c551c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c550eaa0 0x55d2c551c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 -- 172.21.15.38:0/4212367846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 msgr2=0x55d2c5512ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 -- 172.21.15.38:0/4212367846 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2c54177e0 con 0x55d2c5512a20 2023-11-06T13:28:25.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f259c700 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c550eaa0 0x55d2c551c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:25.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28f359e700 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 0x55d2c559c9a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f28e4001a90 tx=0x7f28e4009040).ready entity=mon.0 client_cookie=4d1d145fabd617cd server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28e8bcf700 1 -- 172.21.15.38:0/4212367846 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4001810 con 0x55d2c5512a20 2023-11-06T13:28:25.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28e8bcf700 1 -- 172.21.15.38:0/4212367846 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4000fb0 con 0x55d2c5512a20 2023-11-06T13:28:25.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.041+0000 7f28e8bcf700 1 -- 172.21.15.38:0/4212367846 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400ebc0 con 0x55d2c5512a20 2023-11-06T13:28:25.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 -- 172.21.15.38:0/4212367846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 msgr2=0x55d2c559c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 0x55d2c559c9a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f28e4001a90 tx=0x7f28e4009040).stop 2023-11-06T13:28:25.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 -- 172.21.15.38:0/4212367846 shutdown_connections 2023-11-06T13:28:25.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c5512a20 0x55d2c559c9a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c5512ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 --2- 172.21.15.38:0/4212367846 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c550eaa0 0x55d2c551c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 -- 172.21.15.38:0/4212367846 >> 172.21.15.38:0/4212367846 conn(0x55d2c533b570 msgr2=0x55d2c551a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 -- 172.21.15.38:0/4212367846 shutdown_connections 2023-11-06T13:28:25.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.042+0000 7f290abccb80 1 -- 172.21.15.38:0/4212367846 wait complete. 2023-11-06T13:28:25.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.044+0000 7f290abccb80 1 -- start start 2023-11-06T13:28:25.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.044+0000 7f290abccb80 1 Processor -- start 2023-11-06T13:28:25.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c54d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 0x55d2c550df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c553e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c5510690 con 0x55d2c550eaa0 2023-11-06T13:28:25.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c554fc50 con 0x55d2c528df10 2023-11-06T13:28:25.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2c55aaa50 con 0x55d2c5512a20 2023-11-06T13:28:25.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 10 client.0 ll_register_callbacks cb 0x55d2c5491630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:25.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 0x55d2c550df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 0x55d2c550df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48606/0 (socket says 172.21.15.38:48606) 2023-11-06T13:28:25.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 -- 172.21.15.38:0/1898510903 learned_addr learned my addr 172.21.15.38:0/1898510903 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c54d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f359e700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c553e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 -- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 msgr2=0x55d2c553e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c553e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 -- 172.21.15.38:0/1898510903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 msgr2=0x55d2c54d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c54d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 -- 172.21.15.38:0/1898510903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2c541c6f0 con 0x55d2c550eaa0 2023-11-06T13:28:25.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28f259c700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 0x55d2c550df70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f28dc0844b0 tx=0x7f28dc027040).ready entity=mon.0 client_cookie=b657c97f217f03f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:25.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28d17fa700 1 -- 172.21.15.38:0/1898510903 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0b1370 con 0x55d2c550eaa0 2023-11-06T13:28:25.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f28e400e800 con 0x55d2c550eaa0 2023-11-06T13:28:25.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.046+0000 7f28d17fa700 1 -- 172.21.15.38:0/1898510903 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f28dc0b14d0 con 0x55d2c550eaa0 2023-11-06T13:28:25.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f28d17fa700 1 -- 172.21.15.38:0/1898510903 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28dc0874a0 con 0x55d2c550eaa0 2023-11-06T13:28:25.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 10 client.5124 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:25.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d2c528f050 con 0x55d2c550eaa0 2023-11-06T13:28:25.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f28d17fa700 1 -- 172.21.15.38:0/1898510903 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400e800 con 0x55d2c550eaa0 2023-11-06T13:28:25.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f28d17fa700 1 -- 172.21.15.38:0/1898510903 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f28dc08d400 con 0x55d2c550eaa0 2023-11-06T13:28:25.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 10 client.5124 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:25.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 10 client.5124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:25.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 20 client.5124 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:25.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c551a870 0x55d2c553abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 4 client.5124 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:28:25.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d2c52c0d70 con 0x55d2c551a870 2023-11-06T13:28:25.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.047+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c551a870 0x55d2c553abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.048+0000 7f28f2d9d700 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c551a870 0x55d2c553abf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c70010ed8eb1c9c4 server_cookie=9d6d86a30d9102ca in_seq=0 out_seq=0 2023-11-06T13:28:25.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.048+0000 7f28d17fa700 10 client.5124 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f28d17fa700 1 -- 172.21.15.38:0/1898510903 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d2c52c0d70 con 0x55d2c551a870 2023-11-06T13:28:25.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f28d17fa700 10 client.5124 handle_command_reply: tid=0 2023-11-06T13:28:25.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 client.5124 shutdown 2023-11-06T13:28:25.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 msgr2=0x55d2c550df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 0x55d2c550df70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f28dc0844b0 tx=0x7f28dc027040).stop 2023-11-06T13:28:25.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 shutdown_connections 2023-11-06T13:28:25.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d2c551a870 0x55d2c553abf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d2c5512a20 0x55d2c553e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d2c528df10 0x55d2c54d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f28d17fa700 0 client.5124 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 --2- 172.21.15.38:0/1898510903 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d2c550eaa0 0x55d2c550df70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 >> 172.21.15.38:0/1898510903 conn(0x55d2c533b570 msgr2=0x55d2c550f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 shutdown_connections 2023-11-06T13:28:25.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 1 -- 172.21.15.38:0/1898510903 wait complete. 2023-11-06T13:28:25.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.049+0000 7f290abccb80 20 client.5124 trim_cache size 0 max 16384 2023-11-06T13:28:25.070 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:28:25.070 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "9bfb7419-766b-4590-bb92-c812aee4bf29", 2023-11-06T13:28:25.071 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:28:25.071 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:25.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f28d408cbd0 msgr2=0x7f28d408f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f28d408cbd0 0x7f28d408f090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f28ec005750 tx=0x7f28ec009040).stop 2023-11-06T13:28:25.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 msgr2=0x7f28f416bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 0x7f28f416bf80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f28dc009e00 tx=0x7f28dc017000).stop 2023-11-06T13:28:25.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 shutdown_connections 2023-11-06T13:28:25.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f28d408cbd0 0x7f28d408f090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f4181a30 0x7f28f416c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28f40ca3c0 0x7f28f4192af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 --2- 172.21.15.38:0/1319299227 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f28f4175420 0x7f28f416bf80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 >> 172.21.15.38:0/1319299227 conn(0x7f28f40f2720 msgr2=0x7f28f4069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 shutdown_connections 2023-11-06T13:28:25.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.050+0000 7f28f8a33700 1 -- 172.21.15.38:0/1319299227 wait complete. 2023-11-06T13:28:25.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:28:25.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.238+0000 7f48db9ef700 1 Processor -- start 2023-11-06T13:28:25.242 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.239+0000 7f48db9ef700 1 -- start start 2023-11-06T13:28:25.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48db9ef700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f48d4171940 0x7f48d417d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48db9ef700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d417c510 con 0x7f48d40c7210 2023-11-06T13:28:25.246 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48db9ef700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d40c87f0 con 0x7f48d4171d20 2023-11-06T13:28:25.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48db9ef700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d417f500 con 0x7f48d4171940 2023-11-06T13:28:25.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48d9f8c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f48d40c7210 0x7f48d40c76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50128/0 (socket says 172.21.15.38:50128) 2023-11-06T13:28:25.247 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2058941258 learned_addr learned my addr 172.21.15.38:0/2058941258 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:25.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48d978b700 1 --2- 172.21.15.38:0/2058941258 >> v2:172.21.15.163:3300/0 conn(0x7f48d4171940 0x7f48d417d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460194668 0 0) 0x7f48d417c510 con 0x7f48d40c7210 2023-11-06T13:28:25.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c00033f0 con 0x7f48d40c7210 2023-11-06T13:28:25.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924083334 0 0) 0x7f48d40c87f0 con 0x7f48d4171d20 2023-11-06T13:28:25.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.240+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d417c510 con 0x7f48d4171d20 2023-11-06T13:28:25.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48d978b700 1 -- 172.21.15.38:0/2058941258 >> v1:172.21.15.44:6789/0 conn(0x7f48d4171d20 legacy=0x7f48d417d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48d978b700 1 -- 172.21.15.38:0/2058941258 >> v1:172.21.15.38:6789/0 conn(0x7f48d40c7210 legacy=0x7f48d40c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48d978b700 1 -- 172.21.15.38:0/2058941258 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40c8ad0 con 0x7f48d4171940 2023-11-06T13:28:25.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48d978b700 1 --2- 172.21.15.38:0/2058941258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d4171940 0x7f48d417d2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f48c4009760 tx=0x7f48c4009060).ready entity=mon.2 client_cookie=3e8aed1e2b7fe9c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400d4a0 con 0x7f48d4171940 2023-11-06T13:28:25.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400d600 con 0x7f48d4171940 2023-11-06T13:28:25.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48cbfff700 1 -- 172.21.15.38:0/2058941258 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400d980 con 0x7f48d4171940 2023-11-06T13:28:25.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48db9ef700 1 -- 172.21.15.38:0/2058941258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d4171940 msgr2=0x7f48d417d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2058941258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d4171940 0x7f48d417d2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f48c4009760 tx=0x7f48c4009060).stop 2023-11-06T13:28:25.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48db9ef700 1 -- 172.21.15.38:0/2058941258 shutdown_connections 2023-11-06T13:28:25.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2058941258 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d4171940 0x7f48d417d2b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48db9ef700 1 -- 172.21.15.38:0/2058941258 >> 172.21.15.38:0/2058941258 conn(0x7f48d40f22b0 msgr2=0x7f48d40ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.241+0000 7f48db9ef700 1 -- 172.21.15.38:0/2058941258 shutdown_connections 2023-11-06T13:28:25.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.242+0000 7f48db9ef700 1 -- 172.21.15.38:0/2058941258 wait complete. 2023-11-06T13:28:25.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.243+0000 7f48db9ef700 1 Processor -- start 2023-11-06T13:28:25.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.243+0000 7f48db9ef700 1 -- start start 2023-11-06T13:28:25.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48db9ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d40c7210 0x7f48d4156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48db9ef700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 0x7f48d40ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48db9ef700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d4171d20 0x7f48d40efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48db9ef700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d4190a10 con 0x7f48d4171940 2023-11-06T13:28:25.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48db9ef700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40f0450 con 0x7f48d4171d20 2023-11-06T13:28:25.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48db9ef700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d40f0730 con 0x7f48d40c7210 2023-11-06T13:28:25.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d8f8a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 0x7f48d40ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d8f8a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 0x7f48d40ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48616/0 (socket says 172.21.15.38:48616) 2023-11-06T13:28:25.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d8f8a700 1 -- 172.21.15.38:0/2358162749 learned_addr learned my addr 172.21.15.38:0/2358162749 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d4171d20 0x7f48d40efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d978b700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d40c7210 0x7f48d4156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d8f8a700 1 -- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d40c7210 msgr2=0x7f48d4156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.244+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d40c7210 0x7f48d4156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48d8f8a700 1 -- 172.21.15.38:0/2358162749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d4171d20 msgr2=0x7f48d40efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d4171d20 0x7f48d40efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48d8f8a700 1 -- 172.21.15.38:0/2358162749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40092a0 con 0x7f48d4171940 2023-11-06T13:28:25.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 0x7f48d40ef610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f48d000c440 tx=0x7f48d0007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48c97fa700 1 -- 172.21.15.38:0/2358162749 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0012400 con 0x7f48d4171940 2023-11-06T13:28:25.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48c97fa700 1 -- 172.21.15.38:0/2358162749 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0012560 con 0x7f48d4171940 2023-11-06T13:28:25.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48c97fa700 1 -- 172.21.15.38:0/2358162749 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0012920 con 0x7f48d4171940 2023-11-06T13:28:25.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d40f0a10 con 0x7f48d4171940 2023-11-06T13:28:25.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.245+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d40efff0 con 0x7f48d4171940 2023-11-06T13:28:25.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.248+0000 7f48c97fa700 1 -- 172.21.15.38:0/2358162749 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f48d0012d10 con 0x7f48d4171940 2023-11-06T13:28:25.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.248+0000 7f48c97fa700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f48b808cbd0 0x7f48b808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.248+0000 7f48c97fa700 1 -- 172.21.15.38:0/2358162749 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f48d00b13f0 con 0x7f48d4171940 2023-11-06T13:28:25.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.249+0000 7f48ed387b80 1 Processor -- start 2023-11-06T13:28:25.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.249+0000 7f48d978b700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f48b808cbd0 0x7f48b808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.249+0000 7f48ed387b80 1 -- start start 2023-11-06T13:28:25.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.249+0000 7f48d978b700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f48b808cbd0 0x7f48b808f090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f48c400d260 tx=0x7f48c4016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e1021f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e1021f8f0 0x557e101dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48ed387b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e101a1fd0 con 0x557e0ff98e90 2023-11-06T13:28:25.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48ed387b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e10119240 con 0x557e101dc110 2023-11-06T13:28:25.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48ed387b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1012e490 con 0x557e1021f8f0 2023-11-06T13:28:25.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e1021f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e1021f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48624/0 (socket says 172.21.15.38:48624) 2023-11-06T13:28:25.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 -- 172.21.15.38:0/3360887262 learned_addr learned my addr 172.21.15.38:0/3360887262 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e1021f8f0 0x557e101dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 -- 172.21.15.38:0/3360887262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e1021f8f0 msgr2=0x557e101dbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e1021f8f0 0x557e101dbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 -- 172.21.15.38:0/3360887262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 msgr2=0x557e1021cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 -- 172.21.15.38:0/3360887262 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e10127670 con 0x557e0ff98e90 2023-11-06T13:28:25.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e1021f8f0 0x557e101dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:25.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.250+0000 7f48d978b700 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e1021f400 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f48c4009d50 tx=0x7f48c4020070).ready entity=mon.0 client_cookie=6d4e5b68b16e9e12 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48be7fc700 1 -- 172.21.15.38:0/3360887262 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c401e4e0 con 0x557e0ff98e90 2023-11-06T13:28:25.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48be7fc700 1 -- 172.21.15.38:0/3360887262 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c401e640 con 0x557e0ff98e90 2023-11-06T13:28:25.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48be7fc700 1 -- 172.21.15.38:0/3360887262 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c401e9c0 con 0x557e0ff98e90 2023-11-06T13:28:25.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 -- 172.21.15.38:0/3360887262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 msgr2=0x557e1021f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e1021f400 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f48c4009d50 tx=0x7f48c4020070).stop 2023-11-06T13:28:25.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 -- 172.21.15.38:0/3360887262 shutdown_connections 2023-11-06T13:28:25.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e1021f400 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 --2- 172.21.15.38:0/3360887262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e1021f8f0 0x557e101dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 -- 172.21.15.38:0/3360887262 >> 172.21.15.38:0/3360887262 conn(0x557e100464f0 msgr2=0x557e101dcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 -- 172.21.15.38:0/3360887262 shutdown_connections 2023-11-06T13:28:25.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.251+0000 7f48ed387b80 1 -- 172.21.15.38:0/3360887262 wait complete. 2023-11-06T13:28:25.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.252+0000 7f48ed387b80 1 -- start start 2023-11-06T13:28:25.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.252+0000 7f48ed387b80 1 Processor -- start 2023-11-06T13:28:25.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e0ff98e90 0x557e10211150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e1021ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e101da510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1012e5d0 con 0x557e1021f8f0 2023-11-06T13:28:25.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e1012e850 con 0x557e0ff98e90 2023-11-06T13:28:25.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e100f9e60 con 0x557e101dc110 2023-11-06T13:28:25.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.253+0000 7f48ed387b80 10 client.0 ll_register_callbacks cb 0x557e1019c3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:25.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e101da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e101da510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48630/0 (socket says 172.21.15.38:48630) 2023-11-06T13:28:25.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2427973403 learned_addr learned my addr 172.21.15.38:0/2427973403 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d978b700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e0ff98e90 0x557e10211150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e1021ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 msgr2=0x557e1021ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.286 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e1021ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2427973403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e0ff98e90 msgr2=0x557e10211150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e0ff98e90 0x557e10211150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.287 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2427973403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d40efff0 con 0x557e1021f8f0 2023-11-06T13:28:25.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d978b700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e0ff98e90 0x557e10211150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:25.288 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e101da510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f48cc012720 tx=0x7f48cc009040).ready entity=mon.0 client_cookie=8ed026b54bfc6f00 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:25.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48b37fe700 1 -- 172.21.15.38:0/2427973403 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc001980 con 0x557e1021f8f0 2023-11-06T13:28:25.289 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48b37fe700 1 -- 172.21.15.38:0/2427973403 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f48cc005d10 con 0x557e1021f8f0 2023-11-06T13:28:25.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e101d0690 con 0x557e1021f8f0 2023-11-06T13:28:25.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48b37fe700 1 -- 172.21.15.38:0/2427973403 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48cc0072e0 con 0x557e1021f8f0 2023-11-06T13:28:25.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48ed387b80 10 client.5136 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:25.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f48d40c8ad0 con 0x557e1021f8f0 2023-11-06T13:28:25.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.254+0000 7f48b37fe700 1 -- 172.21.15.38:0/2427973403 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557e101d0690 con 0x557e1021f8f0 2023-11-06T13:28:25.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48b37fe700 1 -- 172.21.15.38:0/2427973403 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f48cc007440 con 0x557e1021f8f0 2023-11-06T13:28:25.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48ed387b80 10 client.5136 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:25.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48ed387b80 10 client.5136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:25.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48ed387b80 20 client.5136 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:25.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e102424c0 0x557e10211640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48ed387b80 4 client.5136 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:25.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e0ff94cf0 con 0x557e102424c0 2023-11-06T13:28:25.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48d978b700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e102424c0 0x557e10211640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48b37fe700 10 client.5136 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.255+0000 7f48d978b700 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e102424c0 0x557e10211640 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=58ebffe2782a40c8 server_cookie=76488f0dd22f459f in_seq=0 out_seq=0 2023-11-06T13:28:25.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48b37fe700 1 -- 172.21.15.38:0/2427973403 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557e0ff94cf0 con 0x557e102424c0 2023-11-06T13:28:25.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48b37fe700 10 client.5136 handle_command_reply: tid=0 2023-11-06T13:28:25.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 client.5136 shutdown 2023-11-06T13:28:25.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 msgr2=0x557e101da510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e101da510 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f48cc012720 tx=0x7f48cc009040).stop 2023-11-06T13:28:25.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 shutdown_connections 2023-11-06T13:28:25.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e101da510 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e0ff98e90 0x557e10211150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e102424c0 0x557e10211640 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2427973403 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e1021ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 >> 172.21.15.38:0/2427973403 conn(0x557e100464f0 msgr2=0x557e1024c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48b37fe700 0 client.5136 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 shutdown_connections 2023-11-06T13:28:25.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 1 -- 172.21.15.38:0/2427973403 wait complete. 2023-11-06T13:28:25.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.256+0000 7f48ed387b80 20 client.5136 trim_cache size 0 max 16384 2023-11-06T13:28:25.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.286+0000 7f48ed387b80 1 Processor -- start 2023-11-06T13:28:25.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.286+0000 7f48ed387b80 1 -- start start 2023-11-06T13:28:25.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.287+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e0ff98e90 0x557e1024c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.287+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.287+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e102a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.287+0000 7f48ed387b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e102160e0 con 0x557e1021f8f0 2023-11-06T13:28:25.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48ed387b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e10242580 con 0x557e101dc110 2023-11-06T13:28:25.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48ed387b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e10242a10 con 0x557e0ff98e90 2023-11-06T13:28:25.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e102a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e102a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48646/0 (socket says 172.21.15.38:48646) 2023-11-06T13:28:25.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2026313201 learned_addr learned my addr 172.21.15.38:0/2026313201 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d978b700 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e0ff98e90 0x557e1024c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2026313201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e0ff98e90 msgr2=0x557e1024c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e0ff98e90 0x557e1024c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2026313201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 msgr2=0x557e1021f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 -- 172.21.15.38:0/2026313201 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e10122a10 con 0x557e1021f8f0 2023-11-06T13:28:25.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d978b700 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e0ff98e90 0x557e1024c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:25.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e102a4100 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f48cc012ef0 tx=0x7f48cc020000).ready entity=mon.0 client_cookie=d732f8d54a149b72 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48beffd700 1 -- 172.21.15.38:0/2026313201 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc0079d0 con 0x557e1021f8f0 2023-11-06T13:28:25.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48beffd700 1 -- 172.21.15.38:0/2026313201 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48cc012370 con 0x557e1021f8f0 2023-11-06T13:28:25.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.288+0000 7f48beffd700 1 -- 172.21.15.38:0/2026313201 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc0072e0 con 0x557e1021f8f0 2023-11-06T13:28:25.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 -- 172.21.15.38:0/2026313201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 msgr2=0x557e102a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e102a4100 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f48cc012ef0 tx=0x7f48cc020000).stop 2023-11-06T13:28:25.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 -- 172.21.15.38:0/2026313201 shutdown_connections 2023-11-06T13:28:25.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e1021f8f0 0x557e102a4100 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e0ff98e90 0x557e1024c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 --2- 172.21.15.38:0/2026313201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e101dc110 0x557e1021f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 -- 172.21.15.38:0/2026313201 >> 172.21.15.38:0/2026313201 conn(0x557e100464f0 msgr2=0x557e101e3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 -- 172.21.15.38:0/2026313201 shutdown_connections 2023-11-06T13:28:25.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.289+0000 7f48ed387b80 1 -- 172.21.15.38:0/2026313201 wait complete. 2023-11-06T13:28:25.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.290+0000 7f48ed387b80 1 -- start start 2023-11-06T13:28:25.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.290+0000 7f48ed387b80 1 Processor -- start 2023-11-06T13:28:25.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e102b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e102b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e1021f8f0 0x557e1029b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e102b4320 con 0x557e0ff98e90 2023-11-06T13:28:25.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e102074f0 con 0x557e1021f8f0 2023-11-06T13:28:25.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e102afea0 con 0x557e101dc110 2023-11-06T13:28:25.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48ed387b80 10 client.0 ll_register_callbacks cb 0x557e1019c3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:25.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e102b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e102b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48652/0 (socket says 172.21.15.38:48652) 2023-11-06T13:28:25.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 -- 172.21.15.38:0/664015326 learned_addr learned my addr 172.21.15.38:0/664015326 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:25.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e102b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e1021f8f0 0x557e1029b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 -- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 msgr2=0x557e102b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e102b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 -- 172.21.15.38:0/664015326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e1021f8f0 msgr2=0x557e1029b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:25.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.291+0000 7f48d978b700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e1021f8f0 0x557e1029b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48d978b700 1 -- 172.21.15.38:0/664015326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d40c8ad0 con 0x557e0ff98e90 2023-11-06T13:28:25.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48d9f8c700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e1021f8f0 0x557e1029b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:25.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48d978b700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e102b3420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f48c401f000 tx=0x7f48c4013040).ready entity=mon.0 client_cookie=6ceb1a4aca6b7100 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:25.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:25.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48b37fe700 1 -- 172.21.15.38:0/664015326 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4036040 con 0x557e0ff98e90 2023-11-06T13:28:25.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48b37fe700 1 -- 172.21.15.38:0/664015326 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8745+0+0 (secure 0 0 0) 0x7f48c401ed30 con 0x557e0ff98e90 2023-11-06T13:28:25.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48c401e640 con 0x557e0ff98e90 2023-11-06T13:28:25.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48b37fe700 1 -- 172.21.15.38:0/664015326 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48c401e9c0 con 0x557e0ff98e90 2023-11-06T13:28:25.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 10 client.5142 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:25.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557e10122760 con 0x557e0ff98e90 2023-11-06T13:28:25.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48b37fe700 1 -- 172.21.15.38:0/664015326 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c401e640 con 0x557e0ff98e90 2023-11-06T13:28:25.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48b37fe700 1 -- 172.21.15.38:0/664015326 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f48c403c4c0 con 0x557e0ff98e90 2023-11-06T13:28:25.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 10 client.5142 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:25.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 10 client.5142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:25.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 20 client.5142 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:25.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e1021fd60 0x557e101d8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:25.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 4 client.5142 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:28:25.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.292+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557e0ffcbcf0 con 0x557e1021fd60 2023-11-06T13:28:25.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e1021fd60 0x557e101d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:25.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48d8f8a700 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e1021fd60 0x557e101d8910 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7aec721486bb3dc2 server_cookie=f24a6f35a07050a1 in_seq=0 out_seq=0 2023-11-06T13:28:25.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48b37fe700 10 client.5142 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48b37fe700 1 -- 172.21.15.38:0/664015326 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557e0ffcbcf0 con 0x557e1021fd60 2023-11-06T13:28:25.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48b37fe700 10 client.5142 handle_command_reply: tid=0 2023-11-06T13:28:25.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 client.5142 shutdown 2023-11-06T13:28:25.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 msgr2=0x557e102b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e102b3420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f48c401f000 tx=0x7f48c4013040).stop 2023-11-06T13:28:25.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 shutdown_connections 2023-11-06T13:28:25.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557e1021f8f0 0x557e1029b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557e0ff98e90 0x557e102b3420 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557e1021fd60 0x557e101d8910 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 --2- 172.21.15.38:0/664015326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557e101dc110 0x557e102b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48b37fe700 0 client.5142 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:25.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 >> 172.21.15.38:0/664015326 conn(0x557e100464f0 msgr2=0x557e10218cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 shutdown_connections 2023-11-06T13:28:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.293+0000 7f48ed387b80 1 -- 172.21.15.38:0/664015326 wait complete. 2023-11-06T13:28:25.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48ed387b80 20 client.5142 trim_cache size 0 max 16384 2023-11-06T13:28:25.319 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:25.320 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:28:25.320 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:28:25.320 INFO:teuthology.orchestra.run.smithi038.stdout: "9bfb7419-766b-4590-bb92-c812aee4bf29": { 2023-11-06T13:28:25.320 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:28:25.320 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "9bfb7419-766b-4590-bb92-c812aee4bf29", 2023-11-06T13:28:25.321 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:28:25.321 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:28:25.321 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:28:25.321 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f48b808cbd0 msgr2=0x7f48b808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f48b808cbd0 0x7f48b808f090 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f48c400d260 tx=0x7f48c4016000).stop 2023-11-06T13:28:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 msgr2=0x7f48d40ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:25.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 0x7f48d40ef610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f48d000c440 tx=0x7f48d0007be0).stop 2023-11-06T13:28:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 shutdown_connections 2023-11-06T13:28:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f48b808cbd0 0x7f48b808f090 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48d4171d20 0x7f48d40efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48d40c7210 0x7f48d4156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 --2- 172.21.15.38:0/2358162749 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f48d4171940 0x7f48d40ef610 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 >> 172.21.15.38:0/2358162749 conn(0x7f48d40f22b0 msgr2=0x7f48d40831f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 shutdown_connections 2023-11-06T13:28:25.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:25.294+0000 7f48db9ef700 1 -- 172.21.15.38:0/2358162749 wait complete. 2023-11-06T13:28:25.325 INFO:tasks.cephfs.filesystem:scrub status for tag:9bfb7419-766b-4590-bb92-c812aee4bf29 - {'path': '/', 'tag': '9bfb7419-766b-4590-bb92-c812aee4bf29', 'options': 'recursive,force'} 2023-11-06T13:28:26.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:28:26.827 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:28:26.830 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:28:55.327 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:28:55.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.449+0000 7f57baf70700 1 Processor -- start 2023-11-06T13:28:55.453 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.449+0000 7f57baf70700 1 -- start start 2023-11-06T13:28:55.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.450+0000 7f57baf70700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f57b4178f80 0x7f57b4085400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.450+0000 7f57baf70700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f57b4180e80 0x7f57b4181300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.450+0000 7f57baf70700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b41809f0 con 0x7f57b41817f0 2023-11-06T13:28:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.450+0000 7f57baf70700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40858f0 con 0x7f57b4178f80 2023-11-06T13:28:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.450+0000 7f57baf70700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40eb8e0 con 0x7f57b4180e80 2023-11-06T13:28:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b950d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f57b41817f0 0x7f57b417eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:58348/0 (socket says 172.21.15.38:58348) 2023-11-06T13:28:55.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b950d700 1 -- 172.21.15.38:0/3304287290 learned_addr learned my addr 172.21.15.38:0/3304287290 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b3fff700 1 --2- 172.21.15.38:0/3304287290 >> v2:172.21.15.163:3300/0 conn(0x7f57b4180e80 0x7f57b4181300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/3304287290 >> v2:172.21.15.44:3300/0 conn(0x7f57b4178f80 0x7f57b4085400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516572585 0 0) 0x7f57b41809f0 con 0x7f57b41817f0 2023-11-06T13:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a40033f0 con 0x7f57b41817f0 2023-11-06T13:28:55.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283392152 0 0) 0x7f57a40033f0 con 0x7f57b41817f0 2023-11-06T13:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 >> v2:172.21.15.163:3300/0 conn(0x7f57b4180e80 msgr2=0x7f57b4181300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 --2- 172.21.15.38:0/3304287290 >> v2:172.21.15.163:3300/0 conn(0x7f57b4180e80 0x7f57b4181300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 >> v2:172.21.15.44:3300/0 conn(0x7f57b4178f80 msgr2=0x7f57b4085400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 --2- 172.21.15.38:0/3304287290 >> v2:172.21.15.44:3300/0 conn(0x7f57b4178f80 0x7f57b4085400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40ebbc0 con 0x7f57b41817f0 2023-11-06T13:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f57ac0017f0 con 0x7f57b41817f0 2023-11-06T13:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 >> v1:172.21.15.38:6789/0 conn(0x7f57b41817f0 legacy=0x7f57b417eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4003930 0x7f57a4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57a4004690 0x7f57a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57a4005000 0x7f57a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40858f0 con 0x7f57a4004690 2023-11-06T13:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40eb8e0 con 0x7f57a4005000 2023-11-06T13:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a400be80 con 0x7f57a4003930 2023-11-06T13:28:55.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.451+0000 7f57b3fff700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57a4004690 0x7f57a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b950d700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57a4005000 0x7f57a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4003930 0x7f57a4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b3fff700 1 -- 172.21.15.38:0/3304287290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4003930 msgr2=0x7f57a4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b3fff700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4003930 0x7f57a4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b3fff700 1 -- 172.21.15.38:0/3304287290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57a4005000 msgr2=0x7f57a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b3fff700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57a4005000 0x7f57a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b3fff700 1 -- 172.21.15.38:0/3304287290 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40033f0 con 0x7f57a4004690 2023-11-06T13:28:55.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b950d700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57a4005000 0x7f57a400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:55.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4003930 0x7f57a4003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:55.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b950d700 1 -- 172.21.15.38:0/3304287290 reap_dead start 2023-11-06T13:28:55.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b3fff700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57a4004690 0x7f57a4004b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f57a0009a80 tx=0x7f57a0009060).ready entity=mon.0 client_cookie=3e426ae67be79d4a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0009430 con 0x7f57a4004690 2023-11-06T13:28:55.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a000e640 con 0x7f57a4004690 2023-11-06T13:28:55.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.452+0000 7f57b37fe700 1 -- 172.21.15.38:0/3304287290 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000e9c0 con 0x7f57a4004690 2023-11-06T13:28:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 -- 172.21.15.38:0/3304287290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57a4004690 msgr2=0x7f57a4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57a4004690 0x7f57a4004b10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f57a0009a80 tx=0x7f57a0009060).stop 2023-11-06T13:28:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 -- 172.21.15.38:0/3304287290 shutdown_connections 2023-11-06T13:28:55.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 --2- 172.21.15.38:0/3304287290 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57a4004690 0x7f57a4004b10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 -- 172.21.15.38:0/3304287290 >> 172.21.15.38:0/3304287290 conn(0x7f57b40ef620 msgr2=0x7f57b405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 -- 172.21.15.38:0/3304287290 shutdown_connections 2023-11-06T13:28:55.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.453+0000 7f57baf70700 1 -- 172.21.15.38:0/3304287290 wait complete. 2023-11-06T13:28:55.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.454+0000 7f57baf70700 1 Processor -- start 2023-11-06T13:28:55.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.455+0000 7f57baf70700 1 -- start start 2023-11-06T13:28:55.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4004690 0x7f57b416fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57b4193690 0x7f57b4193b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 0x7f57b4068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4194000 con 0x7f57b4068200 2023-11-06T13:28:55.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40ee860 con 0x7f57b4193690 2023-11-06T13:28:55.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40edce0 con 0x7f57a4004690 2023-11-06T13:28:55.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 0x7f57b4068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 0x7f57b4068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44692/0 (socket says 172.21.15.38:44692) 2023-11-06T13:28:55.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 -- 172.21.15.38:0/1960308605 learned_addr learned my addr 172.21.15.38:0/1960308605 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:55.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b3fff700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57b4193690 0x7f57b4193b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4004690 0x7f57b416fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 -- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4004690 msgr2=0x7f57b416fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4004690 0x7f57b416fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 -- 172.21.15.38:0/1960308605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57b4193690 msgr2=0x7f57b4193b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57b4193690 0x7f57b4193b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 -- 172.21.15.38:0/1960308605 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40edfc0 con 0x7f57b4068200 2023-11-06T13:28:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4004690 0x7f57b416fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b950d700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 0x7f57b4068680 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f57b40672f0 tx=0x7f57ac007d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b0ff9700 1 -- 172.21.15.38:0/1960308605 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00e5a0 con 0x7f57b4068200 2023-11-06T13:28:55.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b0ff9700 1 -- 172.21.15.38:0/1960308605 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00e700 con 0x7f57b4068200 2023-11-06T13:28:55.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40ee2a0 con 0x7f57b4068200 2023-11-06T13:28:55.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.456+0000 7f57b0ff9700 1 -- 172.21.15.38:0/1960308605 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00eac0 con 0x7f57b4068200 2023-11-06T13:28:55.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.457+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b4067ce0 con 0x7f57b4068200 2023-11-06T13:28:55.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.458+0000 7f57b0ff9700 1 -- 172.21.15.38:0/1960308605 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f57ac014430 con 0x7f57b4068200 2023-11-06T13:28:55.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.459+0000 7f57b0ff9700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f579808cbd0 0x7f579808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.459+0000 7f57b0ff9700 1 -- 172.21.15.38:0/1960308605 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f57ac0b1d40 con 0x7f57b4068200 2023-11-06T13:28:55.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.459+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f579808cbd0 0x7f579808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.460+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f579808cbd0 0x7f579808f090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f57a8009270 tx=0x7f57a8008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.461+0000 7f57cc908b80 1 Processor -- start 2023-11-06T13:28:55.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.461+0000 7f57cc908b80 1 -- start start 2023-11-06T13:28:55.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1a5ce90 0x55adf1ce3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1c9fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ce0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57cc908b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1c65fd0 con 0x55adf1ce38f0 2023-11-06T13:28:55.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57cc908b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1bdd240 con 0x55adf1ca0110 2023-11-06T13:28:55.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57cc908b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1bf2490 con 0x55adf1a5ce90 2023-11-06T13:28:55.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1c9fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1c9fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44706/0 (socket says 172.21.15.38:44706) 2023-11-06T13:28:55.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 -- 172.21.15.38:0/455554622 learned_addr learned my addr 172.21.15.38:0/455554622 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:55.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1a5ce90 0x55adf1ce3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b950d700 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ce0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 -- 172.21.15.38:0/455554622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1a5ce90 msgr2=0x55adf1ce3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1a5ce90 0x55adf1ce3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 -- 172.21.15.38:0/455554622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 msgr2=0x55adf1ce0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ce0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 -- 172.21.15.38:0/455554622 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adf1beb670 con 0x55adf1ce38f0 2023-11-06T13:28:55.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.462+0000 7f57b3fff700 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1c9fc20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f57a400bdd0 tx=0x7f57a001a000).ready entity=mon.0 client_cookie=e60be3f7151b0881 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f579dffb700 1 -- 172.21.15.38:0/455554622 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0022070 con 0x55adf1ce38f0 2023-11-06T13:28:55.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f579dffb700 1 -- 172.21.15.38:0/455554622 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0009df0 con 0x55adf1ce38f0 2023-11-06T13:28:55.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f579dffb700 1 -- 172.21.15.38:0/455554622 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000ed30 con 0x55adf1ce38f0 2023-11-06T13:28:55.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 -- 172.21.15.38:0/455554622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 msgr2=0x55adf1c9fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1c9fc20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f57a400bdd0 tx=0x7f57a001a000).stop 2023-11-06T13:28:55.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 -- 172.21.15.38:0/455554622 shutdown_connections 2023-11-06T13:28:55.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ce0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1a5ce90 0x55adf1ce3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 --2- 172.21.15.38:0/455554622 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1c9fc20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 -- 172.21.15.38:0/455554622 >> 172.21.15.38:0/455554622 conn(0x55adf1b0a4f0 msgr2=0x55adf1ca0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 -- 172.21.15.38:0/455554622 shutdown_connections 2023-11-06T13:28:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.463+0000 7f57cc908b80 1 -- 172.21.15.38:0/455554622 wait complete. 2023-11-06T13:28:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.464+0000 7f57cc908b80 1 -- start start 2023-11-06T13:28:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.464+0000 7f57cc908b80 1 Processor -- start 2023-11-06T13:28:55.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1ca7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ca0110 0x55adf1d22a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1cd3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1bf25d0 con 0x55adf1ce38f0 2023-11-06T13:28:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1bf2850 con 0x55adf1a5ce90 2023-11-06T13:28:55.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1bbde60 con 0x55adf1ca0110 2023-11-06T13:28:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.465+0000 7f57cc908b80 10 client.0 ll_register_callbacks cb 0x55adf1c603d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1cd3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1cd3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44710/0 (socket says 172.21.15.38:44710) 2023-11-06T13:28:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 -- 172.21.15.38:0/2433740373 learned_addr learned my addr 172.21.15.38:0/2433740373 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:55.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ca0110 0x55adf1d22a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1ca7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 -- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ca0110 msgr2=0x55adf1d22a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ca0110 0x55adf1d22a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 -- 172.21.15.38:0/2433740373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 msgr2=0x55adf1ca7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1ca7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 -- 172.21.15.38:0/2433740373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a40033f0 con 0x55adf1ce38f0 2023-11-06T13:28:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ca0110 0x55adf1d22a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57b950d700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1cd3440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f57ac085c00 tx=0x7f57ac0b1040).ready entity=mon.0 client_cookie=59cc4d5300a135b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f5792ffd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:55.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f5792ffd700 1 -- 172.21.15.38:0/2433740373 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac084370 con 0x55adf1ce38f0 2023-11-06T13:28:55.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f5792ffd700 1 -- 172.21.15.38:0/2433740373 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f57ac087070 con 0x55adf1ce38f0 2023-11-06T13:28:55.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adf1c94690 con 0x55adf1ce38f0 2023-11-06T13:28:55.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f5792ffd700 1 -- 172.21.15.38:0/2433740373 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57ac085600 con 0x55adf1ce38f0 2023-11-06T13:28:55.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57cc908b80 10 client.5154 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.466+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55adf1be6a10 con 0x55adf1ce38f0 2023-11-06T13:28:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f5792ffd700 1 -- 172.21.15.38:0/2433740373 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adf1c94690 con 0x55adf1ce38f0 2023-11-06T13:28:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f5792ffd700 1 -- 172.21.15.38:0/2433740373 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f57ac08b350 con 0x55adf1ce38f0 2023-11-06T13:28:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57cc908b80 10 client.5154 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:55.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57cc908b80 10 client.5154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57cc908b80 20 client.5154 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1cdc1a0 0x55adf1d20c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57cc908b80 4 client.5154 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adf1a58cf0 con 0x55adf1cdc1a0 2023-11-06T13:28:55.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1cdc1a0 0x55adf1d20c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f5792ffd700 10 client.5154 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.467+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1cdc1a0 0x55adf1d20c00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d8631b6943b11c7 server_cookie=3e146e08e6372c94 in_seq=0 out_seq=0 2023-11-06T13:28:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f5792ffd700 1 -- 172.21.15.38:0/2433740373 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55adf1a58cf0 con 0x55adf1cdc1a0 2023-11-06T13:28:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f5792ffd700 10 client.5154 handle_command_reply: tid=0 2023-11-06T13:28:55.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 client.5154 shutdown 2023-11-06T13:28:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 msgr2=0x55adf1cd3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1cd3440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f57ac085c00 tx=0x7f57ac0b1040).stop 2023-11-06T13:28:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 shutdown_connections 2023-11-06T13:28:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ce38f0 0x55adf1cd3440 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1ca7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1cdc1a0 0x55adf1d20c00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2433740373 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ca0110 0x55adf1d22a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 >> 172.21.15.38:0/2433740373 conn(0x55adf1b0a4f0 msgr2=0x55adf1d0f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:55.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f5792ffd700 0 client.5154 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:55.497 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 shutdown_connections 2023-11-06T13:28:55.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.468+0000 7f57cc908b80 1 -- 172.21.15.38:0/2433740373 wait complete. 2023-11-06T13:28:55.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.469+0000 7f57cc908b80 20 client.5154 trim_cache size 0 max 16384 2023-11-06T13:28:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.485+0000 7f57cc908b80 1 Processor -- start 2023-11-06T13:28:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.485+0000 7f57cc908b80 1 -- start start 2023-11-06T13:28:55.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.486+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 0x55adf1d0f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.486+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ca04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.486+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1ca0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.486+0000 7f57cc908b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1ce4100 con 0x55adf1a5ce90 2023-11-06T13:28:55.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.486+0000 7f57cc908b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1d10030 con 0x55adf1ca0110 2023-11-06T13:28:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.486+0000 7f57cc908b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1cdfcd0 con 0x55adf1ce38f0 2023-11-06T13:28:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 0x55adf1d0f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 0x55adf1d0f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44718/0 (socket says 172.21.15.38:44718) 2023-11-06T13:28:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 -- 172.21.15.38:0/2986050448 learned_addr learned my addr 172.21.15.38:0/2986050448 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:55.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b950d700 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1ca0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ca04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 -- 172.21.15.38:0/2986050448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 msgr2=0x55adf1ca0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1ca0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 -- 172.21.15.38:0/2986050448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 msgr2=0x55adf1ca04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ca04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 -- 172.21.15.38:0/2986050448 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adf1be6760 con 0x55adf1a5ce90 2023-11-06T13:28:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ca04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 0x55adf1d0f610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f57b4047d10 tx=0x7f57a8015000).ready entity=mon.0 client_cookie=c86cc1399653a532 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f579e7fc700 1 -- 172.21.15.38:0/2986050448 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8028070 con 0x55adf1a5ce90 2023-11-06T13:28:55.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f579e7fc700 1 -- 172.21.15.38:0/2986050448 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8015b70 con 0x55adf1a5ce90 2023-11-06T13:28:55.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.487+0000 7f579e7fc700 1 -- 172.21.15.38:0/2986050448 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8015d20 con 0x55adf1a5ce90 2023-11-06T13:28:55.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 -- 172.21.15.38:0/2986050448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 msgr2=0x55adf1d0f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 0x55adf1d0f610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f57b4047d10 tx=0x7f57a8015000).stop 2023-11-06T13:28:55.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 -- 172.21.15.38:0/2986050448 shutdown_connections 2023-11-06T13:28:55.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1ca0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1a5ce90 0x55adf1d0f610 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2986050448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1ca0110 0x55adf1ca04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 -- 172.21.15.38:0/2986050448 >> 172.21.15.38:0/2986050448 conn(0x55adf1b0a4f0 msgr2=0x55adf1d0ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:55.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 -- 172.21.15.38:0/2986050448 shutdown_connections 2023-11-06T13:28:55.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.488+0000 7f57cc908b80 1 -- 172.21.15.38:0/2986050448 wait complete. 2023-11-06T13:28:55.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.489+0000 7f57cc908b80 1 -- start start 2023-11-06T13:28:55.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.489+0000 7f57cc908b80 1 Processor -- start 2023-11-06T13:28:55.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1d26830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 0x55adf1c9fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1d66b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1d78690 con 0x55adf1ca0110 2023-11-06T13:28:55.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1d677e0 con 0x55adf1a5ce90 2023-11-06T13:28:55.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adf1d74230 con 0x55adf1ce38f0 2023-11-06T13:28:55.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57cc908b80 10 client.0 ll_register_callbacks cb 0x55adf1c603d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:55.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 0x55adf1c9fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 0x55adf1c9fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:44730/0 (socket says 172.21.15.38:44730) 2023-11-06T13:28:55.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 -- 172.21.15.38:0/2734152132 learned_addr learned my addr 172.21.15.38:0/2734152132 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:55.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b950d700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1d66b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1d26830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 -- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 msgr2=0x55adf1d66b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1d66b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 -- 172.21.15.38:0/2734152132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 msgr2=0x55adf1d26830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:55.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1d26830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b3fff700 1 -- 172.21.15.38:0/2734152132 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a8011c50 con 0x55adf1ca0110 2023-11-06T13:28:55.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.490+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1d26830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57b3fff700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 0x55adf1c9fa30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f57a001f000 tx=0x7f57a0022000).ready entity=mon.0 client_cookie=aad97378a8f4c6c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f5792ffd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f5792ffd700 1 -- 172.21.15.38:0/2734152132 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000e9c0 con 0x55adf1ca0110 2023-11-06T13:28:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f5792ffd700 1 -- 172.21.15.38:0/2734152132 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f57a0027ce0 con 0x55adf1ca0110 2023-11-06T13:28:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57a0009df0 con 0x55adf1ca0110 2023-11-06T13:28:55.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f5792ffd700 1 -- 172.21.15.38:0/2734152132 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57a0027ea0 con 0x55adf1ca0110 2023-11-06T13:28:55.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 10 client.5160 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:55.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55adf1a5dfd0 con 0x55adf1ca0110 2023-11-06T13:28:55.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f5792ffd700 1 -- 172.21.15.38:0/2734152132 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0009df0 con 0x55adf1ca0110 2023-11-06T13:28:55.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f5792ffd700 1 -- 172.21.15.38:0/2734152132 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f57a0011070 con 0x55adf1ca0110 2023-11-06T13:28:55.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 10 client.5160 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:55.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 10 client.5160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:55.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 20 client.5160 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:55.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1d77d50 0x55adf1d601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:55.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 4 client.5160 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:28:55.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.491+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55adf1a8fcf0 con 0x55adf1d77d50 2023-11-06T13:28:55.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1d77d50 0x55adf1d601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:55.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f5792ffd700 10 client.5160 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:55.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57b8d0c700 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1d77d50 0x55adf1d601f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a1247707bd75f126 server_cookie=7a05fe5856e4947e in_seq=0 out_seq=0 2023-11-06T13:28:55.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f5792ffd700 1 -- 172.21.15.38:0/2734152132 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55adf1a8fcf0 con 0x55adf1d77d50 2023-11-06T13:28:55.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f5792ffd700 10 client.5160 handle_command_reply: tid=0 2023-11-06T13:28:55.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 client.5160 shutdown 2023-11-06T13:28:55.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 msgr2=0x55adf1c9fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 0x55adf1c9fa30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f57a001f000 tx=0x7f57a0022000).stop 2023-11-06T13:28:55.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 shutdown_connections 2023-11-06T13:28:55.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55adf1d77d50 0x55adf1d601f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55adf1ce38f0 0x55adf1d66b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55adf1a5ce90 0x55adf1d26830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f5792ffd700 0 client.5160 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:55.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 --2- 172.21.15.38:0/2734152132 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55adf1ca0110 0x55adf1c9fa30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 >> 172.21.15.38:0/2734152132 conn(0x55adf1b0a4f0 msgr2=0x55adf1ca0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:55.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 shutdown_connections 2023-11-06T13:28:55.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.492+0000 7f57cc908b80 1 -- 172.21.15.38:0/2734152132 wait complete. 2023-11-06T13:28:55.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57cc908b80 20 client.5160 trim_cache size 0 max 16384 2023-11-06T13:28:55.521 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:55.522 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:28:55.522 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:28:55.522 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:55.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f579808cbd0 msgr2=0x7f579808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f579808cbd0 0x7f579808f090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f57a8009270 tx=0x7f57a8008040).stop 2023-11-06T13:28:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 msgr2=0x7f57b4068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 0x7f57b4068680 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f57b40672f0 tx=0x7f57ac007d10).stop 2023-11-06T13:28:55.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 shutdown_connections 2023-11-06T13:28:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f57b4068200 0x7f57b4068680 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57a4004690 0x7f57b416fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f579808cbd0 0x7f579808f090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 --2- 172.21.15.38:0/1960308605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57b4193690 0x7f57b4193b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:55.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 >> 172.21.15.38:0/1960308605 conn(0x7f57b40ef620 msgr2=0x7f57b405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 shutdown_connections 2023-11-06T13:28:55.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:55.493+0000 7f57baf70700 1 -- 172.21.15.38:0/1960308605 wait complete. 2023-11-06T13:28:55.526 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:28:56.527 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:28:56.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:28:56.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.651+0000 7f406f06d700 1 Processor -- start 2023-11-06T13:28:56.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.651+0000 7f406f06d700 1 -- start start 2023-11-06T13:28:56.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406f06d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f4068172240 0x7f4068172620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406f06d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f406817d790 0x7f406817dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406f06d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680c7d90 con 0x7f40680c7220 2023-11-06T13:28:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406f06d700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40680c8060 con 0x7f406817d790 2023-11-06T13:28:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406f06d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40680c8340 con 0x7f4068172240 2023-11-06T13:28:56.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406d60a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f406817d790 0x7f406817dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406d60a700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f406817d790 0x7f406817dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54606/0 (socket says 172.21.15.38:54606) 2023-11-06T13:28:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.653+0000 7f406d60a700 1 -- 172.21.15.38:0/31177652 learned_addr learned my addr 172.21.15.38:0/31177652 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f406ce09700 1 --2- 172.21.15.38:0/31177652 >> v2:172.21.15.163:3300/0 conn(0x7f4068172240 0x7f4068172620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f406d60a700 1 -- 172.21.15.38:0/31177652 >> v2:172.21.15.163:3300/0 conn(0x7f4068172240 msgr2=0x7f4068172620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f406d60a700 1 --2- 172.21.15.38:0/31177652 >> v2:172.21.15.163:3300/0 conn(0x7f4068172240 0x7f4068172620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f406d60a700 1 -- 172.21.15.38:0/31177652 >> v1:172.21.15.163:6789/0 conn(0x7f40680c7220 legacy=0x7f40680c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f406d60a700 1 -- 172.21.15.38:0/31177652 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680c8620 con 0x7f406817d790 2023-11-06T13:28:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f406d60a700 1 --2- 172.21.15.38:0/31177652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f406817d790 0x7f406817dc20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f4068086260 tx=0x7f4060009840).ready entity=mon.0 client_cookie=37344255b30deac9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f40677fe700 1 -- 172.21.15.38:0/31177652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406000e070 con 0x7f406817d790 2023-11-06T13:28:56.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f40677fe700 1 -- 172.21.15.38:0/31177652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406000ba20 con 0x7f406817d790 2023-11-06T13:28:56.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.654+0000 7f40677fe700 1 -- 172.21.15.38:0/31177652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406000bda0 con 0x7f406817d790 2023-11-06T13:28:56.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 -- 172.21.15.38:0/31177652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f406817d790 msgr2=0x7f406817dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 --2- 172.21.15.38:0/31177652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f406817d790 0x7f406817dc20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f4068086260 tx=0x7f4060009840).stop 2023-11-06T13:28:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 -- 172.21.15.38:0/31177652 shutdown_connections 2023-11-06T13:28:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 --2- 172.21.15.38:0/31177652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f406817d790 0x7f406817dc20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 --2- 172.21.15.38:0/31177652 >> v2:172.21.15.163:3300/0 conn(0x7f4068172240 0x7f4068172620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 -- 172.21.15.38:0/31177652 >> 172.21.15.38:0/31177652 conn(0x7f406805e1b0 msgr2=0x7f406805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 -- 172.21.15.38:0/31177652 shutdown_connections 2023-11-06T13:28:56.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.655+0000 7f406f06d700 1 -- 172.21.15.38:0/31177652 wait complete. 2023-11-06T13:28:56.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.656+0000 7f406f06d700 1 Processor -- start 2023-11-06T13:28:56.665 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.657+0000 7f406f06d700 1 -- start start 2023-11-06T13:28:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40680c7220 0x7f406818f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 0x7f40681686e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f406817d790 0x7f40680c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4068067130 con 0x7f4068172240 2023-11-06T13:28:56.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680c4770 con 0x7f406817d790 2023-11-06T13:28:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406818fca0 con 0x7f40680c7220 2023-11-06T13:28:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 0x7f40681686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 0x7f40681686e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54620/0 (socket says 172.21.15.38:54620) 2023-11-06T13:28:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 -- 172.21.15.38:0/4213095418 learned_addr learned my addr 172.21.15.38:0/4213095418 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406ce09700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40680c7220 0x7f406818f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406d60a700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f406817d790 0x7f40680c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 -- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40680c7220 msgr2=0x7f406818f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40680c7220 0x7f406818f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 -- 172.21.15.38:0/4213095418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f406817d790 msgr2=0x7f40680c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f406817d790 0x7f40680c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 -- 172.21.15.38:0/4213095418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060009ae0 con 0x7f4068172240 2023-11-06T13:28:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406d60a700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f406817d790 0x7f40680c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:28:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4067fff700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 0x7f40681686e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f405400c410 tx=0x7f4054007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4064ff9700 1 -- 172.21.15.38:0/4213095418 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400ce70 con 0x7f4068172240 2023-11-06T13:28:56.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4064ff9700 1 -- 172.21.15.38:0/4213095418 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405400f470 con 0x7f4068172240 2023-11-06T13:28:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f4064ff9700 1 -- 172.21.15.38:0/4213095418 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400f810 con 0x7f4068172240 2023-11-06T13:28:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.658+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4068066e50 con 0x7f4068172240 2023-11-06T13:28:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.659+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40680c4120 con 0x7f4068172240 2023-11-06T13:28:56.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.660+0000 7f4064ff9700 1 -- 172.21.15.38:0/4213095418 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f405400fc00 con 0x7f4068172240 2023-11-06T13:28:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.661+0000 7f4064ff9700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f404c08cba0 0x7f404c08f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.661+0000 7f4064ff9700 1 -- 172.21.15.38:0/4213095418 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f40540b1470 con 0x7f4068172240 2023-11-06T13:28:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.661+0000 7f406ce09700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f404c08cba0 0x7f404c08f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.662+0000 7f406ce09700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f404c08cba0 0x7f404c08f060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f405c009c30 tx=0x7f405c009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.663+0000 7f4080a05b80 1 Processor -- start 2023-11-06T13:28:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.663+0000 7f4080a05b80 1 -- start start 2023-11-06T13:28:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e606f10 0x55b95e88d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 0x55b95e849ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4080a05b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e810050 con 0x55b95e88d970 2023-11-06T13:28:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4080a05b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e7872c0 con 0x55b95e606f10 2023-11-06T13:28:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4080a05b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e79c510 con 0x55b95e84a190 2023-11-06T13:28:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4067fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 0x55b95e849ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4067fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 0x55b95e849ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54626/0 (socket says 172.21.15.38:54626) 2023-11-06T13:28:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f4067fff700 1 -- 172.21.15.38:0/3286981585 learned_addr learned my addr 172.21.15.38:0/3286981585 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f406ce09700 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e606f10 0x55b95e88d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.664+0000 7f406d60a700 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4067fff700 1 -- 172.21.15.38:0/3286981585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 msgr2=0x55b95e88ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4067fff700 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4067fff700 1 -- 172.21.15.38:0/3286981585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e606f10 msgr2=0x55b95e88d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4067fff700 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e606f10 0x55b95e88d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4067fff700 1 -- 172.21.15.38:0/3286981585 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b95e7956f0 con 0x55b95e88d970 2023-11-06T13:28:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4067fff700 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 0x55b95e849ca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4054003f10 tx=0x7f405400feb0).ready entity=mon.0 client_cookie=a143800328073c79 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4051ffb700 1 -- 172.21.15.38:0/3286981585 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054084f90 con 0x55b95e88d970 2023-11-06T13:28:56.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4051ffb700 1 -- 172.21.15.38:0/3286981585 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40540b12c0 con 0x55b95e88d970 2023-11-06T13:28:56.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.665+0000 7f4051ffb700 1 -- 172.21.15.38:0/3286981585 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054085630 con 0x55b95e88d970 2023-11-06T13:28:56.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 -- 172.21.15.38:0/3286981585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 msgr2=0x55b95e849ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 0x55b95e849ca0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4054003f10 tx=0x7f405400feb0).stop 2023-11-06T13:28:56.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 -- 172.21.15.38:0/3286981585 shutdown_connections 2023-11-06T13:28:56.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e606f10 0x55b95e88d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 --2- 172.21.15.38:0/3286981585 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e88d970 0x55b95e849ca0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 -- 172.21.15.38:0/3286981585 >> 172.21.15.38:0/3286981585 conn(0x55b95e6b4570 msgr2=0x55b95e84add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 -- 172.21.15.38:0/3286981585 shutdown_connections 2023-11-06T13:28:56.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.666+0000 7f4080a05b80 1 -- 172.21.15.38:0/3286981585 wait complete. 2023-11-06T13:28:56.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.667+0000 7f4080a05b80 1 -- start start 2023-11-06T13:28:56.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.667+0000 7f4080a05b80 1 Processor -- start 2023-11-06T13:28:56.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e87b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e8cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e79c650 con 0x55b95e606f10 2023-11-06T13:28:56.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e79c8d0 con 0x55b95e84a190 2023-11-06T13:28:56.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e767ee0 con 0x55b95e88d970 2023-11-06T13:28:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4080a05b80 10 client.0 ll_register_callbacks cb 0x55b95e80a450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e87b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e87b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54640/0 (socket says 172.21.15.38:54640) 2023-11-06T13:28:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 -- 172.21.15.38:0/2157343798 learned_addr learned my addr 172.21.15.38:0/2157343798 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406d60a700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4067fff700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e8cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 -- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 msgr2=0x55b95e8ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 -- 172.21.15.38:0/2157343798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 msgr2=0x55b95e8cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e8cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f406ce09700 1 -- 172.21.15.38:0/2157343798 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40680c4120 con 0x55b95e606f10 2023-11-06T13:28:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.668+0000 7f4067fff700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e8cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f406ce09700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e87b230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f405c014770 tx=0x7f405c017000).ready entity=mon.0 client_cookie=bec69db3481f4144 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4046ffd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:56.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4046ffd700 1 -- 172.21.15.38:0/2157343798 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c020440 con 0x55b95e606f10 2023-11-06T13:28:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4046ffd700 1 -- 172.21.15.38:0/2157343798 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f405c0205a0 con 0x55b95e606f10 2023-11-06T13:28:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b95e83e710 con 0x55b95e606f10 2023-11-06T13:28:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4046ffd700 1 -- 172.21.15.38:0/2157343798 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f405c0209c0 con 0x55b95e606f10 2023-11-06T13:28:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4080a05b80 10 client.5172 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:56.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b95e790a90 con 0x55b95e606f10 2023-11-06T13:28:56.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.669+0000 7f4046ffd700 1 -- 172.21.15.38:0/2157343798 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b95e83e710 con 0x55b95e606f10 2023-11-06T13:28:56.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4046ffd700 1 -- 172.21.15.38:0/2157343798 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f405c020b20 con 0x55b95e606f10 2023-11-06T13:28:56.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4080a05b80 10 client.5172 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:56.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4080a05b80 10 client.5172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:56.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4080a05b80 20 client.5172 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:56.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e889f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4080a05b80 4 client.5172 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:56.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b95e602d70 con 0x55b95e8b9640 2023-11-06T13:28:56.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.670+0000 7f4067fff700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e889f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4046ffd700 10 client.5172 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4067fff700 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e889f80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eb174232db9cff06 server_cookie=853a573c5d833f8b in_seq=0 out_seq=0 2023-11-06T13:28:56.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4046ffd700 1 -- 172.21.15.38:0/2157343798 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55b95e602d70 con 0x55b95e8b9640 2023-11-06T13:28:56.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4046ffd700 10 client.5172 handle_command_reply: tid=0 2023-11-06T13:28:56.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4080a05b80 1 client.5172 shutdown 2023-11-06T13:28:56.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 msgr2=0x55b95e87b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.671+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e87b230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f405c014770 tx=0x7f405c017000).stop 2023-11-06T13:28:56.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 shutdown_connections 2023-11-06T13:28:56.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e889f80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4046ffd700 0 client.5172 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e87b230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2157343798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e8cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 >> 172.21.15.38:0/2157343798 conn(0x55b95e6b4570 msgr2=0x55b95e88ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 shutdown_connections 2023-11-06T13:28:56.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 1 -- 172.21.15.38:0/2157343798 wait complete. 2023-11-06T13:28:56.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.672+0000 7f4080a05b80 20 client.5172 trim_cache size 0 max 16384 2023-11-06T13:28:56.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.688+0000 7f4080a05b80 1 Processor -- start 2023-11-06T13:28:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.689+0000 7f4080a05b80 1 -- start start 2023-11-06T13:28:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.689+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e88ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f4080a05b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e8cc120 con 0x55b95e606f10 2023-11-06T13:28:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f4080a05b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e8925e0 con 0x55b95e88d970 2023-11-06T13:28:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f4080a05b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e8b8ed0 con 0x55b95e84a190 2023-11-06T13:28:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e88ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e88ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54654/0 (socket says 172.21.15.38:54654) 2023-11-06T13:28:56.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 -- 172.21.15.38:0/2709239900 learned_addr learned my addr 172.21.15.38:0/2709239900 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406d60a700 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f4067fff700 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 -- 172.21.15.38:0/2709239900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 msgr2=0x55b95e88d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 -- 172.21.15.38:0/2709239900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e88d970 msgr2=0x55b95e8ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 -- 172.21.15.38:0/2709239900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b95e7907e0 con 0x55b95e606f10 2023-11-06T13:28:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f406ce09700 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e88ca80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f405c009190 tx=0x7f405c026000).ready entity=mon.0 client_cookie=db8c24392d0f56d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f40527fc700 1 -- 172.21.15.38:0/2709239900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c006a40 con 0x55b95e606f10 2023-11-06T13:28:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f40527fc700 1 -- 172.21.15.38:0/2709239900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c038070 con 0x55b95e606f10 2023-11-06T13:28:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.690+0000 7f40527fc700 1 -- 172.21.15.38:0/2709239900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c014e10 con 0x55b95e606f10 2023-11-06T13:28:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 -- 172.21.15.38:0/2709239900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 msgr2=0x55b95e88ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e88ca80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f405c009190 tx=0x7f405c026000).stop 2023-11-06T13:28:56.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 -- 172.21.15.38:0/2709239900 shutdown_connections 2023-11-06T13:28:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e88d970 0x55b95e8ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e88ca80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 --2- 172.21.15.38:0/2709239900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e84a190 0x55b95e88d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 -- 172.21.15.38:0/2709239900 >> 172.21.15.38:0/2709239900 conn(0x55b95e6b4570 msgr2=0x55b95e87b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 -- 172.21.15.38:0/2709239900 shutdown_connections 2023-11-06T13:28:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.691+0000 7f4080a05b80 1 -- 172.21.15.38:0/2709239900 wait complete. 2023-11-06T13:28:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.692+0000 7f4080a05b80 1 -- start start 2023-11-06T13:28:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.692+0000 7f4080a05b80 1 Processor -- start 2023-11-06T13:28:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e850790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e879f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e921a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e850020 con 0x55b95e606f10 2023-11-06T13:28:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e850300 con 0x55b95e84a190 2023-11-06T13:28:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95e91e9b0 con 0x55b95e88d970 2023-11-06T13:28:56.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f4080a05b80 10 client.0 ll_register_callbacks cb 0x55b95e80a450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f406ce09700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e850790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f406ce09700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e850790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54656/0 (socket says 172.21.15.38:54656) 2023-11-06T13:28:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.693+0000 7f406ce09700 1 -- 172.21.15.38:0/497101794 learned_addr learned my addr 172.21.15.38:0/497101794 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406d60a700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e921a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4067fff700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e879f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406ce09700 1 -- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 msgr2=0x55b95e921a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406ce09700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e921a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406ce09700 1 -- 172.21.15.38:0/497101794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 msgr2=0x55b95e879f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406ce09700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e879f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406ce09700 1 -- 172.21.15.38:0/497101794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b95e790a90 con 0x55b95e606f10 2023-11-06T13:28:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4067fff700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e879f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:28:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f406ce09700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e850790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f405c009160 tx=0x7f405c036070).ready entity=mon.0 client_cookie=fbe2f38df23fe58e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4046ffd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4046ffd700 1 -- 172.21.15.38:0/497101794 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0209c0 con 0x55b95e606f10 2023-11-06T13:28:56.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40540b12c0 con 0x55b95e606f10 2023-11-06T13:28:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4046ffd700 1 -- 172.21.15.38:0/497101794 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f405c020b20 con 0x55b95e606f10 2023-11-06T13:28:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4046ffd700 1 -- 172.21.15.38:0/497101794 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f405c005a90 con 0x55b95e606f10 2023-11-06T13:28:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4080a05b80 10 client.5178 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b95e608050 con 0x55b95e606f10 2023-11-06T13:28:56.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.694+0000 7f4046ffd700 1 -- 172.21.15.38:0/497101794 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40540b12c0 con 0x55b95e606f10 2023-11-06T13:28:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4046ffd700 1 -- 172.21.15.38:0/497101794 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f405c005bf0 con 0x55b95e606f10 2023-11-06T13:28:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4080a05b80 10 client.5178 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4080a05b80 10 client.5178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4080a05b80 20 client.5178 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:56.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4080a05b80 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e88df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4080a05b80 4 client.5178 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:28:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b95e639d70 con 0x55b95e8b9640 2023-11-06T13:28:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4067fff700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e88df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4046ffd700 10 client.5178 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.695+0000 7f4067fff700 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e88df60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5f3b6243ea749bf0 server_cookie=b4220d8f7ecb1ff1 in_seq=0 out_seq=0 2023-11-06T13:28:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4046ffd700 1 -- 172.21.15.38:0/497101794 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b95e639d70 con 0x55b95e8b9640 2023-11-06T13:28:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4046ffd700 10 client.5178 handle_command_reply: tid=0 2023-11-06T13:28:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 client.5178 shutdown 2023-11-06T13:28:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 msgr2=0x55b95e850790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e850790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f405c009160 tx=0x7f405c036070).stop 2023-11-06T13:28:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 shutdown_connections 2023-11-06T13:28:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55b95e8b9640 0x55b95e88df60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b95e88d970 0x55b95e921a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55b95e606f10 0x55b95e850790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 --2- 172.21.15.38:0/497101794 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b95e84a190 0x55b95e879f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 >> 172.21.15.38:0/497101794 conn(0x55b95e6b4570 msgr2=0x55b95e88ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4046ffd700 0 client.5178 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 shutdown_connections 2023-11-06T13:28:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 1 -- 172.21.15.38:0/497101794 wait complete. 2023-11-06T13:28:56.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.697+0000 7f4080a05b80 20 client.5178 trim_cache size 0 max 16384 2023-11-06T13:28:56.719 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:56.719 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:28:56.719 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "813c126d-8c2d-4e4a-b1c4-f3921cfec113", 2023-11-06T13:28:56.720 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:28:56.720 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:56.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f404c08cba0 msgr2=0x7f404c08f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f404c08cba0 0x7f404c08f060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f405c009c30 tx=0x7f405c009060).stop 2023-11-06T13:28:56.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 msgr2=0x7f40681686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 0x7f40681686e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f405400c410 tx=0x7f4054007d90).stop 2023-11-06T13:28:56.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 shutdown_connections 2023-11-06T13:28:56.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f404c08cba0 0x7f404c08f060 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f406817d790 0x7f40680c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40680c7220 0x7f406818f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 --2- 172.21.15.38:0/4213095418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f4068172240 0x7f40681686e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 >> 172.21.15.38:0/4213095418 conn(0x7f406805e1b0 msgr2=0x7f4068063110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 shutdown_connections 2023-11-06T13:28:56.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.698+0000 7f406f06d700 1 -- 172.21.15.38:0/4213095418 wait complete. 2023-11-06T13:28:56.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:28:56.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.844+0000 7f0371694700 1 Processor -- start 2023-11-06T13:28:56.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.844+0000 7f0371694700 1 -- start start 2023-11-06T13:28:56.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f0371694700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f036c15a870 0x7f036c17f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f0371694700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c0e9b00 con 0x7f036c17f650 2023-11-06T13:28:56.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f0371694700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c06a9f0 con 0x7f036c180880 2023-11-06T13:28:56.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f0371694700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0e8c50 con 0x7f036c15a870 2023-11-06T13:28:56.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f036affd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f036c15a870 0x7f036c17f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f036affd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f036c15a870 0x7f036c17f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:47104/0 (socket says 172.21.15.38:47104) 2023-11-06T13:28:56.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f036affd700 1 -- 172.21.15.38:0/477967340 learned_addr learned my addr 172.21.15.38:0/477967340 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f036a7fc700 1 --1- 172.21.15.38:0/477967340 >> v1:172.21.15.44:6789/0 conn(0x7f036c17f650 0x7f036c180170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:54222/0 (socket says 172.21.15.38:54222) 2023-11-06T13:28:56.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.845+0000 7f036b7fe700 1 --1- 172.21.15.38:0/477967340 >> v1:172.21.15.163:6789/0 conn(0x7f036c180880 0x7f036c182100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:43546/0 (socket says 172.21.15.38:43546) 2023-11-06T13:28:56.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f0369ffb700 1 -- 172.21.15.38:0/477967340 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175437367 0 0) 0x7f036c0e9b00 con 0x7f036c17f650 2023-11-06T13:28:56.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f0369ffb700 1 -- 172.21.15.38:0/477967340 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03540033f0 con 0x7f036c17f650 2023-11-06T13:28:56.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f036affd700 1 -- 172.21.15.38:0/477967340 >> v1:172.21.15.163:6789/0 conn(0x7f036c180880 legacy=0x7f036c182100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f036affd700 1 -- 172.21.15.38:0/477967340 >> v1:172.21.15.44:6789/0 conn(0x7f036c17f650 legacy=0x7f036c180170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f036affd700 1 -- 172.21.15.38:0/477967340 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0e8ef0 con 0x7f036c15a870 2023-11-06T13:28:56.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f036affd700 1 --2- 172.21.15.38:0/477967340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c17f160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f035c006fd0 tx=0x7f035c0090f0).ready entity=mon.2 client_cookie=418202c7f7022df5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f0369ffb700 1 -- 172.21.15.38:0/477967340 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00b580 con 0x7f036c15a870 2023-11-06T13:28:56.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f0369ffb700 1 -- 172.21.15.38:0/477967340 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c00b6e0 con 0x7f036c15a870 2023-11-06T13:28:56.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.846+0000 7f0369ffb700 1 -- 172.21.15.38:0/477967340 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00ba60 con 0x7f036c15a870 2023-11-06T13:28:56.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 -- 172.21.15.38:0/477967340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 msgr2=0x7f036c17f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 --2- 172.21.15.38:0/477967340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c17f160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f035c006fd0 tx=0x7f035c0090f0).stop 2023-11-06T13:28:56.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 -- 172.21.15.38:0/477967340 shutdown_connections 2023-11-06T13:28:56.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 --2- 172.21.15.38:0/477967340 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c17f160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 -- 172.21.15.38:0/477967340 >> 172.21.15.38:0/477967340 conn(0x7f036c05e1b0 msgr2=0x7f036c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 -- 172.21.15.38:0/477967340 shutdown_connections 2023-11-06T13:28:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.847+0000 7f0371694700 1 -- 172.21.15.38:0/477967340 wait complete. 2023-11-06T13:28:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.848+0000 7f0371694700 1 Processor -- start 2023-11-06T13:28:56.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.848+0000 7f0371694700 1 -- start start 2023-11-06T13:28:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.849+0000 7f0371694700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.849+0000 7f0371694700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c17f650 0x7f036c176170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.849+0000 7f0371694700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 0x7f036c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.849+0000 7f0371694700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c157010 con 0x7f036c180880 2023-11-06T13:28:56.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.849+0000 7f0371694700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1572f0 con 0x7f036c17f650 2023-11-06T13:28:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.849+0000 7f0371694700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c18efc0 con 0x7f036c15a870 2023-11-06T13:28:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 0x7f036c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 0x7f036c157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54662/0 (socket says 172.21.15.38:54662) 2023-11-06T13:28:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 -- 172.21.15.38:0/2970721014 learned_addr learned my addr 172.21.15.38:0/2970721014 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036a7fc700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c17f650 0x7f036c176170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036affd700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 -- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 msgr2=0x7f036c154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 -- 172.21.15.38:0/2970721014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c17f650 msgr2=0x7f036c176170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c17f650 0x7f036c176170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 -- 172.21.15.38:0/2970721014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c009370 con 0x7f036c180880 2023-11-06T13:28:56.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f036b7fe700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 0x7f036c157780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f036400c7c0 tx=0x7f0364001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f0352ffd700 1 -- 172.21.15.38:0/2970721014 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0364005c70 con 0x7f036c180880 2023-11-06T13:28:56.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f0352ffd700 1 -- 172.21.15.38:0/2970721014 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0364005dd0 con 0x7f036c180880 2023-11-06T13:28:56.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c18f2a0 con 0x7f036c180880 2023-11-06T13:28:56.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f0352ffd700 1 -- 172.21.15.38:0/2970721014 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03640072e0 con 0x7f036c180880 2023-11-06T13:28:56.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.850+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c18f860 con 0x7f036c180880 2023-11-06T13:28:56.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.853+0000 7f0352ffd700 1 -- 172.21.15.38:0/2970721014 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f03640076d0 con 0x7f036c180880 2023-11-06T13:28:56.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.853+0000 7f0352ffd700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f035808cba0 0x7f035808f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.854+0000 7f0352ffd700 1 -- 172.21.15.38:0/2970721014 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f03640b19d0 con 0x7f036c180880 2023-11-06T13:28:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.854+0000 7f036affd700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f035808cba0 0x7f035808f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.854+0000 7f036affd700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f035808cba0 0x7f035808f060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f035c009fd0 tx=0x7f035c017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.855+0000 7f038302cb80 1 Processor -- start 2023-11-06T13:28:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.855+0000 7f038302cb80 1 -- start start 2023-11-06T13:28:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f038302cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c643460e90 0x55c6436e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f038302cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 0x55c6436ed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f038302cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436ed7f0 0x55c6436edc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f038302cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c643669fd0 con 0x55c6436e59a0 2023-11-06T13:28:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f038302cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6435e1240 con 0x55c643460e90 2023-11-06T13:28:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f038302cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6435f6490 con 0x55c6436ed7f0 2023-11-06T13:28:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 0x55c6436ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 0x55c6436ed300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54668/0 (socket says 172.21.15.38:54668) 2023-11-06T13:28:56.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 -- 172.21.15.38:0/2168685217 learned_addr learned my addr 172.21.15.38:0/2168685217 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036b7fe700 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436ed7f0 0x55c6436edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036affd700 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c643460e90 0x55c6436e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 -- 172.21.15.38:0/2168685217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436ed7f0 msgr2=0x55c6436edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436ed7f0 0x55c6436edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 -- 172.21.15.38:0/2168685217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c643460e90 msgr2=0x55c6436e54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c643460e90 0x55c6436e54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 -- 172.21.15.38:0/2168685217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6435ef670 con 0x55c6436e59a0 2023-11-06T13:28:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.856+0000 7f036a7fc700 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 0x55c6436ed300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f03600074a0 tx=0x7f0360007bc0).ready entity=mon.0 client_cookie=36d6ba08bb451d27 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f034bfff700 1 -- 172.21.15.38:0/2168685217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360007110 con 0x55c6436e59a0 2023-11-06T13:28:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f034bfff700 1 -- 172.21.15.38:0/2168685217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0360015410 con 0x55c6436e59a0 2023-11-06T13:28:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f034bfff700 1 -- 172.21.15.38:0/2168685217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0360015790 con 0x55c6436e59a0 2023-11-06T13:28:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 -- 172.21.15.38:0/2168685217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 msgr2=0x55c6436ed300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 0x55c6436ed300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f03600074a0 tx=0x7f0360007bc0).stop 2023-11-06T13:28:56.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 -- 172.21.15.38:0/2168685217 shutdown_connections 2023-11-06T13:28:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436ed7f0 0x55c6436edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c643460e90 0x55c6436e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 --2- 172.21.15.38:0/2168685217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436e59a0 0x55c6436ed300 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 -- 172.21.15.38:0/2168685217 >> 172.21.15.38:0/2168685217 conn(0x55c64350e4f0 msgr2=0x55c6436a46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 -- 172.21.15.38:0/2168685217 shutdown_connections 2023-11-06T13:28:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.857+0000 7f038302cb80 1 -- 172.21.15.38:0/2168685217 wait complete. 2023-11-06T13:28:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.858+0000 7f038302cb80 1 -- start start 2023-11-06T13:28:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.858+0000 7f038302cb80 1 Processor -- start 2023-11-06T13:28:56.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.859+0000 7f038302cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6436e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.859+0000 7f038302cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c6436dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.859+0000 7f038302cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436de820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.859+0000 7f038302cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6435f65d0 con 0x55c6436ed7f0 2023-11-06T13:28:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.859+0000 7f038302cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6435f6850 con 0x55c6436e59a0 2023-11-06T13:28:56.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.859+0000 7f038302cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6435c1e60 con 0x55c643460e90 2023-11-06T13:28:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f038302cb80 10 client.0 ll_register_callbacks cb 0x55c6436645b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54684/0 (socket says 172.21.15.38:54684) 2023-11-06T13:28:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036a7fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c6436dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 -- 172.21.15.38:0/1330752475 learned_addr learned my addr 172.21.15.38:0/1330752475 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036affd700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6436e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 -- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 msgr2=0x55c6436e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6436e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 -- 172.21.15.38:0/1330752475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 msgr2=0x55c6436dfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c6436dfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 -- 172.21.15.38:0/1330752475 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540033f0 con 0x55c6436ed7f0 2023-11-06T13:28:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036a7fc700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c6436dfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:28:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f036b7fe700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436de820 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f03640af580 tx=0x7f0364007a30).ready entity=mon.0 client_cookie=6a2ceb7cad7e7ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f03497fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:56.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f03497fa700 1 -- 172.21.15.38:0/1330752475 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036408b470 con 0x55c6436ed7f0 2023-11-06T13:28:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f03497fa700 1 -- 172.21.15.38:0/1330752475 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f0364085080 con 0x55c6436ed7f0 2023-11-06T13:28:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c643698690 con 0x55c6436ed7f0 2023-11-06T13:28:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f03497fa700 1 -- 172.21.15.38:0/1330752475 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f036408afe0 con 0x55c6436ed7f0 2023-11-06T13:28:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f038302cb80 10 client.5187 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:56.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.860+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c6435eaa10 con 0x55c6436ed7f0 2023-11-06T13:28:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f03497fa700 1 -- 172.21.15.38:0/1330752475 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c643698690 con 0x55c6436ed7f0 2023-11-06T13:28:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f03497fa700 1 -- 172.21.15.38:0/1330752475 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f036401bbd0 con 0x55c6436ed7f0 2023-11-06T13:28:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f038302cb80 10 client.5187 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f038302cb80 10 client.5187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:56.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f038302cb80 20 client.5187 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f038302cb80 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c643722ec0 0x55c6437232d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f038302cb80 4 client.5187 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:28:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c64345ccf0 con 0x55c643722ec0 2023-11-06T13:28:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.861+0000 7f036affd700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c643722ec0 0x55c6437232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f03497fa700 10 client.5187 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f036affd700 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c643722ec0 0x55c6437232d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8d02b713a67a4252 server_cookie=619e306e2a83f62c in_seq=0 out_seq=0 2023-11-06T13:28:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f03497fa700 1 -- 172.21.15.38:0/1330752475 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55c64345ccf0 con 0x55c643722ec0 2023-11-06T13:28:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f03497fa700 10 client.5187 handle_command_reply: tid=0 2023-11-06T13:28:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 client.5187 shutdown 2023-11-06T13:28:56.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 msgr2=0x55c6436de820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436de820 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f03640af580 tx=0x7f0364007a30).stop 2023-11-06T13:28:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 shutdown_connections 2023-11-06T13:28:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436de820 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c643722ec0 0x55c6437232d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6436e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f03497fa700 0 client.5187 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 --2- 172.21.15.38:0/1330752475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c6436dfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.862+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 >> 172.21.15.38:0/1330752475 conn(0x55c64350e4f0 msgr2=0x55c6436a4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.863+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 shutdown_connections 2023-11-06T13:28:56.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.863+0000 7f038302cb80 1 -- 172.21.15.38:0/1330752475 wait complete. 2023-11-06T13:28:56.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.863+0000 7f038302cb80 20 client.5187 trim_cache size 0 max 16384 2023-11-06T13:28:56.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:28:56.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.879+0000 7f038302cb80 1 Processor -- start 2023-11-06T13:28:56.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.879+0000 7f038302cb80 1 -- start start 2023-11-06T13:28:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f038302cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 0x55c643710850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f038302cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436e59a0 0x55c643723d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f038302cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436ed7f0 0x55c6437228d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f038302cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64369c190 con 0x55c643460e90 2023-11-06T13:28:56.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f038302cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6437148b0 con 0x55c6436ed7f0 2023-11-06T13:28:56.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f038302cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6436a34b0 con 0x55c6436e59a0 2023-11-06T13:28:56.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 0x55c643710850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 0x55c643710850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54690/0 (socket says 172.21.15.38:54690) 2023-11-06T13:28:56.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 -- 172.21.15.38:0/3129923951 learned_addr learned my addr 172.21.15.38:0/3129923951 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036a7fc700 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436e59a0 0x55c643723d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036b7fe700 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436ed7f0 0x55c6437228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 -- 172.21.15.38:0/3129923951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436e59a0 msgr2=0x55c643723d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436e59a0 0x55c643723d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 -- 172.21.15.38:0/3129923951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436ed7f0 msgr2=0x55c6437228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436ed7f0 0x55c6437228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 -- 172.21.15.38:0/3129923951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6435ea760 con 0x55c643460e90 2023-11-06T13:28:56.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f036affd700 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 0x55c643710850 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f036c086140 tx=0x7f035c031280).ready entity=mon.0 client_cookie=a26e9cae8e2949bf server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f0350ff9700 1 -- 172.21.15.38:0/3129923951 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c01d890 con 0x55c643460e90 2023-11-06T13:28:56.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f0350ff9700 1 -- 172.21.15.38:0/3129923951 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c01d9f0 con 0x55c643460e90 2023-11-06T13:28:56.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.880+0000 7f0350ff9700 1 -- 172.21.15.38:0/3129923951 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c01db60 con 0x55c643460e90 2023-11-06T13:28:56.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 -- 172.21.15.38:0/3129923951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 msgr2=0x55c643710850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 0x55c643710850 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f036c086140 tx=0x7f035c031280).stop 2023-11-06T13:28:56.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 -- 172.21.15.38:0/3129923951 shutdown_connections 2023-11-06T13:28:56.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436ed7f0 0x55c6437228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c643460e90 0x55c643710850 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 --2- 172.21.15.38:0/3129923951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c6436e59a0 0x55c643723d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 -- 172.21.15.38:0/3129923951 >> 172.21.15.38:0/3129923951 conn(0x55c64350e4f0 msgr2=0x55c6436abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 -- 172.21.15.38:0/3129923951 shutdown_connections 2023-11-06T13:28:56.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.881+0000 7f038302cb80 1 -- 172.21.15.38:0/3129923951 wait complete. 2023-11-06T13:28:56.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.882+0000 7f038302cb80 1 -- start start 2023-11-06T13:28:56.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.882+0000 7f038302cb80 1 Processor -- start 2023-11-06T13:28:56.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6437237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c643709cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6436aad60 con 0x55c6436ed7f0 2023-11-06T13:28:56.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c64377cfb0 con 0x55c6436e59a0 2023-11-06T13:28:56.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6436d1cc0 con 0x55c643460e90 2023-11-06T13:28:56.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f038302cb80 10 client.0 ll_register_callbacks cb 0x55c6436645b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:28:56.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f036b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f036b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436df7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54692/0 (socket says 172.21.15.38:54692) 2023-11-06T13:28:56.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f036b7fe700 1 -- 172.21.15.38:0/803250206 learned_addr learned my addr 172.21.15.38:0/803250206 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:28:56.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.883+0000 7f036affd700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6437237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036a7fc700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c643709cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036b7fe700 1 -- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 msgr2=0x55c6437237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036b7fe700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6437237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036b7fe700 1 -- 172.21.15.38:0/803250206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 msgr2=0x55c643709cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:28:56.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036b7fe700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c643709cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036b7fe700 1 -- 172.21.15.38:0/803250206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c0e8ef0 con 0x55c6436ed7f0 2023-11-06T13:28:56.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f036b7fe700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436df7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f0364085b20 tx=0x7f036408d000).ready entity=mon.0 client_cookie=cec62c222de18c6a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:28:56.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f03497fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:28:56.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f03497fa700 1 -- 172.21.15.38:0/803250206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036400e040 con 0x55c6436ed7f0 2023-11-06T13:28:56.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0360015410 con 0x55c6436ed7f0 2023-11-06T13:28:56.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f03497fa700 1 -- 172.21.15.38:0/803250206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f0364085080 con 0x55c6436ed7f0 2023-11-06T13:28:56.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f03497fa700 1 -- 172.21.15.38:0/803250206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f036408b470 con 0x55c6436ed7f0 2023-11-06T13:28:56.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f038302cb80 10 client.5193 fetch_fsmap learned FSMap version 17 2023-11-06T13:28:56.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c643461fd0 con 0x55c6436ed7f0 2023-11-06T13:28:56.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.884+0000 7f03497fa700 1 -- 172.21.15.38:0/803250206 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0360015410 con 0x55c6436ed7f0 2023-11-06T13:28:56.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f03497fa700 1 -- 172.21.15.38:0/803250206 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f036408afe0 con 0x55c6436ed7f0 2023-11-06T13:28:56.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 10 client.5193 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:28:56.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 10 client.5193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:28:56.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 20 client.5193 populate_metadata read hostname 'smithi038' 2023-11-06T13:28:56.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c6436a5920 0x55c6436aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:28:56.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 4 client.5193 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:28:56.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c643493cf0 con 0x55c6436a5920 2023-11-06T13:28:56.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f036affd700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c6436a5920 0x55c6436aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:28:56.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f03497fa700 10 client.5193 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f036affd700 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c6436a5920 0x55c6436aa1a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de33376f702f8924 server_cookie=61d0dda9a7cf7c13 in_seq=0 out_seq=0 2023-11-06T13:28:56.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f03497fa700 1 -- 172.21.15.38:0/803250206 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c643493cf0 con 0x55c6436a5920 2023-11-06T13:28:56.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f03497fa700 10 client.5193 handle_command_reply: tid=0 2023-11-06T13:28:56.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.885+0000 7f038302cb80 1 client.5193 shutdown 2023-11-06T13:28:56.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 msgr2=0x55c6436df7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436df7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f0364085b20 tx=0x7f036408d000).stop 2023-11-06T13:28:56.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 shutdown_connections 2023-11-06T13:28:56.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c6436ed7f0 0x55c6436df7a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c6436a5920 0x55c6436aa1a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c643460e90 0x55c6437237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 --2- 172.21.15.38:0/803250206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c6436e59a0 0x55c643709cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f03497fa700 0 client.5193 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:28:56.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 >> 172.21.15.38:0/803250206 conn(0x55c64350e4f0 msgr2=0x55c6436ed080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 shutdown_connections 2023-11-06T13:28:56.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 1 -- 172.21.15.38:0/803250206 wait complete. 2023-11-06T13:28:56.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f038302cb80 20 client.5193 trim_cache size 0 max 16384 2023-11-06T13:28:56.912 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:28:56.912 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:28:56.912 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:28:56.912 INFO:teuthology.orchestra.run.smithi038.stdout: "813c126d-8c2d-4e4a-b1c4-f3921cfec113": { 2023-11-06T13:28:56.912 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:28:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "813c126d-8c2d-4e4a-b1c4-f3921cfec113", 2023-11-06T13:28:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:28:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:28:56.913 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:28:56.913 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:28:56.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f035808cba0 msgr2=0x7f035808f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f035808cba0 0x7f035808f060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f035c009fd0 tx=0x7f035c017000).stop 2023-11-06T13:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 msgr2=0x7f036c157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 0x7f036c157780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f036400c7c0 tx=0x7f0364001510).stop 2023-11-06T13:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 shutdown_connections 2023-11-06T13:28:56.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f036c180880 0x7f036c157780 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f036c15a870 0x7f036c154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f035808cba0 0x7f035808f060 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 --2- 172.21.15.38:0/2970721014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f036c17f650 0x7f036c176170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.886+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 >> 172.21.15.38:0/2970721014 conn(0x7f036c05e1b0 msgr2=0x7f036c176bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:28:56.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.887+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 shutdown_connections 2023-11-06T13:28:56.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:28:56.887+0000 7f0371694700 1 -- 172.21.15.38:0/2970721014 wait complete. 2023-11-06T13:28:56.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:28:56.919 INFO:tasks.cephfs.filesystem:scrub status for tag:813c126d-8c2d-4e4a-b1c4-f3921cfec113 - {'path': '/', 'tag': '813c126d-8c2d-4e4a-b1c4-f3921cfec113', 'options': 'recursive,force'} 2023-11-06T13:28:56.921 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:26.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:29:27.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:27.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.041+0000 7f98bcc74700 1 Processor -- start 2023-11-06T13:29:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.041+0000 7f98bcc74700 1 -- start start 2023-11-06T13:29:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98bcc74700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f98b8178aa0 0x7f98b8181780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98bcc74700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f98b80eca20 0x7f98b8181c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98bcc74700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f98b8178e80 0x7f98b8062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98bcc74700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b81831a0 con 0x7f98b8178aa0 2023-11-06T13:29:27.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98bcc74700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b81812f0 con 0x7f98b8178e80 2023-11-06T13:29:27.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98bcc74700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b8180120 con 0x7f98b80eca20 2023-11-06T13:29:27.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.042+0000 7f98b659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f98b8178aa0 0x7f98b8181780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f98b8178aa0 0x7f98b8181780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34206/0 (socket says 172.21.15.38:34206) 2023-11-06T13:29:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 -- 172.21.15.38:0/526510083 learned_addr learned my addr 172.21.15.38:0/526510083 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b6d9d700 1 --2- 172.21.15.38:0/526510083 >> v2:172.21.15.44:3300/0 conn(0x7f98b8178e80 0x7f98b8062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/526510083 >> v2:172.21.15.163:3300/0 conn(0x7f98b80eca20 0x7f98b8181c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 -- 172.21.15.38:0/526510083 >> v2:172.21.15.163:3300/0 conn(0x7f98b80eca20 msgr2=0x7f98b8181c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 --2- 172.21.15.38:0/526510083 >> v2:172.21.15.163:3300/0 conn(0x7f98b80eca20 0x7f98b8181c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 -- 172.21.15.38:0/526510083 >> v2:172.21.15.44:3300/0 conn(0x7f98b8178e80 msgr2=0x7f98b8062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 --2- 172.21.15.38:0/526510083 >> v2:172.21.15.44:3300/0 conn(0x7f98b8178e80 0x7f98b8062770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 -- 172.21.15.38:0/526510083 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8180400 con 0x7f98b8178aa0 2023-11-06T13:29:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b659c700 1 --2- 172.21.15.38:0/526510083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b8178aa0 0x7f98b8181780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f98b805f270 tx=0x7f98a8009840).ready entity=mon.0 client_cookie=d24e53ed5f9a335d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b559a700 1 -- 172.21.15.38:0/526510083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800e070 con 0x7f98b8178aa0 2023-11-06T13:29:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b559a700 1 -- 172.21.15.38:0/526510083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a800b9f0 con 0x7f98b8178aa0 2023-11-06T13:29:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.043+0000 7f98b559a700 1 -- 172.21.15.38:0/526510083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800bd70 con 0x7f98b8178aa0 2023-11-06T13:29:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 -- 172.21.15.38:0/526510083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b8178aa0 msgr2=0x7f98b8181780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 --2- 172.21.15.38:0/526510083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b8178aa0 0x7f98b8181780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f98b805f270 tx=0x7f98a8009840).stop 2023-11-06T13:29:27.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 -- 172.21.15.38:0/526510083 shutdown_connections 2023-11-06T13:29:27.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 --2- 172.21.15.38:0/526510083 >> v2:172.21.15.44:3300/0 conn(0x7f98b8178e80 0x7f98b8062770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 --2- 172.21.15.38:0/526510083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b8178aa0 0x7f98b8181780 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 --2- 172.21.15.38:0/526510083 >> v2:172.21.15.163:3300/0 conn(0x7f98b80eca20 0x7f98b8181c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 -- 172.21.15.38:0/526510083 >> 172.21.15.38:0/526510083 conn(0x7f98b80ef5b0 msgr2=0x7f98b805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:27.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 -- 172.21.15.38:0/526510083 shutdown_connections 2023-11-06T13:29:27.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.044+0000 7f98bcc74700 1 -- 172.21.15.38:0/526510083 wait complete. 2023-11-06T13:29:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.046+0000 7f98bcc74700 1 Processor -- start 2023-11-06T13:29:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.046+0000 7f98bcc74700 1 -- start start 2023-11-06T13:29:27.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 0x7f98b80f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98b8178aa0 0x7f98b80e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98b8178e80 0x7f98b81690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b816e490 con 0x7f98b80eca20 2023-11-06T13:29:27.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b816e1b0 con 0x7f98b8178aa0 2023-11-06T13:29:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b80effe0 con 0x7f98b8178e80 2023-11-06T13:29:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 0x7f98b80f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 0x7f98b80f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34216/0 (socket says 172.21.15.38:34216) 2023-11-06T13:29:27.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 -- 172.21.15.38:0/3516145257 learned_addr learned my addr 172.21.15.38:0/3516145257 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:27.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98b8178aa0 0x7f98b80e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 -- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98b8178e80 msgr2=0x7f98b81690e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-06T13:29:27.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98b8178e80 0x7f98b81690e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:27.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 -- 172.21.15.38:0/3516145257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98b8178aa0 msgr2=0x7f98b80e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98b8178aa0 0x7f98b80e5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 -- 172.21.15.38:0/3516145257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a8009ae0 con 0x7f98b80eca20 2023-11-06T13:29:27.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98b8178aa0 0x7f98b80e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:29:27.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98b659c700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 0x7f98b80f0da0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f98b8067550 tx=0x7f98a8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98a67fc700 1 -- 172.21.15.38:0/3516145257 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800b6c0 con 0x7f98b80eca20 2023-11-06T13:29:27.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98a67fc700 1 -- 172.21.15.38:0/3516145257 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a800bb60 con 0x7f98b80eca20 2023-11-06T13:29:27.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b80f02c0 con 0x7f98b80eca20 2023-11-06T13:29:27.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.048+0000 7f98a67fc700 1 -- 172.21.15.38:0/3516145257 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a801d620 con 0x7f98b80eca20 2023-11-06T13:29:27.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.049+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b80f0880 con 0x7f98b80eca20 2023-11-06T13:29:27.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.051+0000 7f98a67fc700 1 -- 172.21.15.38:0/3516145257 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7f98a801d990 con 0x7f98b80eca20 2023-11-06T13:29:27.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.051+0000 7f98a67fc700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f989808cbd0 0x7f989808f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.052+0000 7f98a67fc700 1 -- 172.21.15.38:0/3516145257 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f98a80b3af0 con 0x7f98b80eca20 2023-11-06T13:29:27.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.052+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f989808cbd0 0x7f989808f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.052+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f989808cbd0 0x7f989808f090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f98b805e730 tx=0x7f98ac008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.053+0000 7f98ce60cb80 1 Processor -- start 2023-11-06T13:29:27.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.053+0000 7f98ce60cb80 1 -- start start 2023-11-06T13:29:27.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be482400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be43ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be404fd0 con 0x55d7be43f110 2023-11-06T13:29:27.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be37c240 con 0x55d7be4828f0 2023-11-06T13:29:27.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be391490 con 0x55d7be1fbe90 2023-11-06T13:29:27.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be43ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be482400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34228/0 (socket says 172.21.15.38:34228) 2023-11-06T13:29:27.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be43ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:51988/0 (socket says 172.21.15.38:51988) 2023-11-06T13:29:27.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b6d9d700 1 -- 172.21.15.38:0/2537393022 learned_addr learned my addr 172.21.15.38:0/2537393022 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:27.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 -- 172.21.15.38:0/2537393022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 msgr2=0x55d7be482400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be482400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 -- 172.21.15.38:0/2537393022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 msgr2=0x55d7be47fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 -- 172.21.15.38:0/2537393022 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7be38a670 con 0x55d7be4828f0 2023-11-06T13:29:27.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b6d9d700 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:29:27.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.054+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be43ec20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f98ac016710 tx=0x7f98ac012000).ready entity=mon.1 client_cookie=d34e4d1926197d76 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98977fe700 1 -- 172.21.15.38:0/2537393022 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac01b070 con 0x55d7be4828f0 2023-11-06T13:29:27.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98977fe700 1 -- 172.21.15.38:0/2537393022 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac016110 con 0x55d7be4828f0 2023-11-06T13:29:27.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98977fe700 1 -- 172.21.15.38:0/2537393022 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac014410 con 0x55d7be4828f0 2023-11-06T13:29:27.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 -- 172.21.15.38:0/2537393022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 msgr2=0x55d7be43ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be43ec20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f98ac016710 tx=0x7f98ac012000).stop 2023-11-06T13:29:27.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 -- 172.21.15.38:0/2537393022 shutdown_connections 2023-11-06T13:29:27.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be482400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/2537393022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be43ec20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.055+0000 7f98ce60cb80 1 -- 172.21.15.38:0/2537393022 >> 172.21.15.38:0/2537393022 conn(0x55d7be2a94f0 msgr2=0x55d7be43fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:27.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.056+0000 7f98ce60cb80 1 -- 172.21.15.38:0/2537393022 shutdown_connections 2023-11-06T13:29:27.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.056+0000 7f98ce60cb80 1 -- 172.21.15.38:0/2537393022 wait complete. 2023-11-06T13:29:27.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.056+0000 7f98ce60cb80 1 -- start start 2023-11-06T13:29:27.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.056+0000 7f98ce60cb80 1 Processor -- start 2023-11-06T13:29:27.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:27.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 0x55d7be4724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be43f110 0x55d7be43db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be47ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be3915d0 con 0x55d7be1fbe90 2023-11-06T13:29:27.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be391850 con 0x55d7be43f110 2023-11-06T13:29:27.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be35ce60 con 0x55d7be4828f0 2023-11-06T13:29:27.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98ce60cb80 10 client.0 ll_register_callbacks cb 0x55d7be3ff3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:27.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 0x55d7be4724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 0x55d7be4724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34230/0 (socket says 172.21.15.38:34230) 2023-11-06T13:29:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 -- 172.21.15.38:0/3367999446 learned_addr learned my addr 172.21.15.38:0/3367999446 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be43f110 0x55d7be43db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b6d9d700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be47ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 -- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 msgr2=0x55d7be47ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be47ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 -- 172.21.15.38:0/3367999446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be43f110 msgr2=0x55d7be43db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be43f110 0x55d7be43db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 -- 172.21.15.38:0/3367999446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b0009690 con 0x55d7be1fbe90 2023-11-06T13:29:27.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f98b659c700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 0x55d7be4724c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f98a80b14d0 tx=0x7f98a808a040).ready entity=mon.0 client_cookie=a689dd8bb03b24d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f9894ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.058+0000 7f9894ff9700 1 -- 172.21.15.38:0/3367999446 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a800bcd0 con 0x55d7be1fbe90 2023-11-06T13:29:27.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f9894ff9700 1 -- 172.21.15.38:0/3367999446 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f98a80871a0 con 0x55d7be1fbe90 2023-11-06T13:29:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7be433690 con 0x55d7be1fbe90 2023-11-06T13:29:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f9894ff9700 1 -- 172.21.15.38:0/3367999446 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98a808d100 con 0x55d7be1fbe90 2023-11-06T13:29:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 10 client.5205 fetch_fsmap learned FSMap version 17 2023-11-06T13:29:27.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f98ac0164b0 con 0x55d7be1fbe90 2023-11-06T13:29:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f9894ff9700 1 -- 172.21.15.38:0/3367999446 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8097080 con 0x55d7be1fbe90 2023-11-06T13:29:27.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f9894ff9700 1 -- 172.21.15.38:0/3367999446 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f98a8094020 con 0x55d7be1fbe90 2023-11-06T13:29:27.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 10 client.5205 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:29:27.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 10 client.5205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 20 client.5205 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be4c1100 0x55d7be4c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 4 client.5205 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:29:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7be1f7cf0 con 0x55d7be4c1100 2023-11-06T13:29:27.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.059+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be4c1100 0x55d7be4c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.060+0000 7f9894ff9700 10 client.5205 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.060+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be4c1100 0x55d7be4c14e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c7d03d1fd17c270d server_cookie=3ed879bf70e0f39e in_seq=0 out_seq=0 2023-11-06T13:29:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.060+0000 7f9894ff9700 1 -- 172.21.15.38:0/3367999446 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d7be1f7cf0 con 0x55d7be4c1100 2023-11-06T13:29:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.060+0000 7f9894ff9700 10 client.5205 handle_command_reply: tid=0 2023-11-06T13:29:27.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 client.5205 shutdown 2023-11-06T13:29:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 msgr2=0x55d7be4724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 0x55d7be4724c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f98a80b14d0 tx=0x7f98a808a040).stop 2023-11-06T13:29:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 shutdown_connections 2023-11-06T13:29:27.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be4c1100 0x55d7be4c14e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be47ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be1fbe90 0x55d7be4724c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f9894ff9700 0 client.5205 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/3367999446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be43f110 0x55d7be43db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 >> 172.21.15.38:0/3367999446 conn(0x55d7be2a94f0 msgr2=0x55d7be4ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:27.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 shutdown_connections 2023-11-06T13:29:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 1 -- 172.21.15.38:0/3367999446 wait complete. 2023-11-06T13:29:27.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.061+0000 7f98ce60cb80 20 client.5205 trim_cache size 0 max 16384 2023-11-06T13:29:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.078+0000 7f98ce60cb80 1 Processor -- start 2023-11-06T13:29:27.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.078+0000 7f98ce60cb80 1 -- start start 2023-11-06T13:29:27.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be480f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be482280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be47a130 con 0x55d7be43f110 2023-11-06T13:29:27.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be479bb0 con 0x55d7be4828f0 2023-11-06T13:29:27.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be482770 con 0x55d7be1fbe90 2023-11-06T13:29:27.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34236/0 (socket says 172.21.15.38:34236) 2023-11-06T13:29:27.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 -- 172.21.15.38:0/602814660 learned_addr learned my addr 172.21.15.38:0/602814660 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:27.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b6d9d700 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be482280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b659c700 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be480f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 -- 172.21.15.38:0/602814660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 msgr2=0x55d7be480f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be480f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 -- 172.21.15.38:0/602814660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 msgr2=0x55d7be482280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be482280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.079+0000 7f98b5d9b700 1 -- 172.21.15.38:0/602814660 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7be4332b0 con 0x55d7be43f110 2023-11-06T13:29:27.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47f440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x55d7be484940 tx=0x7f98ac018000).ready entity=mon.0 client_cookie=875c1a29c20522e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f9897fff700 1 -- 172.21.15.38:0/602814660 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac027070 con 0x55d7be43f110 2023-11-06T13:29:27.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f9897fff700 1 -- 172.21.15.38:0/602814660 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac028040 con 0x55d7be43f110 2023-11-06T13:29:27.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f9897fff700 1 -- 172.21.15.38:0/602814660 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac014410 con 0x55d7be43f110 2023-11-06T13:29:27.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 -- 172.21.15.38:0/602814660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 msgr2=0x55d7be47f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47f440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x55d7be484940 tx=0x7f98ac018000).stop 2023-11-06T13:29:27.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 -- 172.21.15.38:0/602814660 shutdown_connections 2023-11-06T13:29:27.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be4828f0 0x55d7be482280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be1fbe90 0x55d7be480f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/602814660 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be47f440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.080+0000 7f98ce60cb80 1 -- 172.21.15.38:0/602814660 >> 172.21.15.38:0/602814660 conn(0x55d7be2a94f0 msgr2=0x55d7be4395e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:27.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.081+0000 7f98ce60cb80 1 -- 172.21.15.38:0/602814660 shutdown_connections 2023-11-06T13:29:27.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.081+0000 7f98ce60cb80 1 -- 172.21.15.38:0/602814660 wait complete. 2023-11-06T13:29:27.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.081+0000 7f98ce60cb80 1 -- start start 2023-11-06T13:29:27.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.081+0000 7f98ce60cb80 1 Processor -- start 2023-11-06T13:29:27.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be1fbe90 0x55d7be475dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be506970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be514580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be507140 con 0x55d7be43f110 2023-11-06T13:29:27.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be5075a0 con 0x55d7be1fbe90 2023-11-06T13:29:27.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be5140f0 con 0x55d7be4828f0 2023-11-06T13:29:27.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 10 client.0 ll_register_callbacks cb 0x55d7be3ff3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:27.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be506970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be506970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34240/0 (socket says 172.21.15.38:34240) 2023-11-06T13:29:27.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 -- 172.21.15.38:0/1272902698 learned_addr learned my addr 172.21.15.38:0/1272902698 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:27.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b659c700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be1fbe90 0x55d7be475dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b6d9d700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be514580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 -- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 msgr2=0x55d7be514580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be514580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 -- 172.21.15.38:0/1272902698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be1fbe90 msgr2=0x55d7be475dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be1fbe90 0x55d7be475dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 -- 172.21.15.38:0/1272902698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7be38a670 con 0x55d7be43f110 2023-11-06T13:29:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98b5d9b700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be506970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f98ac0096c0 tx=0x7f98ac024070).ready entity=mon.0 client_cookie=54f02a8cf333d17b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f9894ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:27.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f9894ff9700 1 -- 172.21.15.38:0/1272902698 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac03a070 con 0x55d7be43f110 2023-11-06T13:29:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f9894ff9700 1 -- 172.21.15.38:0/1272902698 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f98ac02ebc0 con 0x55d7be43f110 2023-11-06T13:29:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98ac016110 con 0x55d7be43f110 2023-11-06T13:29:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f9894ff9700 1 -- 172.21.15.38:0/1272902698 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98ac027030 con 0x55d7be43f110 2023-11-06T13:29:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 10 client.5211 fetch_fsmap learned FSMap version 17 2023-11-06T13:29:27.112 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.083+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d7be480d90 con 0x55d7be43f110 2023-11-06T13:29:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f9894ff9700 1 -- 172.21.15.38:0/1272902698 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac016110 con 0x55d7be43f110 2023-11-06T13:29:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f9894ff9700 1 -- 172.21.15.38:0/1272902698 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f98ac03d030 con 0x55d7be43f110 2023-11-06T13:29:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98ce60cb80 10 client.5211 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:29:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98ce60cb80 10 client.5211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:27.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98ce60cb80 20 client.5211 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be517ea0 0x55d7be4469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98ce60cb80 4 client.5211 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:29:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d7be22ecf0 con 0x55d7be517ea0 2023-11-06T13:29:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98b659c700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be517ea0 0x55d7be4469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:27.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f9894ff9700 10 client.5211 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.084+0000 7f98b659c700 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be517ea0 0x55d7be4469c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=377e0541071e8402 server_cookie=1f6493d78abaa64b in_seq=0 out_seq=0 2023-11-06T13:29:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f9894ff9700 1 -- 172.21.15.38:0/1272902698 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d7be22ecf0 con 0x55d7be517ea0 2023-11-06T13:29:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f9894ff9700 10 client.5211 handle_command_reply: tid=0 2023-11-06T13:29:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 client.5211 shutdown 2023-11-06T13:29:27.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 msgr2=0x55d7be506970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be506970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f98ac0096c0 tx=0x7f98ac024070).stop 2023-11-06T13:29:27.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 shutdown_connections 2023-11-06T13:29:27.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d7be517ea0 0x55d7be4469c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d7be4828f0 0x55d7be514580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f9894ff9700 0 client.5211 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:27.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d7be1fbe90 0x55d7be475dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 --2- 172.21.15.38:0/1272902698 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d7be43f110 0x55d7be506970 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 >> 172.21.15.38:0/1272902698 conn(0x55d7be2a94f0 msgr2=0x55d7be43e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:27.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 shutdown_connections 2023-11-06T13:29:27.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 1 -- 172.21.15.38:0/1272902698 wait complete. 2023-11-06T13:29:27.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.085+0000 7f98ce60cb80 20 client.5211 trim_cache size 0 max 16384 2023-11-06T13:29:27.121 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:29:27.121 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:29:27.122 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:29:27.122 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:29:27.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f989808cbd0 msgr2=0x7f989808f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f989808cbd0 0x7f989808f090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f98b805e730 tx=0x7f98ac008040).stop 2023-11-06T13:29:27.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 msgr2=0x7f98b80f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:27.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 0x7f98b80f0da0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f98b8067550 tx=0x7f98a8009840).stop 2023-11-06T13:29:27.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 shutdown_connections 2023-11-06T13:29:27.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f98b8178e80 0x7f98b81690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:27.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f98b80eca20 0x7f98b80f0da0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f989808cbd0 0x7f989808f090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 --2- 172.21.15.38:0/3516145257 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98b8178aa0 0x7f98b80e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:27.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 >> 172.21.15.38:0/3516145257 conn(0x7f98b80ef5b0 msgr2=0x7f98b80f1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:27.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 shutdown_connections 2023-11-06T13:29:27.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:27.086+0000 7f98bcc74700 1 -- 172.21.15.38:0/3516145257 wait complete. 2023-11-06T13:29:27.126 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:29:28.128 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:29:28.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:29:28.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.257+0000 7ff93224c700 1 Processor -- start 2023-11-06T13:29:28.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.257+0000 7ff93224c700 1 -- start start 2023-11-06T13:29:28.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.258+0000 7ff93224c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff92c0c98d0 0x7ff92c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.258+0000 7ff93224c700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c0c8600 con 0x7ff92c17e450 2023-11-06T13:29:28.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.258+0000 7ff92b7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff92c17e450 0x7ff92c17e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:59464/0 (socket says 172.21.15.38:59464) 2023-11-06T13:29:28.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.258+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c0c8830 con 0x7ff92c0ca270 2023-11-06T13:29:28.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.258+0000 7ff92b7fe700 1 -- 172.21.15.38:0/263537754 learned_addr learned my addr 172.21.15.38:0/263537754 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:29:28.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.258+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c064730 con 0x7ff92c0c98d0 2023-11-06T13:29:28.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337855891 0 0) 0x7ff92c0c8600 con 0x7ff92c17e450 2023-11-06T13:29:28.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9140033f0 con 0x7ff92c17e450 2023-11-06T13:29:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92affd700 1 --2- 172.21.15.38:0/263537754 >> v2:172.21.15.44:3300/0 conn(0x7ff92c0c98d0 0x7ff92c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192224084 0 0) 0x7ff9140033f0 con 0x7ff92c17e450 2023-11-06T13:29:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 >> v2:172.21.15.44:3300/0 conn(0x7ff92c0c98d0 msgr2=0x7ff92c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.266 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 --2- 172.21.15.38:0/263537754 >> v2:172.21.15.44:3300/0 conn(0x7ff92c0c98d0 0x7ff92c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 >> v1:172.21.15.163:6789/0 conn(0x7ff92c0ca270 legacy=0x7ff92c0f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0c8b10 con 0x7ff92c17e450 2023-11-06T13:29:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7ff91c001470 con 0x7ff92c17e450 2023-11-06T13:29:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 >> v1:172.21.15.38:6789/0 conn(0x7ff92c17e450 legacy=0x7ff92c17e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9140038e0 0x7ff914003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff914004690 0x7ff914004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff914005000 0x7ff91400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c064730 con 0x7ff9140038e0 2023-11-06T13:29:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91400be50 con 0x7ff914004690 2023-11-06T13:29:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91400c010 con 0x7ff914005000 2023-11-06T13:29:28.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9140038e0 0x7ff914003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92bfff700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff914005000 0x7ff91400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.259+0000 7ff92affd700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff914004690 0x7ff914004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92b7fe700 1 -- 172.21.15.38:0/263537754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff914005000 msgr2=0x7ff91400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff914005000 0x7ff91400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92b7fe700 1 -- 172.21.15.38:0/263537754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff914004690 msgr2=0x7ff914004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff914004690 0x7ff914004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92b7fe700 1 -- 172.21.15.38:0/263537754 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140033f0 con 0x7ff9140038e0 2023-11-06T13:29:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92bfff700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff914005000 0x7ff91400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92affd700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff914004690 0x7ff914004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92bfff700 1 -- 172.21.15.38:0/263537754 reap_dead start 2023-11-06T13:29:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9140038e0 0x7ff914003cc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7ff91c00c190 tx=0x7ff91c001e70).ready entity=mon.0 client_cookie=c1b8cbef0fc99749 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c007a40 con 0x7ff9140038e0 2023-11-06T13:29:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c00cac0 con 0x7ff9140038e0 2023-11-06T13:29:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.260+0000 7ff92a7fc700 1 -- 172.21.15.38:0/263537754 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c00ce40 con 0x7ff9140038e0 2023-11-06T13:29:28.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9140038e0 msgr2=0x7ff914003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9140038e0 0x7ff914003cc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7ff91c00c190 tx=0x7ff91c001e70).stop 2023-11-06T13:29:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 shutdown_connections 2023-11-06T13:29:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 --2- 172.21.15.38:0/263537754 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff9140038e0 0x7ff914003cc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 >> 172.21.15.38:0/263537754 conn(0x7ff92c0f53e0 msgr2=0x7ff92c0f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 shutdown_connections 2023-11-06T13:29:28.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.261+0000 7ff93224c700 1 -- 172.21.15.38:0/263537754 wait complete. 2023-11-06T13:29:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.262+0000 7ff93224c700 1 Processor -- start 2023-11-06T13:29:28.276 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.262+0000 7ff93224c700 1 -- start start 2023-11-06T13:29:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff93224c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9140038e0 0x7ff92c0ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff93224c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 0x7ff92c0f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff93224c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c0f3550 0x7ff92c0efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff93224c700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0f2bd0 con 0x7ff92c166ab0 2023-11-06T13:29:28.277 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff93224c700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c166f30 con 0x7ff9140038e0 2023-11-06T13:29:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff93224c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0f0830 con 0x7ff92c0f3550 2023-11-06T13:29:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff92affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 0x7ff92c0f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff92affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 0x7ff92c0f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34262/0 (socket says 172.21.15.38:34262) 2023-11-06T13:29:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.263+0000 7ff92affd700 1 -- 172.21.15.38:0/2915171931 learned_addr learned my addr 172.21.15.38:0/2915171931 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.278 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9140038e0 0x7ff92c0ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92bfff700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c0f3550 0x7ff92c0efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92affd700 1 -- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c0f3550 msgr2=0x7ff92c0efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92affd700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c0f3550 0x7ff92c0efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92affd700 1 -- 172.21.15.38:0/2915171931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9140038e0 msgr2=0x7ff92c0ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.279 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92affd700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9140038e0 0x7ff92c0ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92affd700 1 -- 172.21.15.38:0/2915171931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0f0b10 con 0x7ff92c166ab0 2023-11-06T13:29:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff92affd700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 0x7ff92c0f3060 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7ff920011960 tx=0x7ff920008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff9137fe700 1 -- 172.21.15.38:0/2915171931 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920013620 con 0x7ff92c166ab0 2023-11-06T13:29:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff9137fe700 1 -- 172.21.15.38:0/2915171931 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920013780 con 0x7ff92c166ab0 2023-11-06T13:29:28.280 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c0f0df0 con 0x7ff92c166ab0 2023-11-06T13:29:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff9137fe700 1 -- 172.21.15.38:0/2915171931 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920013b00 con 0x7ff92c166ab0 2023-11-06T13:29:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.264+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c0f2860 con 0x7ff92c166ab0 2023-11-06T13:29:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.268+0000 7ff9137fe700 1 -- 172.21.15.38:0/2915171931 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 5) v1 ==== 113106+0+0 (secure 0 0 0) 0x7ff920015480 con 0x7ff92c166ab0 2023-11-06T13:29:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.268+0000 7ff9137fe700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cc00 0x7ff91808f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.281 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.269+0000 7ff9137fe700 1 -- 172.21.15.38:0/2915171931 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff9200b2770 con 0x7ff92c166ab0 2023-11-06T13:29:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.269+0000 7ff943be4b80 1 Processor -- start 2023-11-06T13:29:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.269+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cc00 0x7ff91808f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.269+0000 7ff943be4b80 1 -- start start 2023-11-06T13:29:28.282 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.269+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cc00 0x7ff91808f0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff91c00ca90 tx=0x7ff91c015000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.271+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 0x5585e7897480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.271+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7853ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.271+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e7894c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.271+0000 7ff943be4b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e781a050 con 0x5585e7897970 2023-11-06T13:29:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.271+0000 7ff943be4b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e77912c0 con 0x5585e7854190 2023-11-06T13:29:28.283 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.271+0000 7ff943be4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e77a6510 con 0x5585e7610f10 2023-11-06T13:29:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.272+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 0x5585e7897480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.272+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 0x5585e7897480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:51984/0 (socket says 172.21.15.38:51984) 2023-11-06T13:29:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.272+0000 7ff92b7fe700 1 -- 172.21.15.38:0/1746067522 learned_addr learned my addr 172.21.15.38:0/1746067522 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92bfff700 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e7894c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.284 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92b7fe700 1 -- 172.21.15.38:0/1746067522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 msgr2=0x5585e7894c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e7894c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92b7fe700 1 -- 172.21.15.38:0/1746067522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 msgr2=0x5585e7853ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7853ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92b7fe700 1 -- 172.21.15.38:0/1746067522 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e779f6f0 con 0x5585e7610f10 2023-11-06T13:29:28.285 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.273+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 0x5585e7897480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ff91c00c780 tx=0x7ff91c01f000).ready entity=mon.2 client_cookie=c414e9a2619cc872 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.276+0000 7ff9137fe700 1 -- 172.21.15.38:0/2915171931 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7ff9200af970 con 0x7ff92c166ab0 2023-11-06T13:29:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.278+0000 7ff910ff9700 1 -- 172.21.15.38:0/1746067522 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c028070 con 0x5585e7610f10 2023-11-06T13:29:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.278+0000 7ff910ff9700 1 -- 172.21.15.38:0/1746067522 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0073b0 con 0x5585e7610f10 2023-11-06T13:29:28.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.278+0000 7ff910ff9700 1 -- 172.21.15.38:0/1746067522 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0046b0 con 0x5585e7610f10 2023-11-06T13:29:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 -- 172.21.15.38:0/1746067522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 msgr2=0x5585e7897480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 0x5585e7897480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ff91c00c780 tx=0x7ff91c01f000).stop 2023-11-06T13:29:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 -- 172.21.15.38:0/1746067522 shutdown_connections 2023-11-06T13:29:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e7894c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7610f10 0x5585e7897480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 --2- 172.21.15.38:0/1746067522 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7853ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 -- 172.21.15.38:0/1746067522 >> 172.21.15.38:0/1746067522 conn(0x5585e76be570 msgr2=0x5585e7854dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 -- 172.21.15.38:0/1746067522 shutdown_connections 2023-11-06T13:29:28.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.279+0000 7ff943be4b80 1 -- 172.21.15.38:0/1746067522 wait complete. 2023-11-06T13:29:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.280+0000 7ff943be4b80 1 -- start start 2023-11-06T13:29:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.280+0000 7ff943be4b80 1 Processor -- start 2023-11-06T13:29:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 0x5585e788e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e78c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e788ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e77a6650 con 0x5585e7610f10 2023-11-06T13:29:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e77a68d0 con 0x5585e7854190 2023-11-06T13:29:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e7771ee0 con 0x5585e7897970 2023-11-06T13:29:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff943be4b80 10 client.0 ll_register_callbacks cb 0x5585e7814450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:28.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 0x5585e788e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff92b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 0x5585e788e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34288/0 (socket says 172.21.15.38:34288) 2023-11-06T13:29:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff92b7fe700 1 -- 172.21.15.38:0/2723604775 learned_addr learned my addr 172.21.15.38:0/2723604775 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.281+0000 7ff92affd700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e78c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92bfff700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e788ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92b7fe700 1 -- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 msgr2=0x5585e788ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e788ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92b7fe700 1 -- 172.21.15.38:0/2723604775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 msgr2=0x5585e78c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e78c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92b7fe700 1 -- 172.21.15.38:0/2723604775 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9140033f0 con 0x5585e7610f10 2023-11-06T13:29:28.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 0x5585e788e5f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7ff91c007360 tx=0x7ff91c028000).ready entity=mon.0 client_cookie=2827d3b47cd93c2a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff909ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:28.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff909ffb700 1 -- 172.21.15.38:0/2723604775 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c004a20 con 0x5585e7610f10 2023-11-06T13:29:28.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff909ffb700 1 -- 172.21.15.38:0/2723604775 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff91c004b80 con 0x5585e7610f10 2023-11-06T13:29:28.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585e7848710 con 0x5585e7610f10 2023-11-06T13:29:28.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff909ffb700 1 -- 172.21.15.38:0/2723604775 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff91c02e480 con 0x5585e7610f10 2023-11-06T13:29:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff943be4b80 10 client.5220 fetch_fsmap learned FSMap version 17 2023-11-06T13:29:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.282+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5585e779aa90 con 0x5585e7610f10 2023-11-06T13:29:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff909ffb700 1 -- 172.21.15.38:0/2723604775 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585e7848710 con 0x5585e7610f10 2023-11-06T13:29:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff909ffb700 1 -- 172.21.15.38:0/2723604775 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7ff91c02e5e0 con 0x5585e7610f10 2023-11-06T13:29:28.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff943be4b80 10 client.5220 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:29:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff943be4b80 10 client.5220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff943be4b80 20 client.5220 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e7889470 0x5585e78c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff943be4b80 4 client.5220 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:29:28.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585e760cd70 con 0x5585e7889470 2023-11-06T13:29:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff92affd700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e7889470 0x5585e78c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff909ffb700 10 client.5220 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.283+0000 7ff92affd700 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e7889470 0x5585e78c4f50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5493a64d80c91841 server_cookie=f8995dea5767f66c in_seq=0 out_seq=0 2023-11-06T13:29:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff909ffb700 1 -- 172.21.15.38:0/2723604775 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5585e760cd70 con 0x5585e7889470 2023-11-06T13:29:28.300 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff909ffb700 10 client.5220 handle_command_reply: tid=0 2023-11-06T13:29:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 client.5220 shutdown 2023-11-06T13:29:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 msgr2=0x5585e788e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 0x5585e788e5f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7ff91c007360 tx=0x7ff91c028000).stop 2023-11-06T13:29:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 shutdown_connections 2023-11-06T13:29:28.301 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e7889470 0x5585e78c4f50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e788ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7610f10 0x5585e788e5f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff909ffb700 0 client.5220 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2723604775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7854190 0x5585e78c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 >> 172.21.15.38:0/2723604775 conn(0x5585e76be570 msgr2=0x5585e78c32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 shutdown_connections 2023-11-06T13:29:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.284+0000 7ff943be4b80 1 -- 172.21.15.38:0/2723604775 wait complete. 2023-11-06T13:29:28.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.285+0000 7ff943be4b80 20 client.5220 trim_cache size 0 max 16384 2023-11-06T13:29:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.301+0000 7ff943be4b80 1 Processor -- start 2023-11-06T13:29:28.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.301+0000 7ff943be4b80 1 -- start start 2023-11-06T13:29:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e785b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 0x5585e7853af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e785be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff943be4b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e784e730 con 0x5585e7854190 2023-11-06T13:29:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff943be4b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e788a670 con 0x5585e7610f10 2023-11-06T13:29:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff943be4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e78510c0 con 0x5585e7897970 2023-11-06T13:29:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 0x5585e7853af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 0x5585e7853af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34296/0 (socket says 172.21.15.38:34296) 2023-11-06T13:29:28.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 -- 172.21.15.38:0/4120813083 learned_addr learned my addr 172.21.15.38:0/4120813083 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92bfff700 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e785be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e785b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 -- 172.21.15.38:0/4120813083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 msgr2=0x5585e785be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e785be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 -- 172.21.15.38:0/4120813083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 msgr2=0x5585e785b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e785b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 -- 172.21.15.38:0/4120813083 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e7848330 con 0x5585e7854190 2023-11-06T13:29:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92bfff700 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e785be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.302+0000 7ff92affd700 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 0x5585e7853af0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff920011f50 tx=0x7ff92002c040).ready entity=mon.0 client_cookie=b95b74f3614b3435 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff9117fa700 1 -- 172.21.15.38:0/4120813083 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92002a2c0 con 0x5585e7854190 2023-11-06T13:29:28.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff9117fa700 1 -- 172.21.15.38:0/4120813083 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92002fe40 con 0x5585e7854190 2023-11-06T13:29:28.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff9117fa700 1 -- 172.21.15.38:0/4120813083 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92002a030 con 0x5585e7854190 2023-11-06T13:29:28.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 -- 172.21.15.38:0/4120813083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 msgr2=0x5585e7853af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 0x5585e7853af0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff920011f50 tx=0x7ff92002c040).stop 2023-11-06T13:29:28.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 -- 172.21.15.38:0/4120813083 shutdown_connections 2023-11-06T13:29:28.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7897970 0x5585e785be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e785b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 --2- 172.21.15.38:0/4120813083 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7854190 0x5585e7853af0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 -- 172.21.15.38:0/4120813083 >> 172.21.15.38:0/4120813083 conn(0x5585e76be570 msgr2=0x5585e788e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 -- 172.21.15.38:0/4120813083 shutdown_connections 2023-11-06T13:29:28.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.303+0000 7ff943be4b80 1 -- 172.21.15.38:0/4120813083 wait complete. 2023-11-06T13:29:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.304+0000 7ff943be4b80 1 -- start start 2023-11-06T13:29:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.304+0000 7ff943be4b80 1 Processor -- start 2023-11-06T13:29:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e792c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7854190 0x5585e785aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7898870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e7929180 con 0x5585e7897970 2023-11-06T13:29:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e7852540 con 0x5585e7610f10 2023-11-06T13:29:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e78b96d0 con 0x5585e7854190 2023-11-06T13:29:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff943be4b80 10 client.0 ll_register_callbacks cb 0x5585e7814450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:28.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff92bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7898870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff92bfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7898870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34308/0 (socket says 172.21.15.38:34308) 2023-11-06T13:29:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff92bfff700 1 -- 172.21.15.38:0/2091787934 learned_addr learned my addr 172.21.15.38:0/2091787934 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e792c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.305+0000 7ff92affd700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7854190 0x5585e785aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92bfff700 1 -- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7854190 msgr2=0x5585e785aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92bfff700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7854190 0x5585e785aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92bfff700 1 -- 172.21.15.38:0/2091787934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 msgr2=0x5585e792c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92bfff700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e792c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92bfff700 1 -- 172.21.15.38:0/2091787934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c0f2860 con 0x5585e7897970 2023-11-06T13:29:28.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92affd700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7854190 0x5585e785aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff92bfff700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7898870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7ff92c089bb0 tx=0x7ff92400c040).ready entity=mon.0 client_cookie=9299ab97833c8236 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff909ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:28.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff909ffb700 1 -- 172.21.15.38:0/2091787934 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240039b0 con 0x5585e7897970 2023-11-06T13:29:28.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff91c0073b0 con 0x5585e7897970 2023-11-06T13:29:28.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff909ffb700 1 -- 172.21.15.38:0/2091787934 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff924014a10 con 0x5585e7897970 2023-11-06T13:29:28.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff909ffb700 1 -- 172.21.15.38:0/2091787934 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff924014de0 con 0x5585e7897970 2023-11-06T13:29:28.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 10 client.5226 fetch_fsmap learned FSMap version 17 2023-11-06T13:29:28.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5585e779a7e0 con 0x5585e7897970 2023-11-06T13:29:28.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff909ffb700 1 -- 172.21.15.38:0/2091787934 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0073b0 con 0x5585e7897970 2023-11-06T13:29:28.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff909ffb700 1 -- 172.21.15.38:0/2091787934 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7ff924012070 con 0x5585e7897970 2023-11-06T13:29:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 10 client.5226 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:29:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 10 client.5226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 20 client.5226 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e785b750 0x5585e791d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 4 client.5226 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:29:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.306+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5585e7643d70 con 0x5585e785b750 2023-11-06T13:29:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.307+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e785b750 0x5585e791d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.307+0000 7ff909ffb700 10 client.5226 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.307+0000 7ff92b7fe700 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e785b750 0x5585e791d770 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d11664c5660d988d server_cookie=e785a1d64e75097a in_seq=0 out_seq=0 2023-11-06T13:29:28.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff909ffb700 1 -- 172.21.15.38:0/2091787934 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5585e7643d70 con 0x5585e785b750 2023-11-06T13:29:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff909ffb700 10 client.5226 handle_command_reply: tid=0 2023-11-06T13:29:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 client.5226 shutdown 2023-11-06T13:29:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 msgr2=0x5585e7898870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7898870 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7ff92c089bb0 tx=0x7ff92400c040).stop 2023-11-06T13:29:28.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 shutdown_connections 2023-11-06T13:29:28.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5585e7897970 0x5585e7898870 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5585e7610f10 0x5585e792c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5585e785b750 0x5585e791d770 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 --2- 172.21.15.38:0/2091787934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5585e7854190 0x5585e785aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff909ffb700 0 client.5226 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 >> 172.21.15.38:0/2091787934 conn(0x5585e76be570 msgr2=0x5585e78c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 shutdown_connections 2023-11-06T13:29:28.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 1 -- 172.21.15.38:0/2091787934 wait complete. 2023-11-06T13:29:28.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.308+0000 7ff943be4b80 20 client.5226 trim_cache size 0 max 16384 2023-11-06T13:29:28.327 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:29:28.327 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:29:28.327 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "68e602f9-af4f-476f-8bc9-a4ffa6f74c79", 2023-11-06T13:29:28.327 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:29:28.327 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:29:28.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cc00 msgr2=0x7ff91808f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cc00 0x7ff91808f0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff91c00ca90 tx=0x7ff91c015000).stop 2023-11-06T13:29:28.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 msgr2=0x7ff92c0f3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 0x7ff92c0f3060 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7ff920011960 tx=0x7ff920008040).stop 2023-11-06T13:29:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 shutdown_connections 2023-11-06T13:29:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff92c0f3550 0x7ff92c0efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff91808cc00 0x7ff91808f0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9140038e0 0x7ff92c0ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 --2- 172.21.15.38:0/2915171931 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff92c166ab0 0x7ff92c0f3060 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 >> 172.21.15.38:0/2915171931 conn(0x7ff92c0f53e0 msgr2=0x7ff92c16c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 shutdown_connections 2023-11-06T13:29:28.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.309+0000 7ff93224c700 1 -- 172.21.15.38:0/2915171931 wait complete. 2023-11-06T13:29:28.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:29:28.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.451+0000 7f9bcba45700 1 Processor -- start 2023-11-06T13:29:28.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.452+0000 7f9bcba45700 1 -- start start 2023-11-06T13:29:28.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bcba45700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9bc417e650 0x7f9bc417eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bcba45700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40c7210 con 0x7f9bc4180340 2023-11-06T13:29:28.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bcba45700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40c74f0 con 0x7f9bc417e270 2023-11-06T13:29:28.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bcba45700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40c77d0 con 0x7f9bc417e650 2023-11-06T13:29:28.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bc9fe2700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9bc417e650 0x7f9bc417eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bc8fe0700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9bc4180340 0x7f9bc41807c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:60238/0 (socket says 172.21.15.38:60238) 2023-11-06T13:29:28.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bc8fe0700 1 -- 172.21.15.38:0/1467458411 learned_addr learned my addr 172.21.15.38:0/1467458411 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:29:28.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bc97e1700 1 --1- 172.21.15.38:0/1467458411 >> v1:172.21.15.163:6789/0 conn(0x7f9bc417e270 0x7f9bc41827e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:58614/0 (socket says 172.21.15.38:58614) 2023-11-06T13:29:28.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bb7fff700 1 -- 172.21.15.38:0/1467458411 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173307298 0 0) 0x7f9bc40c7210 con 0x7f9bc4180340 2023-11-06T13:29:28.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bb7fff700 1 -- 172.21.15.38:0/1467458411 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb00033f0 con 0x7f9bc4180340 2023-11-06T13:29:28.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/1467458411 >> v1:172.21.15.163:6789/0 conn(0x7f9bc417e270 legacy=0x7f9bc41827e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bb7fff700 1 -- 172.21.15.38:0/1467458411 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012860767 0 0) 0x7f9bc40c74f0 con 0x7f9bc417e270 2023-11-06T13:29:28.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.453+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/1467458411 >> v1:172.21.15.44:6789/0 conn(0x7f9bc4180340 legacy=0x7f9bc41807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/1467458411 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40c7ab0 con 0x7f9bc417e650 2023-11-06T13:29:28.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/1467458411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e650 0x7f9bc417eac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9bbc009e60 tx=0x7f9bbc009780).ready entity=mon.2 client_cookie=1fcd4d95c00c91a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bb7fff700 1 -- 172.21.15.38:0/1467458411 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00e070 con 0x7f9bc417e650 2023-11-06T13:29:28.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bb7fff700 1 -- 172.21.15.38:0/1467458411 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00bb60 con 0x7f9bc417e650 2023-11-06T13:29:28.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bb7fff700 1 -- 172.21.15.38:0/1467458411 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00bee0 con 0x7f9bc417e650 2023-11-06T13:29:28.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bcba45700 1 -- 172.21.15.38:0/1467458411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e650 msgr2=0x7f9bc417eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1467458411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e650 0x7f9bc417eac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f9bbc009e60 tx=0x7f9bbc009780).stop 2023-11-06T13:29:28.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bcba45700 1 -- 172.21.15.38:0/1467458411 shutdown_connections 2023-11-06T13:29:28.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1467458411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e650 0x7f9bc417eac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.454+0000 7f9bcba45700 1 -- 172.21.15.38:0/1467458411 >> 172.21.15.38:0/1467458411 conn(0x7f9bc40f22b0 msgr2=0x7f9bc40ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.455+0000 7f9bcba45700 1 -- 172.21.15.38:0/1467458411 shutdown_connections 2023-11-06T13:29:28.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.455+0000 7f9bcba45700 1 -- 172.21.15.38:0/1467458411 wait complete. 2023-11-06T13:29:28.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.456+0000 7f9bcba45700 1 Processor -- start 2023-11-06T13:29:28.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.456+0000 7f9bcba45700 1 -- start start 2023-11-06T13:29:28.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bcba45700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e270 0x7f9bc4192b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bcba45700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 0x7f9bc4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bcba45700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bc4180340 0x7f9bc4156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.466 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bcba45700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4066a10 con 0x7f9bc417e650 2023-11-06T13:29:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bcba45700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4065b20 con 0x7f9bc4180340 2023-11-06T13:29:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bcba45700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4065e00 con 0x7f9bc417e270 2023-11-06T13:29:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bc8fe0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 0x7f9bc4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bc8fe0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 0x7f9bc4156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34312/0 (socket says 172.21.15.38:34312) 2023-11-06T13:29:28.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bc8fe0700 1 -- 172.21.15.38:0/1404911809 learned_addr learned my addr 172.21.15.38:0/1404911809 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e270 0x7f9bc4192b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.457+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bc4180340 0x7f9bc4156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bc8fe0700 1 -- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e270 msgr2=0x7f9bc4192b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e270 0x7f9bc4192b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bc8fe0700 1 -- 172.21.15.38:0/1404911809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bc4180340 msgr2=0x7f9bc4156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bc4180340 0x7f9bc4156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bc8fe0700 1 -- 172.21.15.38:0/1404911809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc009a20 con 0x7f9bc417e650 2023-11-06T13:29:28.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 0x7f9bc4156130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f9bc000c420 tx=0x7f9bc0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bb57fa700 1 -- 172.21.15.38:0/1404911809 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00070d0 con 0x7f9bc417e650 2023-11-06T13:29:28.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bb57fa700 1 -- 172.21.15.38:0/1404911809 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc0007230 con 0x7f9bc417e650 2023-11-06T13:29:28.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bb57fa700 1 -- 172.21.15.38:0/1404911809 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc00075b0 con 0x7f9bc417e650 2023-11-06T13:29:28.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc40660e0 con 0x7f9bc417e650 2023-11-06T13:29:28.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.458+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc40666a0 con 0x7f9bc417e650 2023-11-06T13:29:28.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.462+0000 7f9bb57fa700 1 -- 172.21.15.38:0/1404911809 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f9bc00059b0 con 0x7f9bc417e650 2023-11-06T13:29:28.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.462+0000 7f9bdd3ddb80 1 Processor -- start 2023-11-06T13:29:28.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.462+0000 7f9bdd3ddb80 1 -- start start 2023-11-06T13:29:28.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.463+0000 7f9bb57fa700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9ba808cb40 0x7f9ba808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.463+0000 7f9bb57fa700 1 -- 172.21.15.38:0/1404911809 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9bc00b16a0 con 0x7f9bc417e650 2023-11-06T13:29:28.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.463+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9ba808cb40 0x7f9ba808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.463+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9ba808cb40 0x7f9ba808f000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9bbc0094d0 tx=0x7f9bc40c8350).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.463+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbd45400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.463+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbd01c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbd42c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbcc7fd0 con 0x5590dbabee90 2023-11-06T13:29:28.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbc3f240 con 0x5590dbd02110 2023-11-06T13:29:28.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbc54490 con 0x5590dbd458f0 2023-11-06T13:29:28.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbd45400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbd45400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34326/0 (socket says 172.21.15.38:34326) 2023-11-06T13:29:28.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 -- 172.21.15.38:0/2028123972 learned_addr learned my addr 172.21.15.38:0/2028123972 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbd01c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbd42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 -- 172.21.15.38:0/2028123972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 msgr2=0x5590dbd01c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbd01c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 -- 172.21.15.38:0/2028123972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 msgr2=0x5590dbd42c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbd42c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 -- 172.21.15.38:0/2028123972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590dbc4d670 con 0x5590dbabee90 2023-11-06T13:29:28.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbd42c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbd45400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f9bb8004790 tx=0x7f9bb8007d50).ready entity=mon.0 client_cookie=b933a868f81f3483 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bae7fc700 1 -- 172.21.15.38:0/2028123972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8007210 con 0x5590dbabee90 2023-11-06T13:29:28.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bae7fc700 1 -- 172.21.15.38:0/2028123972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8011590 con 0x5590dbabee90 2023-11-06T13:29:28.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.464+0000 7f9bae7fc700 1 -- 172.21.15.38:0/2028123972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011910 con 0x5590dbabee90 2023-11-06T13:29:28.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/2028123972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 msgr2=0x5590dbd45400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbd45400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f9bb8004790 tx=0x7f9bb8007d50).stop 2023-11-06T13:29:28.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/2028123972 shutdown_connections 2023-11-06T13:29:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbd42c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbd45400 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/2028123972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbd01c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/2028123972 >> 172.21.15.38:0/2028123972 conn(0x5590dbb6c4f0 msgr2=0x5590dbd02d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.483 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/2028123972 shutdown_connections 2023-11-06T13:29:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.465+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/2028123972 wait complete. 2023-11-06T13:29:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.466+0000 7f9bdd3ddb80 1 -- start start 2023-11-06T13:29:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.467+0000 7f9bdd3ddb80 1 Processor -- start 2023-11-06T13:29:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbabee90 0x5590dbd3c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.484 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd02110 0x5590dbd3dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbd374d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbc545d0 con 0x5590dbd458f0 2023-11-06T13:29:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbc54850 con 0x5590dbabee90 2023-11-06T13:29:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbc1fe60 con 0x5590dbd02110 2023-11-06T13:29:28.485 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 10 client.0 ll_register_callbacks cb 0x5590dbcc23d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbd374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbd374d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34330/0 (socket says 172.21.15.38:34330) 2023-11-06T13:29:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/102466295 learned_addr learned my addr 172.21.15.38:0/102466295 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbabee90 0x5590dbd3c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd02110 0x5590dbd3dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd02110 msgr2=0x5590dbd3dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd02110 0x5590dbd3dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/102466295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbabee90 msgr2=0x5590dbd3c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbabee90 0x5590dbd3c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/102466295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb8007400 con 0x5590dbd458f0 2023-11-06T13:29:28.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd02110 0x5590dbd3dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:29:28.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbd374d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f9bc4084db0 tx=0x7f9bbc01f000).ready entity=mon.0 client_cookie=4d98a2400926fcb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9ba37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:28.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9ba37fe700 1 -- 172.21.15.38:0/102466295 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc01ed20 con 0x5590dbd458f0 2023-11-06T13:29:28.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9ba37fe700 1 -- 172.21.15.38:0/102466295 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9bbc029440 con 0x5590dbd458f0 2023-11-06T13:29:28.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.469+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590dbcf6690 con 0x5590dbd458f0 2023-11-06T13:29:28.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9ba37fe700 1 -- 172.21.15.38:0/102466295 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bbc01ee80 con 0x5590dbd458f0 2023-11-06T13:29:28.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 10 client.5235 fetch_fsmap learned FSMap version 17 2023-11-06T13:29:28.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5590dbc48a10 con 0x5590dbd458f0 2023-11-06T13:29:28.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9ba37fe700 1 -- 172.21.15.38:0/102466295 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590dbcf6690 con 0x5590dbd458f0 2023-11-06T13:29:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9ba37fe700 1 -- 172.21.15.38:0/102466295 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f9bbc026030 con 0x5590dbd458f0 2023-11-06T13:29:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 10 client.5235 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:29:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 10 client.5235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 20 client.5235 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:28.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81790 0x5590dbd74050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 4 client.5235 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:29:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590dbabacf0 con 0x5590dbd81790 2023-11-06T13:29:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.470+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81790 0x5590dbd74050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81790 0x5590dbd74050 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3ce80a9c588330d server_cookie=bbdea0213a4e3c15 in_seq=0 out_seq=0 2023-11-06T13:29:28.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9ba37fe700 10 client.5235 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9ba37fe700 1 -- 172.21.15.38:0/102466295 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5590dbabacf0 con 0x5590dbd81790 2023-11-06T13:29:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9ba37fe700 10 client.5235 handle_command_reply: tid=0 2023-11-06T13:29:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 client.5235 shutdown 2023-11-06T13:29:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 msgr2=0x5590dbd374d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbd374d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f9bc4084db0 tx=0x7f9bbc01f000).stop 2023-11-06T13:29:28.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 shutdown_connections 2023-11-06T13:29:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbd374d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbabee90 0x5590dbd3c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81790 0x5590dbd74050 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/102466295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd02110 0x5590dbd3dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9ba37fe700 0 client.5235 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.471+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 >> 172.21.15.38:0/102466295 conn(0x5590dbb6c4f0 msgr2=0x5590dbd44640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.472+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 shutdown_connections 2023-11-06T13:29:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.472+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/102466295 wait complete. 2023-11-06T13:29:28.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.472+0000 7f9bdd3ddb80 20 client.5235 trim_cache size 0 max 16384 2023-11-06T13:29:28.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.487+0000 7f9bdd3ddb80 1 Processor -- start 2023-11-06T13:29:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.487+0000 7f9bdd3ddb80 1 -- start start 2023-11-06T13:29:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.488+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbabee90 0x5590dbcfc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.488+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdcc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbdccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbcfcad0 con 0x5590dbd458f0 2023-11-06T13:29:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbd469c0 con 0x5590dbd02110 2023-11-06T13:29:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbcff020 con 0x5590dbabee90 2023-11-06T13:29:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbdccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbdccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34344/0 (socket says 172.21.15.38:34344) 2023-11-06T13:29:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/53122596 learned_addr learned my addr 172.21.15.38:0/53122596 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdcc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbabee90 0x5590dbcfc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/53122596 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbabee90 msgr2=0x5590dbcfc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbabee90 0x5590dbcfc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/53122596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 msgr2=0x5590dbdcc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdcc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 -- 172.21.15.38:0/53122596 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590dbc48760 con 0x5590dbd458f0 2023-11-06T13:29:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbabee90 0x5590dbcfc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbdccad0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f9bbc012720 tx=0x7f9bbc029000).ready entity=mon.0 client_cookie=2ff482d5fba20859 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9baeffd700 1 -- 172.21.15.38:0/53122596 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc029440 con 0x5590dbd458f0 2023-11-06T13:29:28.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9baeffd700 1 -- 172.21.15.38:0/53122596 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc012d00 con 0x5590dbd458f0 2023-11-06T13:29:28.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.489+0000 7f9baeffd700 1 -- 172.21.15.38:0/53122596 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc01e8c0 con 0x5590dbd458f0 2023-11-06T13:29:28.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/53122596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 msgr2=0x5590dbdccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbdccad0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f9bbc012720 tx=0x7f9bbc029000).stop 2023-11-06T13:29:28.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/53122596 shutdown_connections 2023-11-06T13:29:28.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbd458f0 0x5590dbdccad0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbabee90 0x5590dbcfc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/53122596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdcc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/53122596 >> 172.21.15.38:0/53122596 conn(0x5590dbb6c4f0 msgr2=0x5590dbcfe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/53122596 shutdown_connections 2023-11-06T13:29:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.490+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/53122596 wait complete. 2023-11-06T13:29:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.491+0000 7f9bdd3ddb80 1 -- start start 2023-11-06T13:29:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.491+0000 7f9bdd3ddb80 1 Processor -- start 2023-11-06T13:29:28.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbddab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdc7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbdc8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbdc8c60 con 0x5590dbabee90 2023-11-06T13:29:28.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbddb250 con 0x5590dbd02110 2023-11-06T13:29:28.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590dbdd71f0 con 0x5590dbd458f0 2023-11-06T13:29:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bdd3ddb80 10 client.0 ll_register_callbacks cb 0x5590dbcc23d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbddab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbddab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:34346/0 (socket says 172.21.15.38:34346) 2023-11-06T13:29:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 -- 172.21.15.38:0/1113425876 learned_addr learned my addr 172.21.15.38:0/1113425876 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:28.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdc7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc9fe2700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbdc8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 -- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 msgr2=0x5590dbdc8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbdc8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 -- 172.21.15.38:0/1113425876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 msgr2=0x5590dbdc7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:28.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdc7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc97e1700 1 -- 172.21.15.38:0/1113425876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590dbc48a10 con 0x5590dbabee90 2023-11-06T13:29:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.492+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdc7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bc97e1700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbddab00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f9bb8017040 tx=0x7f9bb8025280).ready entity=mon.0 client_cookie=6fb6a921435ac305 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9ba37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:28.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9ba37fe700 1 -- 172.21.15.38:0/1113425876 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8000ce0 con 0x5590dbabee90 2023-11-06T13:29:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9ba37fe700 1 -- 172.21.15.38:0/1113425876 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9bb8011c80 con 0x5590dbabee90 2023-11-06T13:29:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bb8011590 con 0x5590dbabee90 2023-11-06T13:29:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9ba37fe700 1 -- 172.21.15.38:0/1113425876 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb8011910 con 0x5590dbabee90 2023-11-06T13:29:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 10 client.5241 fetch_fsmap learned FSMap version 17 2023-11-06T13:29:28.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5590dbabffd0 con 0x5590dbabee90 2023-11-06T13:29:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9ba37fe700 1 -- 172.21.15.38:0/1113425876 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8011590 con 0x5590dbabee90 2023-11-06T13:29:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9ba37fe700 1 -- 172.21.15.38:0/1113425876 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 17) v1 ==== 7456+0+0 (secure 0 0 0) 0x7f9bb8012070 con 0x5590dbabee90 2023-11-06T13:29:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 10 client.5241 fetch_fsmap finished waiting for FSMap version 17 2023-11-06T13:29:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 10 client.5241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:28.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 20 client.5241 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81b70 0x5590dbdcd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 4 client.5241 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:29:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5590dbaf1cf0 con 0x5590dbd81b70 2023-11-06T13:29:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.493+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81b70 0x5590dbdcd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:28.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9ba37fe700 10 client.5241 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bc8fe0700 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81b70 0x5590dbdcd4b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=adf914da3fae54a8 server_cookie=ac11ffdbf3244749 in_seq=0 out_seq=0 2023-11-06T13:29:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9ba37fe700 1 -- 172.21.15.38:0/1113425876 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5590dbaf1cf0 con 0x5590dbd81b70 2023-11-06T13:29:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9ba37fe700 10 client.5241 handle_command_reply: tid=0 2023-11-06T13:29:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 client.5241 shutdown 2023-11-06T13:29:28.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 msgr2=0x5590dbddab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbddab00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f9bb8017040 tx=0x7f9bb8025280).stop 2023-11-06T13:29:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 shutdown_connections 2023-11-06T13:29:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5590dbd81b70 0x5590dbdcd4b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5590dbd458f0 0x5590dbdc8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5590dbabee90 0x5590dbddab00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 --2- 172.21.15.38:0/1113425876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5590dbd02110 0x5590dbdc7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9ba37fe700 0 client.5241 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 >> 172.21.15.38:0/1113425876 conn(0x5590dbb6c4f0 msgr2=0x5590dbd746f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 shutdown_connections 2023-11-06T13:29:28.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 1 -- 172.21.15.38:0/1113425876 wait complete. 2023-11-06T13:29:28.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.494+0000 7f9bdd3ddb80 20 client.5241 trim_cache size 0 max 16384 2023-11-06T13:29:28.518 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:29:28.518 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:29:28.519 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:29:28.519 INFO:teuthology.orchestra.run.smithi038.stdout: "68e602f9-af4f-476f-8bc9-a4ffa6f74c79": { 2023-11-06T13:29:28.519 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:29:28.519 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "68e602f9-af4f-476f-8bc9-a4ffa6f74c79", 2023-11-06T13:29:28.519 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:29:28.520 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:29:28.520 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:29:28.520 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:29:28.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9ba808cb40 msgr2=0x7f9ba808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9ba808cb40 0x7f9ba808f000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9bbc0094d0 tx=0x7f9bc40c8350).stop 2023-11-06T13:29:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 msgr2=0x7f9bc4156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 0x7f9bc4156130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f9bc000c420 tx=0x7f9bc0007c80).stop 2023-11-06T13:29:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 shutdown_connections 2023-11-06T13:29:28.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9ba808cb40 0x7f9ba808f000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9bc4180340 0x7f9bc4156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9bc417e270 0x7f9bc4192b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 --2- 172.21.15.38:0/1404911809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9bc417e650 0x7f9bc4156130 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 >> 172.21.15.38:0/1404911809 conn(0x7f9bc40f22b0 msgr2=0x7f9bc41772e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:28.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 shutdown_connections 2023-11-06T13:29:28.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:28.495+0000 7f9bcba45700 1 -- 172.21.15.38:0/1404911809 wait complete. 2023-11-06T13:29:28.524 INFO:tasks.cephfs.filesystem:scrub status for tag:68e602f9-af4f-476f-8bc9-a4ffa6f74c79 - {'path': '/', 'tag': '68e602f9-af4f-476f-8bc9-a4ffa6f74c79', 'options': 'recursive,force'} 2023-11-06T13:29:29.341 INFO:tasks.workunit.client.0.smithi038.stderr:Updating files: 93% (11277/12074) Updating files: 94% (11350/12074) Updating files: 95% (11471/12074) Updating files: 96% (11592/12074) Updating files: 97% (11712/12074) Updating files: 98% (11833/12074) Updating files: 99% (11954/12074) Updating files: 100% (12074/12074) Updating files: 100% (12074/12074), done. 2023-11-06T13:29:30.263 INFO:tasks.workunit.client.0.smithi038.stderr:Note: switching to '4e03306bd00b0abb2be37dbc132f82d281f8973d'. 2023-11-06T13:29:30.263 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-06T13:29:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-06T13:29:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:state without impacting any branches by switching back to a branch. 2023-11-06T13:29:30.264 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.264 INFO:tasks.workunit.client.0.smithi038.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-06T13:29:30.265 INFO:tasks.workunit.client.0.smithi038.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-06T13:29:30.265 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.265 INFO:tasks.workunit.client.0.smithi038.stderr: git switch -c 2023-11-06T13:29:30.265 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.266 INFO:tasks.workunit.client.0.smithi038.stderr:Or undo this operation with: 2023-11-06T13:29:30.266 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.266 INFO:tasks.workunit.client.0.smithi038.stderr: git switch - 2023-11-06T13:29:30.266 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.266 INFO:tasks.workunit.client.0.smithi038.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-06T13:29:30.267 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:30.267 INFO:tasks.workunit.client.0.smithi038.stderr:HEAD is now at 4e03306bd00 Merge branch 'wip-62523' of https://github.com/lxbsz/ceph into wip-vshankar-testing1-2023-11-02-1726-pacific 2023-11-06T13:29:30.270 DEBUG:teuthology.orchestra.run.smithi038:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-06T13:29:30.298 INFO:tasks.workunit.client.0.smithi038.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-06T13:29:30.300 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-06T13:29:30.300 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-06T13:29:30.906 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-06T13:29:30.974 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-06T13:29:31.015 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-06T13:29:31.016 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-06T13:29:31.017 INFO:tasks.workunit.client.0.smithi038.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-06T13:29:31.055 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-06T13:29:31.058 DEBUG:teuthology.orchestra.run.smithi038:> set -ex 2023-11-06T13:29:31.059 DEBUG:teuthology.orchestra.run.smithi038:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-06T13:29:31.115 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2023-11-06T13:29:31.116 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2023-11-06T13:29:31.117 DEBUG:teuthology.orchestra.run.smithi038:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e03306bd00b0abb2be37dbc132f82d281f8973d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2023-11-06T13:29:31.181 INFO:tasks.workunit.client.0.smithi038.stdout:getting blogbench 2023-11-06T13:29:31.212 INFO:tasks.workunit.client.0.smithi038.stderr:--2023-11-06 13:29:31-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2023-11-06T13:29:31.212 INFO:tasks.workunit.client.0.smithi038.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-11-06T13:29:31.281 INFO:tasks.workunit.client.0.smithi038.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-11-06T13:29:31.348 INFO:tasks.workunit.client.0.smithi038.stderr:HTTP request sent, awaiting response... 200 OK 2023-11-06T13:29:31.349 INFO:tasks.workunit.client.0.smithi038.stderr:Length: 103355 (101K) [application/octet-stream] 2023-11-06T13:29:31.349 INFO:tasks.workunit.client.0.smithi038.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2023-11-06T13:29:31.353 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:31.488 INFO:tasks.workunit.client.0.smithi038.stderr: 0K .......... .......... .......... .......... .......... 49% 367K 0s 2023-11-06T13:29:31.555 INFO:tasks.workunit.client.0.smithi038.stderr: 50K .......... .......... .......... .......... .......... 99% 730K 0s 2023-11-06T13:29:31.555 INFO:tasks.workunit.client.0.smithi038.stderr: 100K 100% 1779G=0.2s 2023-11-06T13:29:31.555 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:31.556 INFO:tasks.workunit.client.0.smithi038.stderr:2023-11-06 13:29:31 (493 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2023-11-06T13:29:31.556 INFO:tasks.workunit.client.0.smithi038.stderr: 2023-11-06T13:29:31.589 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/ 2023-11-06T13:29:31.591 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/m4/ 2023-11-06T13:29:31.592 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/m4/acx_pthread.m4 2023-11-06T13:29:31.593 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/man/ 2023-11-06T13:29:31.594 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/man/blogbench.8 2023-11-06T13:29:31.595 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/man/Makefile.am 2023-11-06T13:29:31.595 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/man/Makefile.in 2023-11-06T13:29:31.595 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/ 2023-11-06T13:29:31.597 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/mysnprintf.c 2023-11-06T13:29:31.600 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/mysnprintf.h 2023-11-06T13:29:31.600 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/blogbench.c 2023-11-06T13:29:31.600 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/blogbench.h 2023-11-06T13:29:31.600 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/fakesnprintf.c 2023-11-06T13:29:31.601 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/fakesnprintf.h 2023-11-06T13:29:31.601 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/blogbench_p.h 2023-11-06T13:29:31.601 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/bsd-getopt_long.c 2023-11-06T13:29:31.601 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/bsd-getopt_long.h 2023-11-06T13:29:31.601 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/Makefile.am 2023-11-06T13:29:31.602 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/Makefile.in 2023-11-06T13:29:31.602 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/process.c 2023-11-06T13:29:31.602 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/globals.h 2023-11-06T13:29:31.602 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/commenter.c 2023-11-06T13:29:31.603 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/rewriter.c 2023-11-06T13:29:31.603 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/reader.c 2023-11-06T13:29:31.603 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/writer.c 2023-11-06T13:29:31.604 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/src/helpers.c 2023-11-06T13:29:31.604 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/NEWS 2023-11-06T13:29:31.609 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/compile 2023-11-06T13:29:31.609 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/depcomp 2023-11-06T13:29:31.610 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/aclocal.m4 2023-11-06T13:29:31.610 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/README 2023-11-06T13:29:31.610 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/configure 2023-11-06T13:29:31.612 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/configure.ac 2023-11-06T13:29:31.613 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/config.guess 2023-11-06T13:29:31.615 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/install-sh 2023-11-06T13:29:31.615 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/config.sub 2023-11-06T13:29:31.615 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/missing 2023-11-06T13:29:31.615 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/mkinstalldirs 2023-11-06T13:29:31.616 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/Makefile.am 2023-11-06T13:29:31.616 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/Makefile.in 2023-11-06T13:29:31.616 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/config.h.in 2023-11-06T13:29:31.616 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/AUTHORS 2023-11-06T13:29:31.616 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/INSTALL 2023-11-06T13:29:31.617 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/ChangeLog 2023-11-06T13:29:31.617 INFO:tasks.workunit.client.0.smithi038.stdout:blogbench-1.0/COPYING 2023-11-06T13:29:31.617 INFO:tasks.workunit.client.0.smithi038.stdout:making blogbench 2023-11-06T13:29:31.717 INFO:tasks.workunit.client.0.smithi038.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-06T13:29:32.723 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether build environment is sane... yes 2023-11-06T13:29:32.731 INFO:tasks.workunit.client.0.smithi038.stdout:checking for gawk... gawk 2023-11-06T13:29:32.746 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether make sets $(MAKE)... yes 2023-11-06T13:29:32.757 INFO:tasks.workunit.client.0.smithi038.stdout:checking for gcc... gcc 2023-11-06T13:29:32.810 INFO:tasks.workunit.client.0.smithi038.stdout:checking for C compiler default output file name... a.out 2023-11-06T13:29:32.811 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether the C compiler works... yes 2023-11-06T13:29:32.814 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether we are cross compiling... no 2023-11-06T13:29:32.854 INFO:tasks.workunit.client.0.smithi038.stdout:checking for suffix of executables... 2023-11-06T13:29:32.887 INFO:tasks.workunit.client.0.smithi038.stdout:checking for suffix of object files... o 2023-11-06T13:29:32.917 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether we are using the GNU C compiler... yes 2023-11-06T13:29:32.945 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether gcc accepts -g... yes 2023-11-06T13:29:32.984 INFO:tasks.workunit.client.0.smithi038.stdout:checking for gcc option to accept ANSI C... none needed 2023-11-06T13:29:33.034 INFO:tasks.workunit.client.0.smithi038.stdout:checking for style of include used by make... GNU 2023-11-06T13:29:33.120 INFO:tasks.workunit.client.0.smithi038.stdout:checking dependency style of gcc... gcc3 2023-11-06T13:29:33.120 INFO:tasks.workunit.client.0.smithi038.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-06T13:29:33.255 INFO:tasks.workunit.client.0.smithi038.stdout:checking how to run the C preprocessor... gcc -E 2023-11-06T13:29:33.284 INFO:tasks.workunit.client.0.smithi038.stdout:checking for egrep... grep -E 2023-11-06T13:29:33.291 INFO:tasks.workunit.client.0.smithi038.stdout:checking for AIX... no 2023-11-06T13:29:33.349 INFO:tasks.workunit.client.0.smithi038.stdout:checking for library containing strerror... none required 2023-11-06T13:29:33.508 INFO:tasks.workunit.client.0.smithi038.stdout:checking for ANSI C header files... yes 2023-11-06T13:29:33.543 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether time.h and sys/time.h may both be included... yes 2023-11-06T13:29:33.585 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/types.h... yes 2023-11-06T13:29:33.641 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/stat.h... yes 2023-11-06T13:29:33.685 INFO:tasks.workunit.client.0.smithi038.stdout:checking for stdlib.h... yes 2023-11-06T13:29:33.729 INFO:tasks.workunit.client.0.smithi038.stdout:checking for string.h... yes 2023-11-06T13:29:33.773 INFO:tasks.workunit.client.0.smithi038.stdout:checking for memory.h... yes 2023-11-06T13:29:33.816 INFO:tasks.workunit.client.0.smithi038.stdout:checking for strings.h... yes 2023-11-06T13:29:33.861 INFO:tasks.workunit.client.0.smithi038.stdout:checking for inttypes.h... yes 2023-11-06T13:29:33.906 INFO:tasks.workunit.client.0.smithi038.stdout:checking for stdint.h... yes 2023-11-06T13:29:33.957 INFO:tasks.workunit.client.0.smithi038.stdout:checking for unistd.h... yes 2023-11-06T13:29:33.971 INFO:tasks.workunit.client.0.smithi038.stdout:checking for memory.h... (cached) yes 2023-11-06T13:29:33.976 INFO:tasks.workunit.client.0.smithi038.stdout:checking for strings.h... (cached) yes 2023-11-06T13:29:33.981 INFO:tasks.workunit.client.0.smithi038.stdout:checking for unistd.h... (cached) yes 2023-11-06T13:29:34.020 INFO:tasks.workunit.client.0.smithi038.stdout:checking locale.h usability... yes 2023-11-06T13:29:34.034 INFO:tasks.workunit.client.0.smithi038.stdout:checking locale.h presence... yes 2023-11-06T13:29:34.035 INFO:tasks.workunit.client.0.smithi038.stdout:checking for locale.h... yes 2023-11-06T13:29:34.049 INFO:tasks.workunit.client.0.smithi038.stdout:checking for stdlib.h... (cached) yes 2023-11-06T13:29:34.054 INFO:tasks.workunit.client.0.smithi038.stdout:checking for string.h... (cached) yes 2023-11-06T13:29:34.098 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/socket.h usability... yes 2023-11-06T13:29:34.113 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/socket.h presence... yes 2023-11-06T13:29:34.114 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/socket.h... yes 2023-11-06T13:29:34.161 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/time.h usability... yes 2023-11-06T13:29:34.175 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/time.h presence... yes 2023-11-06T13:29:34.176 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/time.h... yes 2023-11-06T13:29:34.224 INFO:tasks.workunit.client.0.smithi038.stdout:checking fcntl.h usability... yes 2023-11-06T13:29:34.238 INFO:tasks.workunit.client.0.smithi038.stdout:checking fcntl.h presence... yes 2023-11-06T13:29:34.238 INFO:tasks.workunit.client.0.smithi038.stdout:checking for fcntl.h... yes 2023-11-06T13:29:34.286 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/fcntl.h usability... yes 2023-11-06T13:29:34.299 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/fcntl.h presence... yes 2023-11-06T13:29:34.300 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/fcntl.h... yes 2023-11-06T13:29:34.355 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/param.h usability... yes 2023-11-06T13:29:34.372 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/param.h presence... yes 2023-11-06T13:29:34.373 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/param.h... yes 2023-11-06T13:29:34.416 INFO:tasks.workunit.client.0.smithi038.stdout:checking ioctl.h usability... no 2023-11-06T13:29:34.431 INFO:tasks.workunit.client.0.smithi038.stdout:checking ioctl.h presence... no 2023-11-06T13:29:34.432 INFO:tasks.workunit.client.0.smithi038.stdout:checking for ioctl.h... no 2023-11-06T13:29:34.476 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/ioctl.h usability... yes 2023-11-06T13:29:34.490 INFO:tasks.workunit.client.0.smithi038.stdout:checking sys/ioctl.h presence... yes 2023-11-06T13:29:34.490 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sys/ioctl.h... yes 2023-11-06T13:29:34.538 INFO:tasks.workunit.client.0.smithi038.stdout:checking return type of signal handlers... void 2023-11-06T13:29:34.580 INFO:tasks.workunit.client.0.smithi038.stdout:checking for size_t... yes 2023-11-06T13:29:34.616 INFO:tasks.workunit.client.0.smithi038.stdout:checking for dev_t... yes 2023-11-06T13:29:34.657 INFO:tasks.workunit.client.0.smithi038.stdout:checking for short... yes 2023-11-06T13:29:34.727 INFO:tasks.workunit.client.0.smithi038.stdout:checking size of short... 2 2023-11-06T13:29:34.768 INFO:tasks.workunit.client.0.smithi038.stdout:checking for int... yes 2023-11-06T13:29:34.829 INFO:tasks.workunit.client.0.smithi038.stdout:checking size of int... 4 2023-11-06T13:29:34.869 INFO:tasks.workunit.client.0.smithi038.stdout:checking for long... yes 2023-11-06T13:29:34.931 INFO:tasks.workunit.client.0.smithi038.stdout:checking size of long... 8 2023-11-06T13:29:34.971 INFO:tasks.workunit.client.0.smithi038.stdout:checking for long long... yes 2023-11-06T13:29:35.032 INFO:tasks.workunit.client.0.smithi038.stdout:checking size of long long... 8 2023-11-06T13:29:35.070 INFO:tasks.workunit.client.0.smithi038.stdout:checking for ssize_t... yes 2023-11-06T13:29:35.105 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sig_atomic_t... yes 2023-11-06T13:29:35.144 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether gcc needs -traditional... no 2023-11-06T13:29:35.173 INFO:tasks.workunit.client.0.smithi038.stdout:checking for an ANSI C-conforming const... yes 2023-11-06T13:29:35.193 INFO:tasks.workunit.client.0.smithi038.stdout:checking for inline... inline 2023-11-06T13:29:35.246 INFO:tasks.workunit.client.0.smithi038.stdout:checking for working alloca.h... yes 2023-11-06T13:29:35.287 INFO:tasks.workunit.client.0.smithi038.stdout:checking for alloca... yes 2023-11-06T13:29:35.347 INFO:tasks.workunit.client.0.smithi038.stdout:checking for working memcmp... yes 2023-11-06T13:29:35.397 INFO:tasks.workunit.client.0.smithi038.stdout:checking for strftime... yes 2023-11-06T13:29:35.464 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2023-11-06T13:29:35.521 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether stat accepts an empty string... no 2023-11-06T13:29:35.570 INFO:tasks.workunit.client.0.smithi038.stdout:checking for vprintf... yes 2023-11-06T13:29:35.625 INFO:tasks.workunit.client.0.smithi038.stdout:checking for _doprnt... no 2023-11-06T13:29:35.649 INFO:tasks.workunit.client.0.smithi038.stdout:checking build system type... x86_64-unknown-linux-gnu 2023-11-06T13:29:35.662 INFO:tasks.workunit.client.0.smithi038.stdout:checking host system type... x86_64-unknown-linux-gnu 2023-11-06T13:29:35.707 INFO:tasks.workunit.client.0.smithi038.stdout:checking for the pthreads library -lpthreads... no 2023-11-06T13:29:35.755 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether pthreads work without any flags... no 2023-11-06T13:29:35.768 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether pthreads work with -Kthread... no 2023-11-06T13:29:35.781 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether pthreads work with -kthread... no 2023-11-06T13:29:35.819 INFO:tasks.workunit.client.0.smithi038.stdout:checking for the pthreads library -llthread... no 2023-11-06T13:29:35.866 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether pthreads work with -pthread... yes 2023-11-06T13:29:35.907 INFO:tasks.workunit.client.0.smithi038.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2023-11-06T13:29:35.908 INFO:tasks.workunit.client.0.smithi038.stdout:checking if more special flags are required for pthreads... no 2023-11-06T13:29:35.908 INFO:tasks.workunit.client.0.smithi038.stdout:checking for cc_r... gcc 2023-11-06T13:29:35.986 INFO:tasks.workunit.client.0.smithi038.stdout:checking for setrlimit... yes 2023-11-06T13:29:36.041 INFO:tasks.workunit.client.0.smithi038.stdout:checking for setproctitle... no 2023-11-06T13:29:36.094 INFO:tasks.workunit.client.0.smithi038.stdout:checking for getopt_long... yes 2023-11-06T13:29:36.149 INFO:tasks.workunit.client.0.smithi038.stdout:checking for strtoull... yes 2023-11-06T13:29:36.203 INFO:tasks.workunit.client.0.smithi038.stdout:checking for strtoq... yes 2023-11-06T13:29:36.258 INFO:tasks.workunit.client.0.smithi038.stdout:checking for snprintf... yes 2023-11-06T13:29:36.313 INFO:tasks.workunit.client.0.smithi038.stdout:checking for vsnprintf... yes 2023-11-06T13:29:36.368 INFO:tasks.workunit.client.0.smithi038.stdout:checking for vfprintf... yes 2023-11-06T13:29:36.422 INFO:tasks.workunit.client.0.smithi038.stdout:checking for gethostname... yes 2023-11-06T13:29:36.476 INFO:tasks.workunit.client.0.smithi038.stdout:checking for setlocale... yes 2023-11-06T13:29:36.531 INFO:tasks.workunit.client.0.smithi038.stdout:checking for sync... yes 2023-11-06T13:29:36.591 INFO:tasks.workunit.client.0.smithi038.stdout:checking whether snprintf is C99 conformant... done 2023-11-06T13:29:36.601 INFO:tasks.workunit.client.0.smithi038.stdout:configure: creating ./config.status 2023-11-06T13:29:36.925 INFO:tasks.workunit.client.0.smithi038.stdout:config.status: creating Makefile 2023-11-06T13:29:36.940 INFO:tasks.workunit.client.0.smithi038.stdout:config.status: creating src/Makefile 2023-11-06T13:29:36.963 INFO:tasks.workunit.client.0.smithi038.stdout:config.status: creating man/Makefile 2023-11-06T13:29:36.974 INFO:tasks.workunit.client.0.smithi038.stdout:config.status: creating config.h 2023-11-06T13:29:37.036 INFO:tasks.workunit.client.0.smithi038.stdout:config.status: executing depfiles commands 2023-11-06T13:29:37.192 INFO:tasks.workunit.client.0.smithi038.stdout:make all-recursive 2023-11-06T13:29:37.193 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-06T13:29:37.197 INFO:tasks.workunit.client.0.smithi038.stdout:Making all in src 2023-11-06T13:29:37.208 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-11-06T13:29:37.208 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2023-11-06T13:29:37.208 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2023-11-06T13:29:37.271 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2023-11-06T13:29:37.271 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2023-11-06T13:29:37.332 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2023-11-06T13:29:37.332 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2023-11-06T13:29:37.381 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2023-11-06T13:29:37.381 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2023-11-06T13:29:37.428 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2023-11-06T13:29:37.428 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2023-11-06T13:29:37.474 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2023-11-06T13:29:37.475 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2023-11-06T13:29:37.519 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2023-11-06T13:29:37.520 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2023-11-06T13:29:37.589 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2023-11-06T13:29:37.589 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2023-11-06T13:29:37.621 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2023-11-06T13:29:37.621 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2023-11-06T13:29:37.653 INFO:tasks.workunit.client.0.smithi038.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2023-11-06T13:29:37.653 INFO:tasks.workunit.client.0.smithi038.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2023-11-06T13:29:37.699 INFO:tasks.workunit.client.0.smithi038.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2023-11-06T13:29:37.735 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2023-11-06T13:29:37.736 INFO:tasks.workunit.client.0.smithi038.stdout:Making all in man 2023-11-06T13:29:37.741 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-11-06T13:29:37.741 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Nothing to be done for 'all'. 2023-11-06T13:29:37.742 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2023-11-06T13:29:37.742 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-06T13:29:37.743 INFO:tasks.workunit.client.0.smithi038.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-06T13:29:37.744 INFO:tasks.workunit.client.0.smithi038.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2023-11-06T13:29:37.747 INFO:tasks.workunit.client.0.smithi038.stdout:running blogbench 2023-11-06T13:29:37.747 INFO:tasks.workunit.client.0.smithi038.stdout: 2023-11-06T13:29:37.747 INFO:tasks.workunit.client.0.smithi038.stdout:Frequency = 10 secs 2023-11-06T13:29:37.748 INFO:tasks.workunit.client.0.smithi038.stdout:Scratch dir = [blogtest_in] 2023-11-06T13:29:40.288 INFO:tasks.workunit.client.0.smithi038.stdout:Spawning 3 writers... 2023-11-06T13:29:40.289 INFO:tasks.workunit.client.0.smithi038.stdout:Spawning 1 rewriters... 2023-11-06T13:29:40.289 INFO:tasks.workunit.client.0.smithi038.stdout:Spawning 5 commenters... 2023-11-06T13:29:40.289 INFO:tasks.workunit.client.0.smithi038.stdout:Spawning 100 readers... 2023-11-06T13:29:40.290 INFO:tasks.workunit.client.0.smithi038.stdout:Benchmarking for 30 iterations. 2023-11-06T13:29:40.290 INFO:tasks.workunit.client.0.smithi038.stdout:The test will run during 5 minutes. 2023-11-06T13:29:40.290 INFO:tasks.workunit.client.0.smithi038.stdout: 2023-11-06T13:29:40.291 INFO:tasks.workunit.client.0.smithi038.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2023-11-06T13:29:50.290 INFO:tasks.workunit.client.0.smithi038.stdout: 12 101718 826 53871 579 17096 612 2023-11-06T13:29:57.146 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:57.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:57.152 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:29:58.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:29:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.645+0000 7f8d03da5700 1 Processor -- start 2023-11-06T13:29:58.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.645+0000 7f8d03da5700 1 -- start start 2023-11-06T13:29:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d03da5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cfc17ae10 0x7f8cfc0ec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d03da5700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8cfc17bdf0 0x7f8cfc17c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d03da5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc17e090 con 0x7f8cfc17b1f0 2023-11-06T13:29:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d03da5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc17ec30 con 0x7f8cfc17ae10 2023-11-06T13:29:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d03da5700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc17d1a0 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d01340700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f8cfc17b1f0 0x7f8cfc17e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:39908/0 (socket says 172.21.15.38:39908) 2023-11-06T13:29:58.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d01340700 1 -- 172.21.15.38:0/201233816 learned_addr learned my addr 172.21.15.38:0/201233816 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:29:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d02342700 1 --2- 172.21.15.38:0/201233816 >> v2:172.21.15.163:3300/0 conn(0x7f8cfc17bdf0 0x7f8cfc17c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d01b41700 1 --2- 172.21.15.38:0/201233816 >> v2:172.21.15.44:3300/0 conn(0x7f8cfc17ae10 0x7f8cfc0ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d00b3f700 1 -- 172.21.15.38:0/201233816 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570121454 0 0) 0x7f8cfc17e090 con 0x7f8cfc17b1f0 2023-11-06T13:29:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d00b3f700 1 -- 172.21.15.38:0/201233816 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce80033f0 con 0x7f8cfc17b1f0 2023-11-06T13:29:58.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d02342700 1 -- 172.21.15.38:0/201233816 >> v2:172.21.15.44:3300/0 conn(0x7f8cfc17ae10 msgr2=0x7f8cfc0ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d02342700 1 --2- 172.21.15.38:0/201233816 >> v2:172.21.15.44:3300/0 conn(0x7f8cfc17ae10 0x7f8cfc0ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d02342700 1 -- 172.21.15.38:0/201233816 >> v1:172.21.15.163:6789/0 conn(0x7f8cfc17b1f0 legacy=0x7f8cfc17e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.647+0000 7f8d02342700 1 -- 172.21.15.38:0/201233816 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc17d480 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d02342700 1 --2- 172.21.15.38:0/201233816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc17c260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8cfc0e5350 tx=0x7f8cf4009780).ready entity=mon.2 client_cookie=8bf1c137a9c39ba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d00b3f700 1 -- 172.21.15.38:0/201233816 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400e070 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d00b3f700 1 -- 172.21.15.38:0/201233816 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400bab0 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d00b3f700 1 -- 172.21.15.38:0/201233816 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400be30 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d03da5700 1 -- 172.21.15.38:0/201233816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17bdf0 msgr2=0x7f8cfc17c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d03da5700 1 --2- 172.21.15.38:0/201233816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc17c260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f8cfc0e5350 tx=0x7f8cf4009780).stop 2023-11-06T13:29:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d03da5700 1 -- 172.21.15.38:0/201233816 shutdown_connections 2023-11-06T13:29:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d03da5700 1 --2- 172.21.15.38:0/201233816 >> v2:172.21.15.44:3300/0 conn(0x7f8cfc17ae10 0x7f8cfc0ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.648+0000 7f8d03da5700 1 --2- 172.21.15.38:0/201233816 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc17c260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.649+0000 7f8d03da5700 1 -- 172.21.15.38:0/201233816 >> 172.21.15.38:0/201233816 conn(0x7f8cfc0f22b0 msgr2=0x7f8cfc0ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:58.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.649+0000 7f8d03da5700 1 -- 172.21.15.38:0/201233816 shutdown_connections 2023-11-06T13:29:58.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.649+0000 7f8d03da5700 1 -- 172.21.15.38:0/201233816 wait complete. 2023-11-06T13:29:58.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.650+0000 7f8d03da5700 1 Processor -- start 2023-11-06T13:29:58.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.666+0000 7f8d03da5700 1 -- start start 2023-11-06T13:29:58.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d03da5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17ae10 0x7f8cfc173bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d03da5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cfc17b1f0 0x7f8cfc0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d03da5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc0f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d03da5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc173730 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d03da5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc172b20 con 0x7f8cfc17b1f0 2023-11-06T13:29:58.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d03da5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc172e00 con 0x7f8cfc17ae10 2023-11-06T13:29:58.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d02342700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc0f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d02342700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc0f07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51482/0 (socket says 172.21.15.38:51482) 2023-11-06T13:29:58.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.668+0000 7f8d02342700 1 -- 172.21.15.38:0/3429938170 learned_addr learned my addr 172.21.15.38:0/3429938170 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:58.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.669+0000 7f8d02342700 1 -- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17ae10 msgr2=0x7f8cfc173bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:29:58.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.669+0000 7f8d02342700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17ae10 0x7f8cfc173bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.669+0000 7f8d02342700 1 -- 172.21.15.38:0/3429938170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cfc17b1f0 msgr2=0x7f8cfc0c7a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:29:58.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.669+0000 7f8d02342700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cfc17b1f0 0x7f8cfc0c7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.669+0000 7f8d02342700 1 -- 172.21.15.38:0/3429938170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009a20 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.669+0000 7f8d02342700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc0f07b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f8cf400b610 tx=0x7f8cfc0c2270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.672+0000 7f8cf1ffb700 1 -- 172.21.15.38:0/3429938170 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4007000 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.672+0000 7f8cf1ffb700 1 -- 172.21.15.38:0/3429938170 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf401d630 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.672+0000 7f8cf1ffb700 1 -- 172.21.15.38:0/3429938170 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf401d9d0 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.675+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc1730e0 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.675+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc0c7f80 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.679+0000 7f8cf1ffb700 1 -- 172.21.15.38:0/3429938170 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f8cf4003040 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.683+0000 7f8cf1ffb700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8ce008cb90 0x7f8ce008f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.684+0000 7f8cf1ffb700 1 -- 172.21.15.38:0/3429938170 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f8cf40b3c50 con 0x7f8cfc17bdf0 2023-11-06T13:29:58.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.684+0000 7f8d01b41700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8ce008cb90 0x7f8ce008f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.685+0000 7f8d01b41700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8ce008cb90 0x7f8ce008f050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f8cec009990 tx=0x7f8cec009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.685+0000 7f8d1573db80 1 Processor -- start 2023-11-06T13:29:58.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.685+0000 7f8d1573db80 1 -- start start 2023-11-06T13:29:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbded400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbda9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbdeac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d1573db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbd6ffd0 con 0x55ddbbded8f0 2023-11-06T13:29:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d1573db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbce7240 con 0x55ddbbb66e90 2023-11-06T13:29:58.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d1573db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbcfc490 con 0x55ddbbdaa110 2023-11-06T13:29:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d01b41700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbded400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d02342700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbdeac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.686+0000 7f8d02342700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbdeac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:33808/0 (socket says 172.21.15.38:33808) 2023-11-06T13:29:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.687+0000 7f8d02342700 1 -- 172.21.15.38:0/2192235648 learned_addr learned my addr 172.21.15.38:0/2192235648 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:58.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.693+0000 7f8d02342700 1 -- 172.21.15.38:0/2192235648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 msgr2=0x55ddbbded400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.693+0000 7f8d02342700 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbded400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.693+0000 7f8d02342700 1 -- 172.21.15.38:0/2192235648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 msgr2=0x55ddbbda9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.693+0000 7f8d02342700 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbda9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.693+0000 7f8d02342700 1 -- 172.21.15.38:0/2192235648 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddbbcf5670 con 0x55ddbbdaa110 2023-11-06T13:29:58.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.694+0000 7f8d02342700 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbdeac00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8cf40843d0 tx=0x7f8cf40b1780).ready entity=mon.2 client_cookie=9ed0b5e135696622 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.694+0000 7f8cdeffd700 1 -- 172.21.15.38:0/2192235648 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4084260 con 0x55ddbbdaa110 2023-11-06T13:29:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.694+0000 7f8cdeffd700 1 -- 172.21.15.38:0/2192235648 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4087f20 con 0x55ddbbdaa110 2023-11-06T13:29:58.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.694+0000 7f8cdeffd700 1 -- 172.21.15.38:0/2192235648 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf408d800 con 0x55ddbbdaa110 2023-11-06T13:29:58.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 -- 172.21.15.38:0/2192235648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 msgr2=0x55ddbbdeac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbdeac00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8cf40843d0 tx=0x7f8cf40b1780).stop 2023-11-06T13:29:58.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 -- 172.21.15.38:0/2192235648 shutdown_connections 2023-11-06T13:29:58.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbdeac00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbded400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2192235648 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbda9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.695+0000 7f8d1573db80 1 -- 172.21.15.38:0/2192235648 >> 172.21.15.38:0/2192235648 conn(0x55ddbbc144f0 msgr2=0x55ddbbdaad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.698+0000 7f8d1573db80 1 -- 172.21.15.38:0/2192235648 shutdown_connections 2023-11-06T13:29:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.698+0000 7f8d1573db80 1 -- 172.21.15.38:0/2192235648 wait complete. 2023-11-06T13:29:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.699+0000 7f8d1573db80 1 -- start start 2023-11-06T13:29:58.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.699+0000 7f8d1573db80 1 Processor -- start 2023-11-06T13:29:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.700+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbe28ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.700+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbde6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.700+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d1573db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbcfc5d0 con 0x55ddbbded8f0 2023-11-06T13:29:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d1573db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbcfc850 con 0x55ddbbb66e90 2023-11-06T13:29:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d1573db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbcc7e60 con 0x55ddbbdaa110 2023-11-06T13:29:58.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d1573db80 10 client.0 ll_register_callbacks cb 0x55ddbbd6a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51494/0 (socket says 172.21.15.38:51494) 2023-11-06T13:29:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 -- 172.21.15.38:0/1338455280 learned_addr learned my addr 172.21.15.38:0/1338455280 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 -- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 msgr2=0x55ddbbde6400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:29:58.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbde6400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 -- 172.21.15.38:0/1338455280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 msgr2=0x55ddbbe28ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:29:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbe28ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 -- 172.21.15.38:0/1338455280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc0c7f80 con 0x55ddbbded8f0 2023-11-06T13:29:58.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d02342700 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd4140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f8cf4013e20 tx=0x7f8cf4093000).ready entity=mon.0 client_cookie=95c3d3b77ff47eb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8cd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8cd7fff700 1 -- 172.21.15.38:0/1338455280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4087620 con 0x55ddbbded8f0 2023-11-06T13:29:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8cd7fff700 1 -- 172.21.15.38:0/1338455280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f8cf408d370 con 0x55ddbbded8f0 2023-11-06T13:29:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.701+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddbbd9e690 con 0x55ddbbded8f0 2023-11-06T13:29:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8cd7fff700 1 -- 172.21.15.38:0/1338455280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cf4083d10 con 0x55ddbbded8f0 2023-11-06T13:29:58.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 10 client.5247 fetch_fsmap learned FSMap version 18 2023-11-06T13:29:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ddbbcf0a10 con 0x55ddbbded8f0 2023-11-06T13:29:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8cd7fff700 1 -- 172.21.15.38:0/1338455280 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ddbbd9e690 con 0x55ddbbded8f0 2023-11-06T13:29:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8cd7fff700 1 -- 172.21.15.38:0/1338455280 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 18) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f8cf4094040 con 0x55ddbbded8f0 2023-11-06T13:29:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 10 client.5247 fetch_fsmap finished waiting for FSMap version 18 2023-11-06T13:29:58.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 10 client.5247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 20 client.5247 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe297e0 0x55ddbbdb1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 4 client.5247 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:29:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddbbb62cf0 con 0x55ddbbe297e0 2023-11-06T13:29:58.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.702+0000 7f8d01b41700 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe297e0 0x55ddbbdb1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.703+0000 7f8cd7fff700 10 client.5247 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.703+0000 7f8d01b41700 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe297e0 0x55ddbbdb1a40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=727629320d3e3c1b server_cookie=5e50cedd9d38cd84 in_seq=0 out_seq=0 2023-11-06T13:29:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.703+0000 7f8cd7fff700 1 -- 172.21.15.38:0/1338455280 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55ddbbb62cf0 con 0x55ddbbe297e0 2023-11-06T13:29:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.703+0000 7f8cd7fff700 10 client.5247 handle_command_reply: tid=0 2023-11-06T13:29:58.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 client.5247 shutdown 2023-11-06T13:29:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 msgr2=0x55ddbbdd4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd4140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f8cf4013e20 tx=0x7f8cf4093000).stop 2023-11-06T13:29:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 shutdown_connections 2023-11-06T13:29:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd4140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbb66e90 0x55ddbbe28ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe297e0 0x55ddbbdb1a40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 --2- 172.21.15.38:0/1338455280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbdaa110 0x55ddbbde6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 >> 172.21.15.38:0/1338455280 conn(0x55ddbbc144f0 msgr2=0x55ddbbdec640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:58.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8cd7fff700 0 client.5247 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:58.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 shutdown_connections 2023-11-06T13:29:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.704+0000 7f8d1573db80 1 -- 172.21.15.38:0/1338455280 wait complete. 2023-11-06T13:29:58.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.706+0000 7f8d1573db80 20 client.5247 trim_cache size 0 max 16384 2023-11-06T13:29:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.724+0000 7f8d1573db80 1 Processor -- start 2023-11-06T13:29:58.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.724+0000 7f8d1573db80 1 -- start start 2023-11-06T13:29:58.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbb66e90 0x55ddbbdda950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 0x55ddbbddae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbded8f0 0x55ddbbda1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d1573db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbda2270 con 0x55ddbbdaa110 2023-11-06T13:29:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d1573db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbddf850 con 0x55ddbbded8f0 2023-11-06T13:29:58.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d1573db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbdaffa0 con 0x55ddbbb66e90 2023-11-06T13:29:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 0x55ddbbddae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 0x55ddbbddae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51506/0 (socket says 172.21.15.38:51506) 2023-11-06T13:29:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 -- 172.21.15.38:0/2765090322 learned_addr learned my addr 172.21.15.38:0/2765090322 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:58.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01b41700 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbb66e90 0x55ddbbdda950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d02342700 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbded8f0 0x55ddbbda1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 -- 172.21.15.38:0/2765090322 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbb66e90 msgr2=0x55ddbbdda950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbb66e90 0x55ddbbdda950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 -- 172.21.15.38:0/2765090322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbded8f0 msgr2=0x55ddbbda1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbded8f0 0x55ddbbda1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 -- 172.21.15.38:0/2765090322 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddbbcf0760 con 0x55ddbbdaa110 2023-11-06T13:29:58.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8d01340700 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 0x55ddbbddae70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f8cf8007f10 tx=0x7f8cf8007af0).ready entity=mon.0 client_cookie=e9203effe392f744 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.725+0000 7f8cdf7fe700 1 -- 172.21.15.38:0/2765090322 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8007110 con 0x55ddbbdaa110 2023-11-06T13:29:58.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.726+0000 7f8cdf7fe700 1 -- 172.21.15.38:0/2765090322 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf8007270 con 0x55ddbbdaa110 2023-11-06T13:29:58.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.726+0000 7f8cdf7fe700 1 -- 172.21.15.38:0/2765090322 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8007630 con 0x55ddbbdaa110 2023-11-06T13:29:58.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 -- 172.21.15.38:0/2765090322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 msgr2=0x55ddbbddae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 0x55ddbbddae70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f8cf8007f10 tx=0x7f8cf8007af0).stop 2023-11-06T13:29:58.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 -- 172.21.15.38:0/2765090322 shutdown_connections 2023-11-06T13:29:58.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbded8f0 0x55ddbbda1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbb66e90 0x55ddbbdda950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2765090322 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbdaa110 0x55ddbbddae70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 -- 172.21.15.38:0/2765090322 >> 172.21.15.38:0/2765090322 conn(0x55ddbbc144f0 msgr2=0x55ddbbe1a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:58.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 -- 172.21.15.38:0/2765090322 shutdown_connections 2023-11-06T13:29:58.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 -- 172.21.15.38:0/2765090322 wait complete. 2023-11-06T13:29:58.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.727+0000 7f8d1573db80 1 -- start start 2023-11-06T13:29:58.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.728+0000 7f8d1573db80 1 Processor -- start 2023-11-06T13:29:58.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 0x55ddbbe82230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbdaa110 0x55ddbbdd6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbe2cf40 con 0x55ddbbb66e90 2023-11-06T13:29:58.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbdd6380 con 0x55ddbbdaa110 2023-11-06T13:29:58.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddbbe82720 con 0x55ddbbded8f0 2023-11-06T13:29:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d1573db80 10 client.0 ll_register_callbacks cb 0x55ddbbd6a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 0x55ddbbe82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 0x55ddbbe82230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51508/0 (socket says 172.21.15.38:51508) 2023-11-06T13:29:58.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 -- 172.21.15.38:0/2307908543 learned_addr learned my addr 172.21.15.38:0/2307908543 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:58.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d02342700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01340700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbdaa110 0x55ddbbdd6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 -- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbded8f0 msgr2=0x55ddbbdd7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 -- 172.21.15.38:0/2307908543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbdaa110 msgr2=0x55ddbbdd6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:58.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbdaa110 0x55ddbbdd6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 -- 172.21.15.38:0/2307908543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce80033f0 con 0x55ddbbb66e90 2023-11-06T13:29:58.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d02342700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:29:58.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8d01b41700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 0x55ddbbe82230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f8cec00e4b0 tx=0x7f8cec024040).ready entity=mon.0 client_cookie=3413c681ac4c5ea6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:58.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.729+0000 7f8cd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:29:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8cd7fff700 1 -- 172.21.15.38:0/2307908543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec022110 con 0x55ddbbb66e90 2023-11-06T13:29:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8cd7fff700 1 -- 172.21.15.38:0/2307908543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f8cec00ebb0 con 0x55ddbbb66e90 2023-11-06T13:29:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cf4087f20 con 0x55ddbbb66e90 2023-11-06T13:29:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8cd7fff700 1 -- 172.21.15.38:0/2307908543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cec005f70 con 0x55ddbbb66e90 2023-11-06T13:29:58.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 10 client.5253 fetch_fsmap learned FSMap version 18 2023-11-06T13:29:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ddbbb67fd0 con 0x55ddbbb66e90 2023-11-06T13:29:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8cd7fff700 1 -- 172.21.15.38:0/2307908543 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec035020 con 0x55ddbbb66e90 2023-11-06T13:29:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8cd7fff700 1 -- 172.21.15.38:0/2307908543 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 18) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f8cec029030 con 0x55ddbbb66e90 2023-11-06T13:29:58.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 10 client.5253 fetch_fsmap finished waiting for FSMap version 18 2023-11-06T13:29:58.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 10 client.5253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:58.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 20 client.5253 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:58.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe2bf40 0x55ddbbe6b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:58.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 4 client.5253 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:29:58.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ddbbb99cf0 con 0x55ddbbe2bf40 2023-11-06T13:29:58.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.730+0000 7f8d01340700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe2bf40 0x55ddbbe6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:58.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8cd7fff700 10 client.5253 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:58.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d01340700 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe2bf40 0x55ddbbe6b660 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de0875090258e3d7 server_cookie=66e1cde9c9a5b3c5 in_seq=0 out_seq=0 2023-11-06T13:29:58.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8cd7fff700 1 -- 172.21.15.38:0/2307908543 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ddbbb99cf0 con 0x55ddbbe2bf40 2023-11-06T13:29:58.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8cd7fff700 10 client.5253 handle_command_reply: tid=0 2023-11-06T13:29:58.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 client.5253 shutdown 2023-11-06T13:29:58.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 msgr2=0x55ddbbe82230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 0x55ddbbe82230 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f8cec00e4b0 tx=0x7f8cec024040).stop 2023-11-06T13:29:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 shutdown_connections 2023-11-06T13:29:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ddbbe2bf40 0x55ddbbe6b660 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ddbbded8f0 0x55ddbbdd7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ddbbb66e90 0x55ddbbe82230 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8cd7fff700 0 client.5253 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:58.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 --2- 172.21.15.38:0/2307908543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ddbbdaa110 0x55ddbbdd6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 >> 172.21.15.38:0/2307908543 conn(0x55ddbbc144f0 msgr2=0x55ddbbdd9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:58.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 shutdown_connections 2023-11-06T13:29:58.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.731+0000 7f8d1573db80 1 -- 172.21.15.38:0/2307908543 wait complete. 2023-11-06T13:29:58.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d1573db80 20 client.5253 trim_cache size 0 max 16384 2023-11-06T13:29:58.756 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:29:58.756 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:29:58.756 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:29:58.757 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:29:58.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8ce008cb90 msgr2=0x7f8ce008f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8ce008cb90 0x7f8ce008f050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f8cec009990 tx=0x7f8cec009060).stop 2023-11-06T13:29:58.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 msgr2=0x7f8cfc0f07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:58.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc0f07b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f8cf400b610 tx=0x7f8cfc0c2270).stop 2023-11-06T13:29:58.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 shutdown_connections 2023-11-06T13:29:58.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8cfc17bdf0 0x7f8cfc0f07b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8cfc17ae10 0x7f8cfc173bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8ce008cb90 0x7f8ce008f050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:58.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 --2- 172.21.15.38:0/3429938170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cfc17b1f0 0x7f8cfc0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:58.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 >> 172.21.15.38:0/3429938170 conn(0x7f8cfc0f22b0 msgr2=0x7f8cfc17e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:58.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 shutdown_connections 2023-11-06T13:29:58.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:58.732+0000 7f8d03da5700 1 -- 172.21.15.38:0/3429938170 wait complete. 2023-11-06T13:29:58.762 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:29:59.763 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:29:59.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:29:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.892+0000 7fdf29817700 1 Processor -- start 2023-11-06T13:29:59.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.892+0000 7fdf29817700 1 -- start start 2023-11-06T13:29:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf29817700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdf24176770 0x7fdf24176b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf29817700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf24085a40 con 0x7fdf240854b0 2023-11-06T13:29:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf29817700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf24085d20 con 0x7fdf24085000 2023-11-06T13:29:59.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf29817700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf24086000 con 0x7fdf24176770 2023-11-06T13:29:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf22ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdf24176770 0x7fdf24176b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf22ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdf24176770 0x7fdf24176b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:33834/0 (socket says 172.21.15.38:33834) 2023-11-06T13:29:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf22ffd700 1 -- 172.21.15.38:0/3258600497 learned_addr learned my addr 172.21.15.38:0/3258600497 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:59.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf227fc700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fdf24085000 0x7fdf2417e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:39914/0 (socket says 172.21.15.38:39914) 2023-11-06T13:29:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf22ffd700 1 -- 172.21.15.38:0/3258600497 >> v1:172.21.15.163:6789/0 conn(0x7fdf24085000 legacy=0x7fdf2417e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf22ffd700 1 -- 172.21.15.38:0/3258600497 >> v1:172.21.15.44:6789/0 conn(0x7fdf240854b0 legacy=0x7fdf2417ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf21ffb700 1 -- 172.21.15.38:0/3258600497 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305401180 0 0) 0x7fdf24085d20 con 0x7fdf24085000 2023-11-06T13:29:59.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.893+0000 7fdf22ffd700 1 -- 172.21.15.38:0/3258600497 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240862e0 con 0x7fdf24176770 2023-11-06T13:29:59.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.894+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/3258600497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf24176770 0x7fdf24176b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fdf14006fd0 tx=0x7fdf140090f0).ready entity=mon.2 client_cookie=3274d440de6354d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.894+0000 7fdf21ffb700 1 -- 172.21.15.38:0/3258600497 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400b600 con 0x7fdf24176770 2023-11-06T13:29:59.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.894+0000 7fdf21ffb700 1 -- 172.21.15.38:0/3258600497 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1400b760 con 0x7fdf24176770 2023-11-06T13:29:59.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.894+0000 7fdf21ffb700 1 -- 172.21.15.38:0/3258600497 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400bae0 con 0x7fdf24176770 2023-11-06T13:29:59.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 -- 172.21.15.38:0/3258600497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf24176770 msgr2=0x7fdf24176b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 --2- 172.21.15.38:0/3258600497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf24176770 0x7fdf24176b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fdf14006fd0 tx=0x7fdf140090f0).stop 2023-11-06T13:29:59.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 -- 172.21.15.38:0/3258600497 shutdown_connections 2023-11-06T13:29:59.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 --2- 172.21.15.38:0/3258600497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf24176770 0x7fdf24176b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 -- 172.21.15.38:0/3258600497 >> 172.21.15.38:0/3258600497 conn(0x7fdf240efc40 msgr2=0x7fdf240f0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 -- 172.21.15.38:0/3258600497 shutdown_connections 2023-11-06T13:29:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.895+0000 7fdf29817700 1 -- 172.21.15.38:0/3258600497 wait complete. 2023-11-06T13:29:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.897+0000 7fdf29817700 1 Processor -- start 2023-11-06T13:29:59.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.897+0000 7fdf29817700 1 -- start start 2023-11-06T13:29:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf29817700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf24085000 0x7fdf24166600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf29817700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 0x7fdf2418f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf29817700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf24176770 0x7fdf2418fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf29817700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2418f300 con 0x7fdf24176770 2023-11-06T13:29:59.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf29817700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2418e6f0 con 0x7fdf24085000 2023-11-06T13:29:59.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf29817700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2418e9d0 con 0x7fdf240854b0 2023-11-06T13:29:59.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 0x7fdf2418f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf24176770 0x7fdf2418fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 0x7fdf2418f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:33844/0 (socket says 172.21.15.38:33844) 2023-11-06T13:29:59.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 -- 172.21.15.38:0/2472490600 learned_addr learned my addr 172.21.15.38:0/2472490600 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:59.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf237fe700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf24176770 0x7fdf2418fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51514/0 (socket says 172.21.15.38:51514) 2023-11-06T13:29:59.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf24085000 0x7fdf24166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 -- 172.21.15.38:0/2472490600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf24085000 msgr2=0x7fdf24166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf24085000 0x7fdf24166600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 -- 172.21.15.38:0/2472490600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf24176770 msgr2=0x7fdf2418fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf24176770 0x7fdf2418fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf227fc700 1 -- 172.21.15.38:0/2472490600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009370 con 0x7fdf240854b0 2023-11-06T13:29:59.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.898+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf24085000 0x7fdf24166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:29:59.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.899+0000 7fdf227fc700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 0x7fdf2418f790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fdf1800c560 tx=0x7fdf18007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.899+0000 7fdf0affd700 1 -- 172.21.15.38:0/2472490600 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180072e0 con 0x7fdf240854b0 2023-11-06T13:29:59.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.899+0000 7fdf0affd700 1 -- 172.21.15.38:0/2472490600 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18007440 con 0x7fdf240854b0 2023-11-06T13:29:59.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.899+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2418ecb0 con 0x7fdf240854b0 2023-11-06T13:29:59.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.899+0000 7fdf0affd700 1 -- 172.21.15.38:0/2472490600 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180058f0 con 0x7fdf240854b0 2023-11-06T13:29:59.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.899+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf24190170 con 0x7fdf240854b0 2023-11-06T13:29:59.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.901+0000 7fdf0affd700 1 -- 172.21.15.38:0/2472490600 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fdf18005ce0 con 0x7fdf240854b0 2023-11-06T13:29:59.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.901+0000 7fdf0affd700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdf1008cb40 0x7fdf1008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.901+0000 7fdf0affd700 1 -- 172.21.15.38:0/2472490600 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdf180b1930 con 0x7fdf240854b0 2023-11-06T13:29:59.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.902+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdf1008cb40 0x7fdf1008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.902+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdf1008cb40 0x7fdf1008f000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fdf14009130 tx=0x7fdf14017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.906+0000 7fdf3b1afb80 1 Processor -- start 2023-11-06T13:29:59.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.906+0000 7fdf3b1afb80 1 -- start start 2023-11-06T13:29:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560dde91ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560dded2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560dde58050 con 0x5560dded5970 2023-11-06T13:29:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560dddcf2c0 con 0x5560ddc4ef10 2023-11-06T13:29:59.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ddde4510 con 0x5560dde92190 2023-11-06T13:29:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560dde91ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560dded2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560dde91ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51522/0 (socket says 172.21.15.38:51522) 2023-11-06T13:29:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560dded2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:33848/0 (socket says 172.21.15.38:33848) 2023-11-06T13:29:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 -- 172.21.15.38:0/1519475631 learned_addr learned my addr 172.21.15.38:0/1519475631 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:59.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 -- 172.21.15.38:0/1519475631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 msgr2=0x5560dded2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560dded2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 -- 172.21.15.38:0/1519475631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 msgr2=0x5560dded5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf227fc700 1 -- 172.21.15.38:0/1519475631 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560ddddd6f0 con 0x5560dded5970 2023-11-06T13:29:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.908+0000 7fdf237fe700 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560dded2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:29:59.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.909+0000 7fdf227fc700 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560dde91ca0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fdf18005fd0 tx=0x7fdf180075b0).ready entity=mon.0 client_cookie=ffb7145c9a5b5252 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.909+0000 7fdf03fff700 1 -- 172.21.15.38:0/1519475631 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18085b80 con 0x5560dded5970 2023-11-06T13:29:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.909+0000 7fdf03fff700 1 -- 172.21.15.38:0/1519475631 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1808b460 con 0x5560dded5970 2023-11-06T13:29:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.909+0000 7fdf03fff700 1 -- 172.21.15.38:0/1519475631 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18083f20 con 0x5560dded5970 2023-11-06T13:29:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1519475631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 msgr2=0x5560dde91ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560dde91ca0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fdf18005fd0 tx=0x7fdf180075b0).stop 2023-11-06T13:29:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1519475631 shutdown_connections 2023-11-06T13:29:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560dded2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1519475631 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560dde91ca0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1519475631 >> 172.21.15.38:0/1519475631 conn(0x5560ddcfc570 msgr2=0x5560dde92dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1519475631 shutdown_connections 2023-11-06T13:29:59.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.910+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1519475631 wait complete. 2023-11-06T13:29:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.911+0000 7fdf3b1afb80 1 -- start start 2023-11-06T13:29:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.911+0000 7fdf3b1afb80 1 Processor -- start 2023-11-06T13:29:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 0x5560ddecf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddec7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560dded5970 0x5560ddf12820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ddde4650 con 0x5560ddc4ef10 2023-11-06T13:29:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ddde48d0 con 0x5560dded5970 2023-11-06T13:29:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560dddafee0 con 0x5560dde92190 2023-11-06T13:29:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf3b1afb80 10 client.0 ll_register_callbacks cb 0x5560dde52450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf22ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 0x5560ddecf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf22ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 0x5560ddecf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51538/0 (socket says 172.21.15.38:51538) 2023-11-06T13:29:59.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf22ffd700 1 -- 172.21.15.38:0/323801685 learned_addr learned my addr 172.21.15.38:0/323801685 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddec7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf237fe700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560dded5970 0x5560ddf12820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 -- 172.21.15.38:0/323801685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560dded5970 msgr2=0x5560ddf12820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560dded5970 0x5560ddf12820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 -- 172.21.15.38:0/323801685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 msgr2=0x5560ddecf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 0x5560ddecf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 -- 172.21.15.38:0/323801685 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c00f040 con 0x5560dde92190 2023-11-06T13:29:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 0x5560ddecf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:29:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf227fc700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddec7050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fdf180b0000 tx=0x7fdf1808c000).ready entity=mon.2 client_cookie=66b08c0f06b5daea server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf017fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:29:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.913+0000 7fdf017fa700 1 -- 172.21.15.38:0/323801685 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18085b80 con 0x5560dde92190 2023-11-06T13:29:59.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf017fa700 1 -- 172.21.15.38:0/323801685 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdf18083f20 con 0x5560dde92190 2023-11-06T13:29:59.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560dde86710 con 0x5560dde92190 2023-11-06T13:29:59.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf017fa700 1 -- 172.21.15.38:0/323801685 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf1808b1e0 con 0x5560dde92190 2023-11-06T13:29:59.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 10 client.5135 fetch_fsmap learned FSMap version 18 2023-11-06T13:29:59.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7fdf24190170 con 0x5560dde92190 2023-11-06T13:29:59.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf017fa700 1 -- 172.21.15.38:0/323801685 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5560dde86710 con 0x5560dde92190 2023-11-06T13:29:59.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf017fa700 1 -- 172.21.15.38:0/323801685 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 18) v1 ==== 7460+0+0 (secure 0 0 0) 0x7fdf1801bbf0 con 0x5560dde92190 2023-11-06T13:29:59.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 10 client.5135 fetch_fsmap finished waiting for FSMap version 18 2023-11-06T13:29:59.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 10 client.5135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:59.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 20 client.5135 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:59.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560dded48d0 0x5560ddf14180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 4 client.5135 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:29:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560ddc4ad70 con 0x5560dded48d0 2023-11-06T13:29:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.914+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560dded48d0 0x5560ddf14180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf017fa700 10 client.5135 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:59.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560dded48d0 0x5560ddf14180 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e49e49af1579963a server_cookie=a131b46407b00371 in_seq=0 out_seq=0 2023-11-06T13:29:59.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf017fa700 1 -- 172.21.15.38:0/323801685 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5560ddc4ad70 con 0x5560dded48d0 2023-11-06T13:29:59.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf017fa700 10 client.5135 handle_command_reply: tid=0 2023-11-06T13:29:59.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 client.5135 shutdown 2023-11-06T13:29:59.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 msgr2=0x5560ddec7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddec7050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fdf180b0000 tx=0x7fdf1808c000).stop 2023-11-06T13:29:59.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 shutdown_connections 2023-11-06T13:29:59.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560dded5970 0x5560ddf12820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560ddc4ef10 0x5560ddecf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560dded48d0 0x5560ddf14180 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/323801685 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddec7050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf017fa700 0 client.5135 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:59.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 >> 172.21.15.38:0/323801685 conn(0x5560ddcfc570 msgr2=0x5560dded2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:59.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 shutdown_connections 2023-11-06T13:29:59.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.915+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/323801685 wait complete. 2023-11-06T13:29:59.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.916+0000 7fdf3b1afb80 20 client.5135 trim_cache size 0 max 16384 2023-11-06T13:29:59.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.934+0000 7fdf3b1afb80 1 Processor -- start 2023-11-06T13:29:59.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.934+0000 7fdf3b1afb80 1 -- start start 2023-11-06T13:29:59.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560ddf05600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf5d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddece620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560dded1f60 con 0x5560dded5970 2023-11-06T13:29:59.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560dded3b50 con 0x5560ddc4ef10 2023-11-06T13:29:59.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560dded75d0 con 0x5560dde92190 2023-11-06T13:29:59.952 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf5d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddece620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddece620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51550/0 (socket says 172.21.15.38:51550) 2023-11-06T13:29:59.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf237fe700 1 -- 172.21.15.38:0/1597068667 learned_addr learned my addr 172.21.15.38:0/1597068667 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:59.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf5d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:33854/0 (socket says 172.21.15.38:33854) 2023-11-06T13:29:59.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.936+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560ddf05600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf227fc700 1 -- 172.21.15.38:0/1597068667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 msgr2=0x5560ddf05600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf227fc700 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560ddf05600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf227fc700 1 -- 172.21.15.38:0/1597068667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 msgr2=0x5560ddece620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf227fc700 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddece620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf227fc700 1 -- 172.21.15.38:0/1597068667 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560dde8ef30 con 0x5560dde92190 2023-11-06T13:29:59.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf227fc700 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf5d400 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdf1800cc00 tx=0x7fdf18094000).ready entity=mon.2 client_cookie=1a19731b1142733a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf08ff9700 1 -- 172.21.15.38:0/1597068667 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18085b80 con 0x5560dde92190 2023-11-06T13:29:59.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf08ff9700 1 -- 172.21.15.38:0/1597068667 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf180854e0 con 0x5560dde92190 2023-11-06T13:29:59.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.937+0000 7fdf08ff9700 1 -- 172.21.15.38:0/1597068667 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1808b1e0 con 0x5560dde92190 2023-11-06T13:29:59.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1597068667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 msgr2=0x5560ddf5d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf5d400 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdf1800cc00 tx=0x7fdf18094000).stop 2023-11-06T13:29:59.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1597068667 shutdown_connections 2023-11-06T13:29:59.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddece620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560ddf05600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/1597068667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf5d400 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1597068667 >> 172.21.15.38:0/1597068667 conn(0x5560ddcfc570 msgr2=0x5560dde92da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.938+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1597068667 shutdown_connections 2023-11-06T13:29:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.940+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/1597068667 wait complete. 2023-11-06T13:29:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.941+0000 7fdf3b1afb80 1 -- start start 2023-11-06T13:29:59.957 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.941+0000 7fdf3b1afb80 1 Processor -- start 2023-11-06T13:29:59.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddf66e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ddf03190 con 0x5560dded5970 2023-11-06T13:29:59.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ddf69c10 con 0x5560ddc4ef10 2023-11-06T13:29:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560ddf6aa70 con 0x5560dde92190 2023-11-06T13:29:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf3b1afb80 10 client.0 ll_register_callbacks cb 0x5560dde52450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:29:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddf66e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:33862/0 (socket says 172.21.15.38:33862) 2023-11-06T13:29:59.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 -- 172.21.15.38:0/825640221 learned_addr learned my addr 172.21.15.38:0/825640221 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:29:59.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf237fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddf66e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51560/0 (socket says 172.21.15.38:51560) 2023-11-06T13:29:59.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 -- 172.21.15.38:0/825640221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 msgr2=0x5560dded4cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:29:59.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded4cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:59.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 -- 172.21.15.38:0/825640221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 msgr2=0x5560ddf66e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:29:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddf66e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf227fc700 1 -- 172.21.15.38:0/825640221 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf24190170 con 0x5560dde92190 2023-11-06T13:29:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.943+0000 7fdf237fe700 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddf66e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:29:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf227fc700 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf024c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdf18082080 tx=0x7fdf180a4000).ready entity=mon.2 client_cookie=4a434f74e91f2998 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:29:59.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf017fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:29:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf017fa700 1 -- 172.21.15.38:0/825640221 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180aa070 con 0x5560dde92190 2023-11-06T13:29:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf017fa700 1 -- 172.21.15.38:0/825640221 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdf18085b80 con 0x5560dde92190 2023-11-06T13:29:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560ddc81d70 con 0x5560dde92190 2023-11-06T13:29:59.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf017fa700 1 -- 172.21.15.38:0/825640221 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf180854e0 con 0x5560dde92190 2023-11-06T13:29:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 10 client.5141 fetch_fsmap learned FSMap version 18 2023-11-06T13:29:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5560dddd8a90 con 0x5560dde92190 2023-11-06T13:29:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf017fa700 1 -- 172.21.15.38:0/825640221 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5560ddc81d70 con 0x5560dde92190 2023-11-06T13:29:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf017fa700 1 -- 172.21.15.38:0/825640221 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 18) v1 ==== 7460+0+0 (secure 0 0 0) 0x7fdf1801bbf0 con 0x5560dde92190 2023-11-06T13:29:59.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 10 client.5141 fetch_fsmap finished waiting for FSMap version 18 2023-11-06T13:29:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 10 client.5141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:29:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 20 client.5141 populate_metadata read hostname 'smithi038' 2023-11-06T13:29:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560ddf66740 0x5560ddf53500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:29:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 4 client.5141 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:29:59.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.944+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5560ddcb0610 con 0x5560ddf66740 2023-11-06T13:29:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.945+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560ddf66740 0x5560ddf53500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:29:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.945+0000 7fdf22ffd700 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560ddf66740 0x5560ddf53500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=10b728518e93aedb server_cookie=f87c622b7a347418 in_seq=0 out_seq=0 2023-11-06T13:29:59.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.945+0000 7fdf017fa700 10 client.5141 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:59.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf017fa700 1 -- 172.21.15.38:0/825640221 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5560ddcb0610 con 0x5560ddf66740 2023-11-06T13:29:59.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf017fa700 10 client.5141 handle_command_reply: tid=0 2023-11-06T13:29:59.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 client.5141 shutdown 2023-11-06T13:29:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 msgr2=0x5560ddf024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf024c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fdf18082080 tx=0x7fdf180a4000).stop 2023-11-06T13:29:59.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 shutdown_connections 2023-11-06T13:29:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5560dded5970 0x5560ddf66e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560ddc4ef10 0x5560dded4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:29:59.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5560ddf66740 0x5560ddf53500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 --2- 172.21.15.38:0/825640221 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5560dde92190 0x5560ddf024c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf017fa700 0 client.5141 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:29:59.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 >> 172.21.15.38:0/825640221 conn(0x5560ddcfc570 msgr2=0x5560dde998b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 shutdown_connections 2023-11-06T13:29:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.946+0000 7fdf3b1afb80 1 -- 172.21.15.38:0/825640221 wait complete. 2023-11-06T13:29:59.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf3b1afb80 20 client.5141 trim_cache size 0 max 16384 2023-11-06T13:29:59.971 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:29:59.971 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:29:59.972 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "c437e413-4a1d-44ee-b206-c19a96429278", 2023-11-06T13:29:59.972 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:29:59.972 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:29:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdf1008cb40 msgr2=0x7fdf1008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdf1008cb40 0x7fdf1008f000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fdf14009130 tx=0x7fdf14017000).stop 2023-11-06T13:29:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 msgr2=0x7fdf2418f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:29:59.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 0x7fdf2418f790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fdf1800c560 tx=0x7fdf18007c90).stop 2023-11-06T13:29:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 shutdown_connections 2023-11-06T13:29:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdf24176770 0x7fdf2418fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdf1008cb40 0x7fdf1008f000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdf24085000 0x7fdf24166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 --2- 172.21.15.38:0/2472490600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdf240854b0 0x7fdf2418f790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:29:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 >> 172.21.15.38:0/2472490600 conn(0x7fdf240efc40 msgr2=0x7fdf2417e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:29:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 shutdown_connections 2023-11-06T13:29:59.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:29:59.947+0000 7fdf29817700 1 -- 172.21.15.38:0/2472490600 wait complete. 2023-11-06T13:29:59.977 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:30:00.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.110+0000 7f6436d9e700 1 Processor -- start 2023-11-06T13:30:00.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.110+0000 7f6436d9e700 1 -- start start 2023-11-06T13:30:00.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f6436d9e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f64300f10d0 0x7f643017e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f6436d9e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f643017cac0 0x7f64301857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f6436d9e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643017e250 con 0x7f6430175890 2023-11-06T13:30:00.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f6436d9e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643017d360 con 0x7f643017cac0 2023-11-06T13:30:00.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f6436d9e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643017d640 con 0x7f64300f10d0 2023-11-06T13:30:00.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f643017cac0 0x7f64301857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f643017cac0 0x7f64301857a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51568/0 (socket says 172.21.15.38:51568) 2023-11-06T13:30:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 -- 172.21.15.38:0/3929137652 learned_addr learned my addr 172.21.15.38:0/3929137652 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643559b700 1 --2- 172.21.15.38:0/3929137652 >> v2:172.21.15.163:3300/0 conn(0x7f64300f10d0 0x7f643017e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 -- 172.21.15.38:0/3929137652 >> v2:172.21.15.163:3300/0 conn(0x7f64300f10d0 msgr2=0x7f643017e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 --2- 172.21.15.38:0/3929137652 >> v2:172.21.15.163:3300/0 conn(0x7f64300f10d0 0x7f643017e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 -- 172.21.15.38:0/3929137652 >> v1:172.21.15.44:6789/0 conn(0x7f6430175890 legacy=0x7f64300cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 -- 172.21.15.38:0/3929137652 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643017d920 con 0x7f643017cac0 2023-11-06T13:30:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f643659d700 1 --2- 172.21.15.38:0/3929137652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f643017cac0 0x7f64301857a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f643008a010 tx=0x7f6428009840).ready entity=mon.0 client_cookie=e05507cc5b94985 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.112+0000 7f6434d9a700 1 -- 172.21.15.38:0/3929137652 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800e070 con 0x7f643017cac0 2023-11-06T13:30:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6434d9a700 1 -- 172.21.15.38:0/3929137652 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800ba20 con 0x7f643017cac0 2023-11-06T13:30:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6434d9a700 1 -- 172.21.15.38:0/3929137652 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800bda0 con 0x7f643017cac0 2023-11-06T13:30:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 -- 172.21.15.38:0/3929137652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f643017cac0 msgr2=0x7f64301857a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 --2- 172.21.15.38:0/3929137652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f643017cac0 0x7f64301857a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f643008a010 tx=0x7f6428009840).stop 2023-11-06T13:30:00.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 -- 172.21.15.38:0/3929137652 shutdown_connections 2023-11-06T13:30:00.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 --2- 172.21.15.38:0/3929137652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f643017cac0 0x7f64301857a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 --2- 172.21.15.38:0/3929137652 >> v2:172.21.15.163:3300/0 conn(0x7f64300f10d0 0x7f643017e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 -- 172.21.15.38:0/3929137652 >> 172.21.15.38:0/3929137652 conn(0x7f64300f5d20 msgr2=0x7f64300f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:00.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 -- 172.21.15.38:0/3929137652 shutdown_connections 2023-11-06T13:30:00.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.113+0000 7f6436d9e700 1 -- 172.21.15.38:0/3929137652 wait complete. 2023-11-06T13:30:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.115+0000 7f6436d9e700 1 Processor -- start 2023-11-06T13:30:00.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.115+0000 7f6436d9e700 1 -- start start 2023-11-06T13:30:00.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6436d9e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 0x7f643018ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6436d9e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6430175890 0x7f643016c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6436d9e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f643017cac0 0x7f6430169350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6436d9e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64301900a0 con 0x7f64300f10d0 2023-11-06T13:30:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6436d9e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643017ea80 con 0x7f6430175890 2023-11-06T13:30:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6436d9e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643017e780 con 0x7f643017cac0 2023-11-06T13:30:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 0x7f643018ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 0x7f643018ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51582/0 (socket says 172.21.15.38:51582) 2023-11-06T13:30:00.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 -- 172.21.15.38:0/1000029561 learned_addr learned my addr 172.21.15.38:0/1000029561 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f643659d700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f643017cac0 0x7f6430169350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f643559b700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6430175890 0x7f643016c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 -- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f643017cac0 msgr2=0x7f6430169350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f643017cac0 0x7f6430169350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 -- 172.21.15.38:0/1000029561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6430175890 msgr2=0x7f643016c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6430175890 0x7f643016c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f6435d9c700 1 -- 172.21.15.38:0/1000029561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6428009ae0 con 0x7f64300f10d0 2023-11-06T13:30:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.116+0000 7f643659d700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f643017cac0 0x7f6430169350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.117+0000 7f6435d9c700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 0x7f643018ec20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f642c00c470 tx=0x7f642c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.117+0000 7f6421ffb700 1 -- 172.21.15.38:0/1000029561 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0123f0 con 0x7f64300f10d0 2023-11-06T13:30:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.117+0000 7f6421ffb700 1 -- 172.21.15.38:0/1000029561 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c001e90 con 0x7f64300f10d0 2023-11-06T13:30:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.117+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643016cde0 con 0x7f64300f10d0 2023-11-06T13:30:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.117+0000 7f6421ffb700 1 -- 172.21.15.38:0/1000029561 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0127a0 con 0x7f64300f10d0 2023-11-06T13:30:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.117+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643018f4d0 con 0x7f64300f10d0 2023-11-06T13:30:00.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.119+0000 7f6421ffb700 1 -- 172.21.15.38:0/1000029561 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f642c012b10 con 0x7f64300f10d0 2023-11-06T13:30:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.120+0000 7f6421ffb700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f641408cb40 0x7f641408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.120+0000 7f6421ffb700 1 -- 172.21.15.38:0/1000029561 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f642c0b1120 con 0x7f64300f10d0 2023-11-06T13:30:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.120+0000 7f643559b700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f641408cb40 0x7f641408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.121+0000 7f643559b700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f641408cb40 0x7f641408f000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f64300cdaf0 tx=0x7f6424009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.122+0000 7f6449998b80 1 Processor -- start 2023-11-06T13:30:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.122+0000 7f6449998b80 1 -- start start 2023-11-06T13:30:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6449998b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 0x5594f44c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6449998b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6449998b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44cb7f0 0x5594f44cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6449998b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f4447fd0 con 0x5594f423ee90 2023-11-06T13:30:00.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6449998b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f43bf240 con 0x5594f44cb7f0 2023-11-06T13:30:00.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6449998b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f43d4490 con 0x5594f44c39a0 2023-11-06T13:30:00.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6435d9c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 0x5594f44c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643559b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6435d9c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 0x5594f44c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51592/0 (socket says 172.21.15.38:51592) 2023-11-06T13:30:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6435d9c700 1 -- 172.21.15.38:0/1631873564 learned_addr learned my addr 172.21.15.38:0/1631873564 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643659d700 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44cb7f0 0x5594f44cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643559b700 1 -- 172.21.15.38:0/1631873564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44cb7f0 msgr2=0x5594f44cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643559b700 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44cb7f0 0x5594f44cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643559b700 1 -- 172.21.15.38:0/1631873564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 msgr2=0x5594f44c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643559b700 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 0x5594f44c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f643559b700 1 -- 172.21.15.38:0/1631873564 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f43cd670 con 0x5594f44c39a0 2023-11-06T13:30:00.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.123+0000 7f6435d9c700 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 0x5594f44c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f643559b700 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44cb300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f64300eee80 tx=0x7f6424017000).ready entity=mon.2 client_cookie=f701542f147a3216 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f641affd700 1 -- 172.21.15.38:0/1631873564 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240148a0 con 0x5594f44c39a0 2023-11-06T13:30:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f641affd700 1 -- 172.21.15.38:0/1631873564 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424014a00 con 0x5594f44c39a0 2023-11-06T13:30:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f641affd700 1 -- 172.21.15.38:0/1631873564 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424014da0 con 0x5594f44c39a0 2023-11-06T13:30:00.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 -- 172.21.15.38:0/1631873564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 msgr2=0x5594f44cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44cb300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f64300eee80 tx=0x7f6424017000).stop 2023-11-06T13:30:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 -- 172.21.15.38:0/1631873564 shutdown_connections 2023-11-06T13:30:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44cb7f0 0x5594f44cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f423ee90 0x5594f44c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 --2- 172.21.15.38:0/1631873564 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44cb300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.124+0000 7f6449998b80 1 -- 172.21.15.38:0/1631873564 >> 172.21.15.38:0/1631873564 conn(0x5594f42ec4f0 msgr2=0x5594f44826b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.125+0000 7f6449998b80 1 -- 172.21.15.38:0/1631873564 shutdown_connections 2023-11-06T13:30:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.125+0000 7f6449998b80 1 -- 172.21.15.38:0/1631873564 wait complete. 2023-11-06T13:30:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.125+0000 7f6449998b80 1 -- start start 2023-11-06T13:30:00.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.125+0000 7f6449998b80 1 Processor -- start 2023-11-06T13:30:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4483950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f44ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f44c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f43d45d0 con 0x5594f44cb7f0 2023-11-06T13:30:00.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f43d4850 con 0x5594f44c39a0 2023-11-06T13:30:00.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f439fe60 con 0x5594f423ee90 2023-11-06T13:30:00.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 10 client.0 ll_register_callbacks cb 0x5594f44425b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:00.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f44c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6435d9c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4483950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f44c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51598/0 (socket says 172.21.15.38:51598) 2023-11-06T13:30:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 -- 172.21.15.38:0/3332301830 learned_addr learned my addr 172.21.15.38:0/3332301830 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643559b700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f44ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 -- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 msgr2=0x5594f4483950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4483950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 -- 172.21.15.38:0/3332301830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 msgr2=0x5594f44ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f44ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 -- 172.21.15.38:0/3332301830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643018f4d0 con 0x5594f44cb7f0 2023-11-06T13:30:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643559b700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f44ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:30:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6435d9c700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4483950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f643659d700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f44c5390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f642800b6c0 tx=0x7f6428009840).ready entity=mon.0 client_cookie=9358390a3cb33f38 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f640ffff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:30:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f640ffff700 1 -- 172.21.15.38:0/3332301830 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428013e50 con 0x5594f44cb7f0 2023-11-06T13:30:00.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594f4476690 con 0x5594f44cb7f0 2023-11-06T13:30:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.127+0000 7f640ffff700 1 -- 172.21.15.38:0/3332301830 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f642801f430 con 0x5594f44cb7f0 2023-11-06T13:30:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f640ffff700 1 -- 172.21.15.38:0/3332301830 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f642801f800 con 0x5594f44cb7f0 2023-11-06T13:30:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 10 client.5280 fetch_fsmap learned FSMap version 18 2023-11-06T13:30:00.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f6424011830 con 0x5594f44cb7f0 2023-11-06T13:30:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f640ffff700 1 -- 172.21.15.38:0/3332301830 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594f4476690 con 0x5594f44cb7f0 2023-11-06T13:30:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f640ffff700 1 -- 172.21.15.38:0/3332301830 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 18) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f642801f960 con 0x5594f44cb7f0 2023-11-06T13:30:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 10 client.5280 fetch_fsmap finished waiting for FSMap version 18 2023-11-06T13:30:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 10 client.5280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:00.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 20 client.5280 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44c44c0 0x5594f44c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 4 client.5280 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:30:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594f423acf0 con 0x5594f44c44c0 2023-11-06T13:30:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.128+0000 7f6435d9c700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44c44c0 0x5594f44c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f640ffff700 10 client.5280 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:00.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6435d9c700 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44c44c0 0x5594f44c48d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fe862921b9d8210b server_cookie=8031028ba27a6ddc in_seq=0 out_seq=0 2023-11-06T13:30:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f640ffff700 1 -- 172.21.15.38:0/3332301830 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5594f423acf0 con 0x5594f44c44c0 2023-11-06T13:30:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f640ffff700 10 client.5280 handle_command_reply: tid=0 2023-11-06T13:30:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 client.5280 shutdown 2023-11-06T13:30:00.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 msgr2=0x5594f44c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f44c5390 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f642800b6c0 tx=0x7f6428009840).stop 2023-11-06T13:30:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 shutdown_connections 2023-11-06T13:30:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f44c5390 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44c44c0 0x5594f44c48d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4483950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 --2- 172.21.15.38:0/3332301830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f44ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f640ffff700 0 client.5280 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.129+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 >> 172.21.15.38:0/3332301830 conn(0x5594f42ec4f0 msgr2=0x5594f4482670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.130+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 shutdown_connections 2023-11-06T13:30:00.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.130+0000 7f6449998b80 1 -- 172.21.15.38:0/3332301830 wait complete. 2023-11-06T13:30:00.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.130+0000 7f6449998b80 20 client.5280 trim_cache size 0 max 16384 2023-11-06T13:30:00.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.146+0000 7f6449998b80 1 Processor -- start 2023-11-06T13:30:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.146+0000 7f6449998b80 1 -- start start 2023-11-06T13:30:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6449998b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f423ee90 0x5594f4500a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6449998b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6449998b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6449998b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f447f370 con 0x5594f44cb7f0 2023-11-06T13:30:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6449998b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f4548480 con 0x5594f423ee90 2023-11-06T13:30:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6449998b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f44c2720 con 0x5594f44c39a0 2023-11-06T13:30:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f643659d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f643559b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f643659d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51606/0 (socket says 172.21.15.38:51606) 2023-11-06T13:30:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f643659d700 1 -- 172.21.15.38:0/3380502210 learned_addr learned my addr 172.21.15.38:0/3380502210 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.148+0000 7f6435d9c700 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f423ee90 0x5594f4500a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f643559b700 1 -- 172.21.15.38:0/3380502210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f423ee90 msgr2=0x5594f4500a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f643559b700 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f423ee90 0x5594f4500a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f643559b700 1 -- 172.21.15.38:0/3380502210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 msgr2=0x5594f4488850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f643559b700 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f643559b700 1 -- 172.21.15.38:0/3380502210 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594f43c8a10 con 0x5594f44c39a0 2023-11-06T13:30:00.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f643559b700 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44f47a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f6424002000 tx=0x7f6424023000).ready entity=mon.2 client_cookie=7cecc4d0c5299fcd server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f641b7fe700 1 -- 172.21.15.38:0/3380502210 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642402f070 con 0x5594f44c39a0 2023-11-06T13:30:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f641b7fe700 1 -- 172.21.15.38:0/3380502210 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424000c30 con 0x5594f44c39a0 2023-11-06T13:30:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.149+0000 7f641b7fe700 1 -- 172.21.15.38:0/3380502210 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240148a0 con 0x5594f44c39a0 2023-11-06T13:30:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 -- 172.21.15.38:0/3380502210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 msgr2=0x5594f44f47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44f47a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f6424002000 tx=0x7f6424023000).stop 2023-11-06T13:30:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 -- 172.21.15.38:0/3380502210 shutdown_connections 2023-11-06T13:30:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f423ee90 0x5594f4500a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 --2- 172.21.15.38:0/3380502210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f44c39a0 0x5594f44f47a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 -- 172.21.15.38:0/3380502210 >> 172.21.15.38:0/3380502210 conn(0x5594f42ec4f0 msgr2=0x5594f4479d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 -- 172.21.15.38:0/3380502210 shutdown_connections 2023-11-06T13:30:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.150+0000 7f6449998b80 1 -- 172.21.15.38:0/3380502210 wait complete. 2023-11-06T13:30:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.151+0000 7f6449998b80 1 -- start start 2023-11-06T13:30:00.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.151+0000 7f6449998b80 1 Processor -- start 2023-11-06T13:30:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4487cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f455b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f4488d40 con 0x5594f44cb7f0 2023-11-06T13:30:00.169 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f454ceb0 con 0x5594f44c39a0 2023-11-06T13:30:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594f455abb0 con 0x5594f423ee90 2023-11-06T13:30:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6449998b80 10 client.0 ll_register_callbacks cb 0x5594f44425b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.170 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51620/0 (socket says 172.21.15.38:51620) 2023-11-06T13:30:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f6435d9c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4487cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 -- 172.21.15.38:0/25809871 learned_addr learned my addr 172.21.15.38:0/25809871 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643559b700 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f455b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 -- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 msgr2=0x5594f4487cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.171 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4487cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 -- 172.21.15.38:0/25809871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 msgr2=0x5594f455b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f455b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.152+0000 7f643659d700 1 -- 172.21.15.38:0/25809871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594f43cd670 con 0x5594f44cb7f0 2023-11-06T13:30:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f643659d700 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f642800bea0 tx=0x7f6428020000).ready entity=mon.0 client_cookie=c2f1b6dd8a758cfb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f640ffff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:30:00.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f640ffff700 1 -- 172.21.15.38:0/25809871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642801fe20 con 0x5594f44cb7f0 2023-11-06T13:30:00.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6424014a00 con 0x5594f44cb7f0 2023-11-06T13:30:00.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f640ffff700 1 -- 172.21.15.38:0/25809871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f6428002030 con 0x5594f44cb7f0 2023-11-06T13:30:00.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f640ffff700 1 -- 172.21.15.38:0/25809871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f642801fa10 con 0x5594f44cb7f0 2023-11-06T13:30:00.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 10 client.5286 fetch_fsmap learned FSMap version 18 2023-11-06T13:30:00.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5594f43c8760 con 0x5594f44cb7f0 2023-11-06T13:30:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f640ffff700 1 -- 172.21.15.38:0/25809871 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424014a00 con 0x5594f44cb7f0 2023-11-06T13:30:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f640ffff700 1 -- 172.21.15.38:0/25809871 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 18) v1 ==== 7460+0+0 (secure 0 0 0) 0x7f6428032400 con 0x5594f44cb7f0 2023-11-06T13:30:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 10 client.5286 fetch_fsmap finished waiting for FSMap version 18 2023-11-06T13:30:00.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 10 client.5286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 20 client.5286 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44f1f90 0x5594f44bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 4 client.5286 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:30:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5594f4271cf0 con 0x5594f44f1f90 2023-11-06T13:30:00.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.153+0000 7f6435d9c700 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44f1f90 0x5594f44bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f640ffff700 10 client.5286 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6435d9c700 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44f1f90 0x5594f44bee10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=10f3a2a992ad286 server_cookie=ec58f44856bb7b07 in_seq=0 out_seq=0 2023-11-06T13:30:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f640ffff700 1 -- 172.21.15.38:0/25809871 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5594f4271cf0 con 0x5594f44f1f90 2023-11-06T13:30:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f640ffff700 10 client.5286 handle_command_reply: tid=0 2023-11-06T13:30:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 client.5286 shutdown 2023-11-06T13:30:00.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 msgr2=0x5594f4488850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f642800bea0 tx=0x7f6428020000).stop 2023-11-06T13:30:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 shutdown_connections 2023-11-06T13:30:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5594f44cb7f0 0x5594f4488850 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5594f44f1f90 0x5594f44bee10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5594f423ee90 0x5594f4487cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 --2- 172.21.15.38:0/25809871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5594f44c39a0 0x5594f455b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 >> 172.21.15.38:0/25809871 conn(0x5594f42ec4f0 msgr2=0x5594f44eed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f640ffff700 0 client.5286 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:00.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 shutdown_connections 2023-11-06T13:30:00.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 1 -- 172.21.15.38:0/25809871 wait complete. 2023-11-06T13:30:00.179 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.154+0000 7f6449998b80 20 client.5286 trim_cache size 0 max 16384 2023-11-06T13:30:00.179 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:30:00.179 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "scrub active (0 inodes in the stack)", 2023-11-06T13:30:00.180 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:30:00.180 INFO:teuthology.orchestra.run.smithi038.stdout: "c437e413-4a1d-44ee-b206-c19a96429278": { 2023-11-06T13:30:00.180 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:30:00.180 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "c437e413-4a1d-44ee-b206-c19a96429278", 2023-11-06T13:30:00.180 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:30:00.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:30:00.181 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:30:00.181 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:30:00.182 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f641408cb40 msgr2=0x7f641408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f641408cb40 0x7f641408f000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f64300cdaf0 tx=0x7f6424009060).stop 2023-11-06T13:30:00.183 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 msgr2=0x7f643018ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 0x7f643018ec20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f642c00c470 tx=0x7f642c007db0).stop 2023-11-06T13:30:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 shutdown_connections 2023-11-06T13:30:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f643017cac0 0x7f6430169350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f64300f10d0 0x7f643018ec20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.184 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f641408cb40 0x7f641408f000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 --2- 172.21.15.38:0/1000029561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6430175890 0x7f643016c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 >> 172.21.15.38:0/1000029561 conn(0x7f64300f5d20 msgr2=0x7f64300ee100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 shutdown_connections 2023-11-06T13:30:00.185 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:00.155+0000 7f6436d9e700 1 -- 172.21.15.38:0/1000029561 wait complete. 2023-11-06T13:30:00.186 INFO:tasks.cephfs.filesystem:scrub status for tag:c437e413-4a1d-44ee-b206-c19a96429278 - {'path': '/', 'tag': 'c437e413-4a1d-44ee-b206-c19a96429278', 'options': 'recursive,force'} 2023-11-06T13:30:00.290 INFO:tasks.workunit.client.0.smithi038.stdout: 23 465103 536 261434 455 104592 805 2023-11-06T13:30:10.290 INFO:tasks.workunit.client.0.smithi038.stdout: 30 755478 465 452561 552 259734 1409 2023-11-06T13:30:20.291 INFO:tasks.workunit.client.0.smithi038.stdout: 33 169819 211 108186 162 76169 474 2023-11-06T13:30:27.693 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:30:27.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:30:27.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:30:30.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:30:30.290 INFO:tasks.workunit.client.0.smithi038.stdout: 42 418443 511 266949 546 209751 1399 2023-11-06T13:30:30.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.308+0000 7fefd9f05700 1 Processor -- start 2023-11-06T13:30:30.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.308+0000 7fefd9f05700 1 -- start start 2023-11-06T13:30:30.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd9f05700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fefd4187370 0x7fefd40eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd9f05700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40eded0 con 0x7fefd4182c80 2023-11-06T13:30:30.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd9f05700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd40c0e00 con 0x7fefd40ecf40 2023-11-06T13:30:30.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd9f05700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd41877f0 con 0x7fefd4187370 2023-11-06T13:30:30.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd2ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fefd4187370 0x7fefd40eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd3fff700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7fefd40ecf40 0x7fefd40eb040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:50938/0 (socket says 172.21.15.38:50938) 2023-11-06T13:30:30.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd3fff700 1 -- 172.21.15.38:0/1378244639 learned_addr learned my addr 172.21.15.38:0/1378244639 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:30:30.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd2ffd700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fefd4187370 0x7fefd40eca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39306/0 (socket says 172.21.15.38:39306) 2023-11-06T13:30:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd2ffd700 1 -- 172.21.15.38:0/1378244639 >> v1:172.21.15.163:6789/0 conn(0x7fefd40ecf40 legacy=0x7fefd40eb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd27fc700 1 -- 172.21.15.38:0/1378244639 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944432703 0 0) 0x7fefd40eded0 con 0x7fefd4182c80 2023-11-06T13:30:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd2ffd700 1 -- 172.21.15.38:0/1378244639 >> v1:172.21.15.44:6789/0 conn(0x7fefd4182c80 legacy=0x7fefd40c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.309+0000 7fefd2ffd700 1 -- 172.21.15.38:0/1378244639 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40ed910 con 0x7fefd4187370 2023-11-06T13:30:30.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd2ffd700 1 --2- 172.21.15.38:0/1378244639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4187370 0x7fefd40eca50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fefc80096e0 tx=0x7fefc8009060).ready entity=mon.2 client_cookie=dd36f356906b4f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd27fc700 1 -- 172.21.15.38:0/1378244639 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80090d0 con 0x7fefd4187370 2023-11-06T13:30:30.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd27fc700 1 -- 172.21.15.38:0/1378244639 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc800f510 con 0x7fefd4187370 2023-11-06T13:30:30.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd27fc700 1 -- 172.21.15.38:0/1378244639 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc800f890 con 0x7fefd4187370 2023-11-06T13:30:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 -- 172.21.15.38:0/1378244639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4187370 msgr2=0x7fefd40eca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 --2- 172.21.15.38:0/1378244639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4187370 0x7fefd40eca50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fefc80096e0 tx=0x7fefc8009060).stop 2023-11-06T13:30:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 -- 172.21.15.38:0/1378244639 shutdown_connections 2023-11-06T13:30:30.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 --2- 172.21.15.38:0/1378244639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4187370 0x7fefd40eca50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 -- 172.21.15.38:0/1378244639 >> 172.21.15.38:0/1378244639 conn(0x7fefd40ef620 msgr2=0x7fefd405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 -- 172.21.15.38:0/1378244639 shutdown_connections 2023-11-06T13:30:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.310+0000 7fefd9f05700 1 -- 172.21.15.38:0/1378244639 wait complete. 2023-11-06T13:30:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.312+0000 7fefd9f05700 1 Processor -- start 2023-11-06T13:30:30.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.312+0000 7fefd9f05700 1 -- start start 2023-11-06T13:30:30.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd9f05700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd40ecf40 0x7fefd41708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd9f05700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 0x7fefd4195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd9f05700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd4187370 0x7fefd4196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd9f05700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd4195a00 con 0x7fefd4187370 2023-11-06T13:30:30.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd9f05700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd4194e30 con 0x7fefd40ecf40 2023-11-06T13:30:30.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd9f05700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd41950d0 con 0x7fefd4182c80 2023-11-06T13:30:30.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd4187370 0x7fefd4196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 0x7fefd4195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 0x7fefd4195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39322/0 (socket says 172.21.15.38:39322) 2023-11-06T13:30:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd2ffd700 1 -- 172.21.15.38:0/2059692459 learned_addr learned my addr 172.21.15.38:0/2059692459 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.313+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd40ecf40 0x7fefd41708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd3fff700 1 -- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 msgr2=0x7fefd4195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd3fff700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 0x7fefd4195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd3fff700 1 -- 172.21.15.38:0/2059692459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd40ecf40 msgr2=0x7fefd41708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd3fff700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd40ecf40 0x7fefd41708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd3fff700 1 -- 172.21.15.38:0/2059692459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80092a0 con 0x7fefd4187370 2023-11-06T13:30:30.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd40ecf40 0x7fefd41708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:30:30.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd2ffd700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 0x7fefd4195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:30.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd3fff700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd4187370 0x7fefd4196380 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fefcc005ad0 tx=0x7fefcc001620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefbb7fe700 1 -- 172.21.15.38:0/2059692459 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc005d30 con 0x7fefd4187370 2023-11-06T13:30:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefbb7fe700 1 -- 172.21.15.38:0/2059692459 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc005e90 con 0x7fefd4187370 2023-11-06T13:30:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd41953b0 con 0x7fefd4187370 2023-11-06T13:30:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefbb7fe700 1 -- 172.21.15.38:0/2059692459 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc007320 con 0x7fefd4187370 2023-11-06T13:30:30.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.314+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd40c7310 con 0x7fefd4187370 2023-11-06T13:30:30.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.317+0000 7fefbb7fe700 1 -- 172.21.15.38:0/2059692459 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fefcc007710 con 0x7fefd4187370 2023-11-06T13:30:30.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.318+0000 7fefbb7fe700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fefc008cb40 0x7fefc008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.318+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fefc008cb40 0x7fefc008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.318+0000 7fefbb7fe700 1 -- 172.21.15.38:0/2059692459 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fefcc0b1f30 con 0x7fefd4187370 2023-11-06T13:30:30.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.319+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fefc008cb40 0x7fefc008f000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fefc4007fd0 tx=0x7fefc4009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.319+0000 7fefeb89db80 1 Processor -- start 2023-11-06T13:30:30.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.319+0000 7fefeb89db80 1 -- start start 2023-11-06T13:30:30.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.320+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.320+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b38bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.320+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.320+0000 7fefeb89db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b351fd0 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.320+0000 7fefeb89db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b2c9240 con 0x55dc3b38c110 2023-11-06T13:30:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.320+0000 7fefeb89db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b2de490 con 0x55dc3b148e90 2023-11-06T13:30:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd2ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b38bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39324/0 (socket says 172.21.15.38:39324) 2023-11-06T13:30:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 -- 172.21.15.38:0/2187753707 learned_addr learned my addr 172.21.15.38:0/2187753707 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 -- 172.21.15.38:0/2187753707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 msgr2=0x55dc3b3ccc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:30:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3ccc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:30:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 -- 172.21.15.38:0/2187753707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 msgr2=0x55dc3b38bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b38bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 -- 172.21.15.38:0/2187753707 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3b2d7670 con 0x55dc3b148e90 2023-11-06T13:30:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cf400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fefc400e740 tx=0x7fefc4003000).ready entity=mon.2 client_cookie=22e34c8765dddb1b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefb8ff9700 1 -- 172.21.15.38:0/2187753707 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40186f0 con 0x55dc3b148e90 2023-11-06T13:30:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefb8ff9700 1 -- 172.21.15.38:0/2187753707 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4018850 con 0x55dc3b148e90 2023-11-06T13:30:30.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.321+0000 7fefb8ff9700 1 -- 172.21.15.38:0/2187753707 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4018bf0 con 0x55dc3b148e90 2023-11-06T13:30:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 -- 172.21.15.38:0/2187753707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 msgr2=0x55dc3b3cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cf400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fefc400e740 tx=0x7fefc4003000).stop 2023-11-06T13:30:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 -- 172.21.15.38:0/2187753707 shutdown_connections 2023-11-06T13:30:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:30:30.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cf400 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2187753707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b38bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.322+0000 7fefeb89db80 1 -- 172.21.15.38:0/2187753707 >> 172.21.15.38:0/2187753707 conn(0x55dc3b1f64f0 msgr2=0x55dc3b38cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.323+0000 7fefeb89db80 1 -- 172.21.15.38:0/2187753707 shutdown_connections 2023-11-06T13:30:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.323+0000 7fefeb89db80 1 -- 172.21.15.38:0/2187753707 wait complete. 2023-11-06T13:30:30.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.324+0000 7fefeb89db80 1 -- start start 2023-11-06T13:30:30.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.324+0000 7fefeb89db80 1 Processor -- start 2023-11-06T13:30:30.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b148e90 0x55dc3b3fced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b40ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b2de5d0 con 0x55dc3b148e90 2023-11-06T13:30:30.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b2de850 con 0x55dc3b38c110 2023-11-06T13:30:30.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b2a9e60 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefeb89db80 10 client.0 ll_register_callbacks cb 0x55dc3b34c3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:30.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b40ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b148e90 0x55dc3b3fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b40ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39338/0 (socket says 172.21.15.38:39338) 2023-11-06T13:30:30.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 -- 172.21.15.38:0/2946081418 learned_addr learned my addr 172.21.15.38:0/2946081418 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:30.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd2ffd700 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 -- 172.21.15.38:0/2946081418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 msgr2=0x55dc3b3bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 -- 172.21.15.38:0/2946081418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b148e90 msgr2=0x55dc3b3fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.325+0000 7fefd3fff700 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b148e90 0x55dc3b3fced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefd3fff700 1 -- 172.21.15.38:0/2946081418 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc400f040 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefd3fff700 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b40ce70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fefcc086190 tx=0x7fefcc001810).ready entity=mon.2 client_cookie=3d6a1ec10e6aaabb server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:30:30.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefb1ffb700 1 -- 172.21.15.38:0/2946081418 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc08bae0 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefb1ffb700 1 -- 172.21.15.38:0/2946081418 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fefcc01adb0 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc3b380690 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefb1ffb700 1 -- 172.21.15.38:0/2946081418 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefcc0856f0 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 10 client.5174 fetch_fsmap learned FSMap version 22 2023-11-06T13:30:30.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55dc3b2d2a10 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefb1ffb700 1 -- 172.21.15.38:0/2946081418 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc3b380690 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefb1ffb700 1 -- 172.21.15.38:0/2946081418 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7fefcc08b650 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 10 client.5174 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:30:30.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 10 client.5174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:30.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 20 client.5174 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:30.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b3fff60 0x55dc3b40d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 4 client.5174 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:30:30.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.326+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc3b144cf0 con 0x55dc3b3fff60 2023-11-06T13:30:30.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.327+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b3fff60 0x55dc3b40d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.327+0000 7fefd37fe700 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b3fff60 0x55dc3b40d360 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3933146dac39732 server_cookie=b1e35ba9c3a340cd in_seq=0 out_seq=0 2023-11-06T13:30:30.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.327+0000 7fefb1ffb700 10 client.5174 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.327+0000 7fefb1ffb700 1 -- 172.21.15.38:0/2946081418 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55dc3b144cf0 con 0x55dc3b3fff60 2023-11-06T13:30:30.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.327+0000 7fefb1ffb700 10 client.5174 handle_command_reply: tid=0 2023-11-06T13:30:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 client.5174 shutdown 2023-11-06T13:30:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 msgr2=0x55dc3b40ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b40ce70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fefcc086190 tx=0x7fefcc001810).stop 2023-11-06T13:30:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 shutdown_connections 2023-11-06T13:30:30.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b3fff60 0x55dc3b40d360 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b40ce70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b148e90 0x55dc3b3fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefb1ffb700 0 client.5174 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 --2- 172.21.15.38:0/2946081418 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 >> 172.21.15.38:0/2946081418 conn(0x55dc3b1f64f0 msgr2=0x55dc3b3ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:30.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 shutdown_connections 2023-11-06T13:30:30.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 1 -- 172.21.15.38:0/2946081418 wait complete. 2023-11-06T13:30:30.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.328+0000 7fefeb89db80 20 client.5174 trim_cache size 0 max 16384 2023-11-06T13:30:30.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.346+0000 7fefeb89db80 1 Processor -- start 2023-11-06T13:30:30.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.347+0000 7fefeb89db80 1 -- start start 2023-11-06T13:30:30.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b3d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefeb89db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b386830 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefeb89db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b383d80 con 0x55dc3b38c110 2023-11-06T13:30:30.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefeb89db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b384270 con 0x55dc3b148e90 2023-11-06T13:30:30.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b3d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b3d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51732/0 (socket says 172.21.15.38:51732) 2023-11-06T13:30:30.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd3fff700 1 -- 172.21.15.38:0/82182211 learned_addr learned my addr 172.21.15.38:0/82182211 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:30.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd2ffd700 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 -- 172.21.15.38:0/82182211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 msgr2=0x55dc3b3d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 -- 172.21.15.38:0/82182211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 msgr2=0x55dc3b3d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b3d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 -- 172.21.15.38:0/82182211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3b3802b0 con 0x55dc3b148e90 2023-11-06T13:30:30.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefd37fe700 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cefb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fefc401d000 tx=0x7fefc4016000).ready entity=mon.2 client_cookie=4f67593f568ca2e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefb97fa700 1 -- 172.21.15.38:0/82182211 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4029070 con 0x55dc3b148e90 2023-11-06T13:30:30.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefb97fa700 1 -- 172.21.15.38:0/82182211 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc402a040 con 0x55dc3b148e90 2023-11-06T13:30:30.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.348+0000 7fefb97fa700 1 -- 172.21.15.38:0/82182211 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc402d280 con 0x55dc3b148e90 2023-11-06T13:30:30.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 -- 172.21.15.38:0/82182211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 msgr2=0x55dc3b3cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cefb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fefc401d000 tx=0x7fefc4016000).stop 2023-11-06T13:30:30.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 -- 172.21.15.38:0/82182211 shutdown_connections 2023-11-06T13:30:30.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b3d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b3cefb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 --2- 172.21.15.38:0/82182211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b3d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 -- 172.21.15.38:0/82182211 >> 172.21.15.38:0/82182211 conn(0x55dc3b1f64f0 msgr2=0x55dc3b3ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:30.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 -- 172.21.15.38:0/82182211 shutdown_connections 2023-11-06T13:30:30.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.349+0000 7fefeb89db80 1 -- 172.21.15.38:0/82182211 wait complete. 2023-11-06T13:30:30.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.350+0000 7fefeb89db80 1 -- start start 2023-11-06T13:30:30.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.350+0000 7fefeb89db80 1 Processor -- start 2023-11-06T13:30:30.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b38d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b386980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b457f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b461c20 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b464800 con 0x55dc3b38c110 2023-11-06T13:30:30.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3b4650a0 con 0x55dc3b148e90 2023-11-06T13:30:30.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefeb89db80 10 client.0 ll_register_callbacks cb 0x55dc3b34c3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:30.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b457f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b38d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b457f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51744/0 (socket says 172.21.15.38:51744) 2023-11-06T13:30:30.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b38d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39364/0 (socket says 172.21.15.38:39364) 2023-11-06T13:30:30.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefd3fff700 1 -- 172.21.15.38:0/4265174714 learned_addr learned my addr 172.21.15.38:0/4265174714 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:30.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.351+0000 7fefd2ffd700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b386980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd3fff700 1 -- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 msgr2=0x55dc3b38d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd3fff700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b38d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd3fff700 1 -- 172.21.15.38:0/4265174714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 msgr2=0x55dc3b386980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:30.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd3fff700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b386980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd3fff700 1 -- 172.21.15.38:0/4265174714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc3b2d7670 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd37fe700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b38d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:30.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefd3fff700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b457f00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fefcc085f00 tx=0x7fefcc0b1000).ready entity=mon.0 client_cookie=f4e388d038cc0b1a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:30.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:30:30.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefb1ffb700 1 -- 172.21.15.38:0/4265174714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0079c0 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefb1ffb700 1 -- 172.21.15.38:0/4265174714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fefcc08bae0 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefc4018850 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefb1ffb700 1 -- 172.21.15.38:0/4265174714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefcc082540 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 10 client.5301 fetch_fsmap learned FSMap version 22 2023-11-06T13:30:30.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55dc3b2d2760 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefb1ffb700 1 -- 172.21.15.38:0/4265174714 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4018850 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefb1ffb700 1 -- 172.21.15.38:0/4265174714 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7fefcc01a020 con 0x55dc3b3cf8f0 2023-11-06T13:30:30.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 10 client.5301 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:30:30.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 10 client.5301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:30.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 20 client.5301 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:30.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b461280 0x55dc3b38ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:30.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 4 client.5301 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:30:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.352+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dc3b17bcf0 con 0x55dc3b461280 2023-11-06T13:30:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefd37fe700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b461280 0x55dc3b38ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefd37fe700 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b461280 0x55dc3b38ab70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5dab5e3fc4c5652e server_cookie=5b1d6682e1f60eed in_seq=0 out_seq=0 2023-11-06T13:30:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefb1ffb700 10 client.5301 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:30.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefb1ffb700 1 -- 172.21.15.38:0/4265174714 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55dc3b17bcf0 con 0x55dc3b461280 2023-11-06T13:30:30.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefb1ffb700 10 client.5301 handle_command_reply: tid=0 2023-11-06T13:30:30.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 client.5301 shutdown 2023-11-06T13:30:30.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 msgr2=0x55dc3b457f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b457f00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fefcc085f00 tx=0x7fefcc0b1000).stop 2023-11-06T13:30:30.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 shutdown_connections 2023-11-06T13:30:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55dc3b3cf8f0 0x55dc3b457f00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55dc3b461280 0x55dc3b38ab70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc3b148e90 0x55dc3b38d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefb1ffb700 0 client.5301 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:30.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 --2- 172.21.15.38:0/4265174714 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55dc3b38c110 0x55dc3b386980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 >> 172.21.15.38:0/4265174714 conn(0x55dc3b1f64f0 msgr2=0x55dc3b3d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.353+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 shutdown_connections 2023-11-06T13:30:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefeb89db80 1 -- 172.21.15.38:0/4265174714 wait complete. 2023-11-06T13:30:30.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefeb89db80 20 client.5301 trim_cache size 0 max 16384 2023-11-06T13:30:30.374 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:30:30.374 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:30:30.374 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:30:30.374 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:30:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fefc008cb40 msgr2=0x7fefc008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fefc008cb40 0x7fefc008f000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fefc4007fd0 tx=0x7fefc4009040).stop 2023-11-06T13:30:30.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd4187370 msgr2=0x7fefd4196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd4187370 0x7fefd4196380 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fefcc005ad0 tx=0x7fefcc001620).stop 2023-11-06T13:30:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 shutdown_connections 2023-11-06T13:30:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fefd4187370 0x7fefd4196380 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fefc008cb40 0x7fefc008f000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd40ecf40 0x7fefd41708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 --2- 172.21.15.38:0/2059692459 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fefd4182c80 0x7fefd4195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.354+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 >> 172.21.15.38:0/2059692459 conn(0x7fefd40ef620 msgr2=0x7fefd405e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.355+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 shutdown_connections 2023-11-06T13:30:30.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:30.355+0000 7fefd9f05700 1 -- 172.21.15.38:0/2059692459 wait complete. 2023-11-06T13:30:30.379 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:30:31.380 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:30:31.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:30:31.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.547+0000 7ffa2fe43700 1 Processor -- start 2023-11-06T13:30:31.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.548+0000 7ffa2fe43700 1 -- start start 2023-11-06T13:30:31.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2fe43700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa2817dfa0 0x7ffa2817bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2fe43700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2817d120 con 0x7ffa280842d0 2023-11-06T13:30:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2fe43700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa280ec4a0 con 0x7ffa28172670 2023-11-06T13:30:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2fe43700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280847e0 con 0x7ffa2817dfa0 2023-11-06T13:30:31.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2e3e0700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffa2817dfa0 0x7ffa2817bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2dbdf700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7ffa28172670 0x7ffa28083bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:50942/0 (socket says 172.21.15.38:50942) 2023-11-06T13:30:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/1357642646 learned_addr learned my addr 172.21.15.38:0/1357642646 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:30:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2cbdd700 1 -- 172.21.15.38:0/1357642646 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134904472 0 0) 0x7ffa280ec4a0 con 0x7ffa28172670 2023-11-06T13:30:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2cbdd700 1 -- 172.21.15.38:0/1357642646 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa140033f0 con 0x7ffa28172670 2023-11-06T13:30:31.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/1357642646 >> v1:172.21.15.163:6789/0 conn(0x7ffa28172670 legacy=0x7ffa28083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/1357642646 >> v1:172.21.15.44:6789/0 conn(0x7ffa280842d0 legacy=0x7ffa2817d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.549+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/1357642646 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28084ac0 con 0x7ffa2817dfa0 2023-11-06T13:30:31.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/1357642646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa2817dfa0 0x7ffa2817bc50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ffa20009e60 tx=0x7ffa20009780).ready entity=mon.0 client_cookie=872f46c7c4e4e260 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2cbdd700 1 -- 172.21.15.38:0/1357642646 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000e070 con 0x7ffa2817dfa0 2023-11-06T13:30:31.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2cbdd700 1 -- 172.21.15.38:0/1357642646 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000bb60 con 0x7ffa2817dfa0 2023-11-06T13:30:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2cbdd700 1 -- 172.21.15.38:0/1357642646 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20012410 con 0x7ffa2817dfa0 2023-11-06T13:30:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2fe43700 1 -- 172.21.15.38:0/1357642646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa2817dfa0 msgr2=0x7ffa2817bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/1357642646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa2817dfa0 0x7ffa2817bc50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ffa20009e60 tx=0x7ffa20009780).stop 2023-11-06T13:30:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.550+0000 7ffa2fe43700 1 -- 172.21.15.38:0/1357642646 shutdown_connections 2023-11-06T13:30:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.551+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/1357642646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa2817dfa0 0x7ffa2817bc50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.551+0000 7ffa2fe43700 1 -- 172.21.15.38:0/1357642646 >> 172.21.15.38:0/1357642646 conn(0x7ffa280ef610 msgr2=0x7ffa2805e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.551+0000 7ffa2fe43700 1 -- 172.21.15.38:0/1357642646 shutdown_connections 2023-11-06T13:30:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.551+0000 7ffa2fe43700 1 -- 172.21.15.38:0/1357642646 wait complete. 2023-11-06T13:30:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.553+0000 7ffa2fe43700 1 Processor -- start 2023-11-06T13:30:31.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.553+0000 7ffa2fe43700 1 -- start start 2023-11-06T13:30:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2fe43700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa280842d0 0x7ffa2818e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2fe43700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 0x7ffa2815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2fe43700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa2817dfa0 0x7ffa2815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2fe43700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2816fdc0 con 0x7ffa28172670 2023-11-06T13:30:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2fe43700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2816ca00 con 0x7ffa2817dfa0 2023-11-06T13:30:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2fe43700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2816cca0 con 0x7ffa280842d0 2023-11-06T13:30:31.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2d3de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 0x7ffa2815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2d3de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 0x7ffa2815e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51762/0 (socket says 172.21.15.38:51762) 2023-11-06T13:30:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2d3de700 1 -- 172.21.15.38:0/2579003559 learned_addr learned my addr 172.21.15.38:0/2579003559 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.554+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa280842d0 0x7ffa2818e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa2817dfa0 0x7ffa2815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2d3de700 1 -- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa280842d0 msgr2=0x7ffa2818e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa280842d0 0x7ffa2818e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2d3de700 1 -- 172.21.15.38:0/2579003559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa2817dfa0 msgr2=0x7ffa2815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa2817dfa0 0x7ffa2815ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2d3de700 1 -- 172.21.15.38:0/2579003559 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20009a20 con 0x7ffa28172670 2023-11-06T13:30:31.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa2817dfa0 0x7ffa2815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:30:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 0x7ffa2815e770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ffa1800c440 tx=0x7ffa18007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa1dffb700 1 -- 172.21.15.38:0/2579003559 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18012400 con 0x7ffa28172670 2023-11-06T13:30:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2816cf80 con 0x7ffa28172670 2023-11-06T13:30:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa1dffb700 1 -- 172.21.15.38:0/2579003559 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18012560 con 0x7ffa28172670 2023-11-06T13:30:31.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa1dffb700 1 -- 172.21.15.38:0/2579003559 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18012920 con 0x7ffa28172670 2023-11-06T13:30:31.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.555+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2816d540 con 0x7ffa28172670 2023-11-06T13:30:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.558+0000 7ffa1dffb700 1 -- 172.21.15.38:0/2579003559 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7ffa1801b3b0 con 0x7ffa28172670 2023-11-06T13:30:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.559+0000 7ffa1dffb700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa0c08cb40 0x7ffa0c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.559+0000 7ffa1dffb700 1 -- 172.21.15.38:0/2579003559 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ffa180b16e0 con 0x7ffa28172670 2023-11-06T13:30:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.559+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa0c08cb40 0x7ffa0c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.559+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa0c08cb40 0x7ffa0c08f000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ffa24005750 tx=0x7ffa24009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.560+0000 7ffa417dbb80 1 Processor -- start 2023-11-06T13:30:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.560+0000 7ffa417dbb80 1 -- start start 2023-11-06T13:30:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a973575f10 0x55a9737fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737fc970 0x55a9737b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a9737f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97377f050 con 0x55a9737b9190 2023-11-06T13:30:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9736f62c0 con 0x55a973575f10 2023-11-06T13:30:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97370b510 con 0x55a9737fc970 2023-11-06T13:30:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa2e3e0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a9737f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa2e3e0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a9737f9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51764/0 (socket says 172.21.15.38:51764) 2023-11-06T13:30:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa2d3de700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737fc970 0x55a9737b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.562+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/2815577008 learned_addr learned my addr 172.21.15.38:0/2815577008 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a973575f10 0x55a9737fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/2815577008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737fc970 msgr2=0x55a9737b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737fc970 0x55a9737b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/2815577008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a973575f10 msgr2=0x55a9737fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a973575f10 0x55a9737fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2e3e0700 1 -- 172.21.15.38:0/2815577008 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9737046f0 con 0x55a9737b9190 2023-11-06T13:30:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737fc970 0x55a9737b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:31.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a9737f9c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7ffa280ec740 tx=0x7ffa20009780).ready entity=mon.0 client_cookie=d993c15500a7d13d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa12ffd700 1 -- 172.21.15.38:0/2815577008 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200070e0 con 0x55a9737b9190 2023-11-06T13:30:31.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa12ffd700 1 -- 172.21.15.38:0/2815577008 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000bcd0 con 0x55a9737b9190 2023-11-06T13:30:31.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.563+0000 7ffa12ffd700 1 -- 172.21.15.38:0/2815577008 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20012990 con 0x55a9737b9190 2023-11-06T13:30:31.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 -- 172.21.15.38:0/2815577008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 msgr2=0x55a9737f9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a9737f9c80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7ffa280ec740 tx=0x7ffa20009780).stop 2023-11-06T13:30:31.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 -- 172.21.15.38:0/2815577008 shutdown_connections 2023-11-06T13:30:31.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a9737f9c80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a973575f10 0x55a9737fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/2815577008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737fc970 0x55a9737b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 -- 172.21.15.38:0/2815577008 >> 172.21.15.38:0/2815577008 conn(0x55a973623570 msgr2=0x55a9737b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 -- 172.21.15.38:0/2815577008 shutdown_connections 2023-11-06T13:30:31.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.564+0000 7ffa417dbb80 1 -- 172.21.15.38:0/2815577008 wait complete. 2023-11-06T13:30:31.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.565+0000 7ffa417dbb80 1 -- start start 2023-11-06T13:30:31.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.565+0000 7ffa417dbb80 1 Processor -- start 2023-11-06T13:30:31.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.567+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a9737ec350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.567+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.567+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a97382aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.567+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97370b650 con 0x55a973575f10 2023-11-06T13:30:31.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.567+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97370b8d0 con 0x55a9737fc970 2023-11-06T13:30:31.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.567+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9736d6ee0 con 0x55a9737b9190 2023-11-06T13:30:31.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa417dbb80 10 client.0 ll_register_callbacks cb 0x55a973779450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2dbdf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a9737ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2dbdf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a9737ec350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51778/0 (socket says 172.21.15.38:51778) 2023-11-06T13:30:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/60025777 learned_addr learned my addr 172.21.15.38:0/60025777 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a97382aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 -- 172.21.15.38:0/60025777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 msgr2=0x55a97382aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a97382aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 -- 172.21.15.38:0/60025777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 msgr2=0x55a9737ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a9737ec350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 -- 172.21.15.38:0/60025777 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2816d540 con 0x55a9737b9190 2023-11-06T13:30:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a9737ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737f6760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ffa1800c410 tx=0x7ffa180b1040).ready entity=mon.2 client_cookie=73ddb90a73c99ba1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa07fff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:30:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa07fff700 1 -- 172.21.15.38:0/60025777 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18085130 con 0x55a9737b9190 2023-11-06T13:30:31.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa07fff700 1 -- 172.21.15.38:0/60025777 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ffa1808ae00 con 0x55a9737b9190 2023-11-06T13:30:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9737ad710 con 0x55a9737b9190 2023-11-06T13:30:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.568+0000 7ffa07fff700 1 -- 172.21.15.38:0/60025777 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa1808b060 con 0x55a9737b9190 2023-11-06T13:30:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 10 client.5192 fetch_fsmap learned FSMap version 22 2023-11-06T13:30:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7ffa28084ac0 con 0x55a9737b9190 2023-11-06T13:30:31.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa07fff700 1 -- 172.21.15.38:0/60025777 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9737ad710 con 0x55a9737b9190 2023-11-06T13:30:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa07fff700 1 -- 172.21.15.38:0/60025777 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7ffa180819b0 con 0x55a9737b9190 2023-11-06T13:30:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 10 client.5192 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:30:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 10 client.5192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 20 client.5192 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97382a610 0x55a9737fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 4 client.5192 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:30:31.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a973571d70 con 0x55a97382a610 2023-11-06T13:30:31.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.569+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97382a610 0x55a9737fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa07fff700 10 client.5192 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97382a610 0x55a9737fb8d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7d93fece082cda9a server_cookie=ad3724ddc9d0bf64 in_seq=0 out_seq=0 2023-11-06T13:30:31.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa07fff700 1 -- 172.21.15.38:0/60025777 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a973571d70 con 0x55a97382a610 2023-11-06T13:30:31.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa07fff700 10 client.5192 handle_command_reply: tid=0 2023-11-06T13:30:31.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa417dbb80 1 client.5192 shutdown 2023-11-06T13:30:31.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 msgr2=0x55a9737f6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.570+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737f6760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ffa1800c410 tx=0x7ffa180b1040).stop 2023-11-06T13:30:31.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 shutdown_connections 2023-11-06T13:30:31.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a97382aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a9737ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97382a610 0x55a9737fb8d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/60025777 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737f6760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 >> 172.21.15.38:0/60025777 conn(0x55a973623570 msgr2=0x55a973828120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa07fff700 0 client.5192 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 shutdown_connections 2023-11-06T13:30:31.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 1 -- 172.21.15.38:0/60025777 wait complete. 2023-11-06T13:30:31.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.571+0000 7ffa417dbb80 20 client.5192 trim_cache size 0 max 16384 2023-11-06T13:30:31.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.588+0000 7ffa417dbb80 1 Processor -- start 2023-11-06T13:30:31.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.588+0000 7ffa417dbb80 1 -- start start 2023-11-06T13:30:31.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a973829a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9737ebae0 con 0x55a973575f10 2023-11-06T13:30:31.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9737fc440 con 0x55a9737fc970 2023-11-06T13:30:31.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973829370 con 0x55a9737b9190 2023-11-06T13:30:31.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa2dbdf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a973829a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa2dbdf700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a973829a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51788/0 (socket says 172.21.15.38:51788) 2023-11-06T13:30:31.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/687784151 learned_addr learned my addr 172.21.15.38:0/687784151 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.589+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.595 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/687784151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 msgr2=0x55a9737b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/687784151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 msgr2=0x55a9737ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/687784151 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9737ad330 con 0x55a973575f10 2023-11-06T13:30:31.596 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:30:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a973829a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7ffa24001ed0 tx=0x7ffa2400a000).ready entity=mon.0 client_cookie=dd8ecb201d3bcca6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa137fe700 1 -- 172.21.15.38:0/687784151 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2402aa60 con 0x55a973575f10 2023-11-06T13:30:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa137fe700 1 -- 172.21.15.38:0/687784151 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2402abc0 con 0x55a973575f10 2023-11-06T13:30:31.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.590+0000 7ffa137fe700 1 -- 172.21.15.38:0/687784151 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24022410 con 0x55a973575f10 2023-11-06T13:30:31.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 -- 172.21.15.38:0/687784151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 msgr2=0x55a973829a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a973829a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7ffa24001ed0 tx=0x7ffa2400a000).stop 2023-11-06T13:30:31.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 -- 172.21.15.38:0/687784151 shutdown_connections 2023-11-06T13:30:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a973575f10 0x55a973829a70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/687784151 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a9737b9190 0x55a9737b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 -- 172.21.15.38:0/687784151 >> 172.21.15.38:0/687784151 conn(0x55a973623570 msgr2=0x55a9737f3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 -- 172.21.15.38:0/687784151 shutdown_connections 2023-11-06T13:30:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.591+0000 7ffa417dbb80 1 -- 172.21.15.38:0/687784151 wait complete. 2023-11-06T13:30:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.592+0000 7ffa417dbb80 1 -- start start 2023-11-06T13:30:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.592+0000 7ffa417dbb80 1 Processor -- start 2023-11-06T13:30:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 0x55a973892370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a973884cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97388eac0 con 0x55a9737b9190 2023-11-06T13:30:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97388e8c0 con 0x55a9737fc970 2023-11-06T13:30:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973892d80 con 0x55a973575f10 2023-11-06T13:30:31.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa417dbb80 10 client.0 ll_register_callbacks cb 0x55a973779450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2d3de700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a973884cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 0x55a973892370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 0x55a973892370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:39406/0 (socket says 172.21.15.38:39406) 2023-11-06T13:30:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/1610991600 learned_addr learned my addr 172.21.15.38:0/1610991600 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/1610991600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 msgr2=0x55a9737ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/1610991600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 msgr2=0x55a973884cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a973884cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2dbdf700 1 -- 172.21.15.38:0/1610991600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa28084ac0 con 0x55a973575f10 2023-11-06T13:30:31.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.594+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a973884cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:30:31.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa2e3e0700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:30:31.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa2dbdf700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 0x55a973892370 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ffa2400f4b0 tx=0x7ffa24016030).ready entity=mon.2 client_cookie=c5c3f66c71c98d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa07fff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:30:31.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa07fff700 1 -- 172.21.15.38:0/1610991600 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24022410 con 0x55a973575f10 2023-11-06T13:30:31.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa2000bcd0 con 0x55a973575f10 2023-11-06T13:30:31.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa07fff700 1 -- 172.21.15.38:0/1610991600 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ffa240353f0 con 0x55a973575f10 2023-11-06T13:30:31.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa07fff700 1 -- 172.21.15.38:0/1610991600 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa2402aa60 con 0x55a973575f10 2023-11-06T13:30:31.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 10 client.5198 fetch_fsmap learned FSMap version 22 2023-11-06T13:30:31.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7ffa140033f0 con 0x55a973575f10 2023-11-06T13:30:31.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa07fff700 1 -- 172.21.15.38:0/1610991600 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000bcd0 con 0x55a973575f10 2023-11-06T13:30:31.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa07fff700 1 -- 172.21.15.38:0/1610991600 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7ffa240357c0 con 0x55a973575f10 2023-11-06T13:30:31.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 10 client.5198 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:30:31.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 10 client.5198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:31.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 20 client.5198 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.595+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97387e0c0 0x55a973828820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.596+0000 7ffa417dbb80 4 client.5198 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:30:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.596+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a9735a8d70 con 0x55a97387e0c0 2023-11-06T13:30:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.596+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97387e0c0 0x55a973828820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.597+0000 7ffa07fff700 10 client.5198 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.597+0000 7ffa2d3de700 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97387e0c0 0x55a973828820 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4212ecc9c8a4d91e server_cookie=509a2f8bb2e77a19 in_seq=0 out_seq=0 2023-11-06T13:30:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa07fff700 1 -- 172.21.15.38:0/1610991600 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a9735a8d70 con 0x55a97387e0c0 2023-11-06T13:30:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa07fff700 10 client.5198 handle_command_reply: tid=0 2023-11-06T13:30:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 client.5198 shutdown 2023-11-06T13:30:31.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 msgr2=0x55a973892370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 0x55a973892370 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ffa2400f4b0 tx=0x7ffa24016030).stop 2023-11-06T13:30:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 shutdown_connections 2023-11-06T13:30:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a9737fc970 0x55a9737ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a97387e0c0 0x55a973828820 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a973575f10 0x55a973892370 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 --2- 172.21.15.38:0/1610991600 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a9737b9190 0x55a973884cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 >> 172.21.15.38:0/1610991600 conn(0x55a973623570 msgr2=0x55a973838ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa07fff700 0 client.5198 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 shutdown_connections 2023-11-06T13:30:31.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.598+0000 7ffa417dbb80 1 -- 172.21.15.38:0/1610991600 wait complete. 2023-11-06T13:30:31.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa417dbb80 20 client.5198 trim_cache size 0 max 16384 2023-11-06T13:30:31.615 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:30:31.615 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:30:31.615 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:30:31.616 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:30:31.616 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:30:31.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa0c08cb40 msgr2=0x7ffa0c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa0c08cb40 0x7ffa0c08f000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7ffa24005750 tx=0x7ffa24009040).stop 2023-11-06T13:30:31.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 msgr2=0x7ffa2815e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 0x7ffa2815e770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ffa1800c440 tx=0x7ffa18007db0).stop 2023-11-06T13:30:31.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 shutdown_connections 2023-11-06T13:30:31.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffa0c08cb40 0x7ffa0c08f000 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0x7ffa24005750 tx=0x7ffa24009040).stop 2023-11-06T13:30:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa2817dfa0 0x7ffa2815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffa280842d0 0x7ffa2818e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 --2- 172.21.15.38:0/2579003559 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffa28172670 0x7ffa2815e770 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.599+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 >> 172.21.15.38:0/2579003559 conn(0x7ffa280ef610 msgr2=0x7ffa2805e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.600+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 shutdown_connections 2023-11-06T13:30:31.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.600+0000 7ffa2fe43700 1 -- 172.21.15.38:0/2579003559 wait complete. 2023-11-06T13:30:31.619 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:30:31.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.742+0000 7f750d5fc700 1 Processor -- start 2023-11-06T13:30:31.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.742+0000 7f750d5fc700 1 -- start start 2023-11-06T13:30:31.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.743+0000 7f750d5fc700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75080f10d0 0x7f750817e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.743+0000 7f750d5fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f750817cac0 0x7f75081857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.743+0000 7f750d5fc700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750817e250 con 0x7f7508175890 2023-11-06T13:30:31.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.743+0000 7f750d5fc700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750817d360 con 0x7f750817cac0 2023-11-06T13:30:31.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.743+0000 7f750d5fc700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750817d640 con 0x7f75080f10d0 2023-11-06T13:30:31.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f750817cac0 0x7f75081857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f750817cac0 0x7f75081857a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51804/0 (socket says 172.21.15.38:51804) 2023-11-06T13:30:31.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 -- 172.21.15.38:0/2746279552 learned_addr learned my addr 172.21.15.38:0/2746279552 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 -- 172.21.15.38:0/2746279552 >> v2:172.21.15.44:3300/0 conn(0x7f75080f10d0 msgr2=0x7f750817e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f75077fe700 1 --2- 172.21.15.38:0/2746279552 >> v2:172.21.15.44:3300/0 conn(0x7f75080f10d0 0x7f750817e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 --2- 172.21.15.38:0/2746279552 >> v2:172.21.15.44:3300/0 conn(0x7f75080f10d0 0x7f750817e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 -- 172.21.15.38:0/2746279552 >> v1:172.21.15.163:6789/0 conn(0x7f7508175890 legacy=0x7f75080cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f7506ffd700 1 -- 172.21.15.38:0/2746279552 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970764431 0 0) 0x7f750817e250 con 0x7f7508175890 2023-11-06T13:30:31.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 -- 172.21.15.38:0/2746279552 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750817d920 con 0x7f750817cac0 2023-11-06T13:30:31.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f75077fe700 1 --2- 172.21.15.38:0/2746279552 >> v2:172.21.15.44:3300/0 conn(0x7f75080f10d0 0x7f750817e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:30:31.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f750cdfb700 1 --2- 172.21.15.38:0/2746279552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f750817cac0 0x7f75081857a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f750808a010 tx=0x7f7500009840).ready entity=mon.0 client_cookie=27b2da3dff617bf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f7506ffd700 1 -- 172.21.15.38:0/2746279552 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000e070 con 0x7f750817cac0 2023-11-06T13:30:31.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f7506ffd700 1 -- 172.21.15.38:0/2746279552 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000ba50 con 0x7f750817cac0 2023-11-06T13:30:31.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.744+0000 7f7506ffd700 1 -- 172.21.15.38:0/2746279552 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750000bdd0 con 0x7f750817cac0 2023-11-06T13:30:31.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 -- 172.21.15.38:0/2746279552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f750817cac0 msgr2=0x7f75081857a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 --2- 172.21.15.38:0/2746279552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f750817cac0 0x7f75081857a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f750808a010 tx=0x7f7500009840).stop 2023-11-06T13:30:31.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 -- 172.21.15.38:0/2746279552 shutdown_connections 2023-11-06T13:30:31.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 --2- 172.21.15.38:0/2746279552 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f750817cac0 0x7f75081857a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 --2- 172.21.15.38:0/2746279552 >> v2:172.21.15.44:3300/0 conn(0x7f75080f10d0 0x7f750817e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 -- 172.21.15.38:0/2746279552 >> 172.21.15.38:0/2746279552 conn(0x7f75080f5d20 msgr2=0x7f75080f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 -- 172.21.15.38:0/2746279552 shutdown_connections 2023-11-06T13:30:31.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.745+0000 7f750d5fc700 1 -- 172.21.15.38:0/2746279552 wait complete. 2023-11-06T13:30:31.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.746+0000 7f750d5fc700 1 Processor -- start 2023-11-06T13:30:31.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.747+0000 7f750d5fc700 1 -- start start 2023-11-06T13:30:31.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75080f10d0 0x7f75080f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 0x7f75080cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f750817cac0 0x7f75080cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080ccee0 con 0x7f7508175890 2023-11-06T13:30:31.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080cd1c0 con 0x7f750817cac0 2023-11-06T13:30:31.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75080cd4a0 con 0x7f75080f10d0 2023-11-06T13:30:31.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 0x7f75080cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 0x7f75080cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51818/0 (socket says 172.21.15.38:51818) 2023-11-06T13:30:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 -- 172.21.15.38:0/32287970 learned_addr learned my addr 172.21.15.38:0/32287970 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f7507fff700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75080f10d0 0x7f75080f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750cdfb700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f750817cac0 0x7f75080cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 -- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75080f10d0 msgr2=0x7f75080f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.759 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75080f10d0 0x7f75080f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 -- 172.21.15.38:0/32287970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f750817cac0 msgr2=0x7f75080cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f750817cac0 0x7f75080cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 -- 172.21.15.38:0/32287970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7500009ae0 con 0x7f7508175890 2023-11-06T13:30:31.760 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f75077fe700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 0x7f75080cc0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f74fc00c880 tx=0x7f74fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f74effff700 1 -- 172.21.15.38:0/32287970 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc010580 con 0x7f7508175890 2023-11-06T13:30:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f74effff700 1 -- 172.21.15.38:0/32287970 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc0106e0 con 0x7f7508175890 2023-11-06T13:30:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75080cd780 con 0x7f7508175890 2023-11-06T13:30:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.748+0000 7f74effff700 1 -- 172.21.15.38:0/32287970 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc010a60 con 0x7f7508175890 2023-11-06T13:30:31.761 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.749+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75080f4120 con 0x7f7508175890 2023-11-06T13:30:31.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.750+0000 7f74effff700 1 -- 172.21.15.38:0/32287970 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f74fc01b460 con 0x7f7508175890 2023-11-06T13:30:31.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.751+0000 7f74effff700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f74f408cb40 0x7f74f408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.751+0000 7f74effff700 1 -- 172.21.15.38:0/32287970 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f74fc0b1db0 con 0x7f7508175890 2023-11-06T13:30:31.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.751+0000 7f7507fff700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f74f408cb40 0x7f74f408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.751+0000 7f7507fff700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f74f408cb40 0x7f74f408f000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f74f80038c0 tx=0x7f74f8007d40).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.753+0000 7f75201f6b80 1 Processor -- start 2023-11-06T13:30:31.763 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.753+0000 7f75201f6b80 1 -- start start 2023-11-06T13:30:31.768 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x5616955f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616955fe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 0x5616955fec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f75201f6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56169557afd0 con 0x5616955fe7f0 2023-11-06T13:30:31.769 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f75201f6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954f2240 con 0x5616955f69a0 2023-11-06T13:30:31.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f75201f6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695507490 con 0x561695371e90 2023-11-06T13:30:31.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f750cdfb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 0x5616955fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f7507fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x5616955f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f750cdfb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 0x5616955fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51830/0 (socket says 172.21.15.38:51830) 2023-11-06T13:30:31.770 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.754+0000 7f750cdfb700 1 -- 172.21.15.38:0/1572332195 learned_addr learned my addr 172.21.15.38:0/1572332195 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f75077fe700 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616955fe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f750cdfb700 1 -- 172.21.15.38:0/1572332195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 msgr2=0x5616955f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f750cdfb700 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x5616955f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f750cdfb700 1 -- 172.21.15.38:0/1572332195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 msgr2=0x5616955fe300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.771 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f750cdfb700 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616955fe300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f750cdfb700 1 -- 172.21.15.38:0/1572332195 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561695500670 con 0x5616955fe7f0 2023-11-06T13:30:31.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f75077fe700 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616955fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:30:31.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f750cdfb700 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 0x5616955fec70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f750000ba10 tx=0x7f7500009840).ready entity=mon.0 client_cookie=e8a5464b52c27373 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f74ed7fa700 1 -- 172.21.15.38:0/1572332195 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500022070 con 0x5616955fe7f0 2023-11-06T13:30:31.772 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f74ed7fa700 1 -- 172.21.15.38:0/1572332195 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000bc90 con 0x5616955fe7f0 2023-11-06T13:30:31.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.755+0000 7f74ed7fa700 1 -- 172.21.15.38:0/1572332195 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500013630 con 0x5616955fe7f0 2023-11-06T13:30:31.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 -- 172.21.15.38:0/1572332195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 msgr2=0x5616955fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 0x5616955fec70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f750000ba10 tx=0x7f7500009840).stop 2023-11-06T13:30:31.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 -- 172.21.15.38:0/1572332195 shutdown_connections 2023-11-06T13:30:31.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955fe7f0 0x5616955fec70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.773 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x5616955f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1572332195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616955fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 -- 172.21.15.38:0/1572332195 >> 172.21.15.38:0/1572332195 conn(0x56169541f4f0 msgr2=0x5616955b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 -- 172.21.15.38:0/1572332195 shutdown_connections 2023-11-06T13:30:31.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 -- 172.21.15.38:0/1572332195 wait complete. 2023-11-06T13:30:31.774 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.756+0000 7f75201f6b80 1 -- start start 2023-11-06T13:30:31.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.757+0000 7f75201f6b80 1 Processor -- start 2023-11-06T13:30:31.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616956216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695620df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.775 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616955075d0 con 0x561695371e90 2023-11-06T13:30:31.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695507850 con 0x5616955f69a0 2023-11-06T13:30:31.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616954d2e60 con 0x5616955fe7f0 2023-11-06T13:30:31.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 10 client.0 ll_register_callbacks cb 0x5616955755b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:31.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.776 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51838/0 (socket says 172.21.15.38:51838) 2023-11-06T13:30:31.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 -- 172.21.15.38:0/1629570037 learned_addr learned my addr 172.21.15.38:0/1629570037 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f750cdfb700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695620df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75077fe700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616956216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 -- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 msgr2=0x561695620df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.777 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695620df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 -- 172.21.15.38:0/1629570037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 msgr2=0x5616956216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616956216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 -- 172.21.15.38:0/1629570037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7500017040 con 0x561695371e90 2023-11-06T13:30:31.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75077fe700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616956216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:30:31.778 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f7507fff700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955f7f10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f74f80164a0 tx=0x7f74f800a000).ready entity=mon.0 client_cookie=b7ce132e956520ab server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f74e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:30:31.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f74e67fc700 1 -- 172.21.15.38:0/1629570037 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f801c070 con 0x561695371e90 2023-11-06T13:30:31.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f74e67fc700 1 -- 172.21.15.38:0/1629570037 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f74f8016cf0 con 0x561695371e90 2023-11-06T13:30:31.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.758+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616955a9690 con 0x561695371e90 2023-11-06T13:30:31.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f74e67fc700 1 -- 172.21.15.38:0/1629570037 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74f8014660 con 0x561695371e90 2023-11-06T13:30:31.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 10 client.5331 fetch_fsmap learned FSMap version 22 2023-11-06T13:30:31.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5616954fba10 con 0x561695371e90 2023-11-06T13:30:31.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f74e67fc700 1 -- 172.21.15.38:0/1629570037 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616955a9690 con 0x561695371e90 2023-11-06T13:30:31.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f74e67fc700 1 -- 172.21.15.38:0/1629570037 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7f74f80147c0 con 0x561695371e90 2023-11-06T13:30:31.780 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 10 client.5331 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:30:31.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 10 client.5331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:31.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 20 client.5331 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:31.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5616956212e0 0x5616955f1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 4 client.5331 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:30:31.781 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56169536dcf0 con 0x5616956212e0 2023-11-06T13:30:31.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.759+0000 7f75077fe700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5616956212e0 0x5616955f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f74e67fc700 10 client.5331 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75077fe700 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5616956212e0 0x5616955f1100 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7fb51e9d99077eea server_cookie=f5b32ddc3646e567 in_seq=0 out_seq=0 2023-11-06T13:30:31.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f74e67fc700 1 -- 172.21.15.38:0/1629570037 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56169536dcf0 con 0x5616956212e0 2023-11-06T13:30:31.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f74e67fc700 10 client.5331 handle_command_reply: tid=0 2023-11-06T13:30:31.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 client.5331 shutdown 2023-11-06T13:30:31.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 msgr2=0x5616955f7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955f7f10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f74f80164a0 tx=0x7f74f800a000).stop 2023-11-06T13:30:31.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 shutdown_connections 2023-11-06T13:30:31.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5616956212e0 0x5616955f1100 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695620df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955f7f10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1629570037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x5616956216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f74e67fc700 0 client.5331 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 >> 172.21.15.38:0/1629570037 conn(0x56169541f4f0 msgr2=0x5616955b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 shutdown_connections 2023-11-06T13:30:31.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.760+0000 7f75201f6b80 1 -- 172.21.15.38:0/1629570037 wait complete. 2023-11-06T13:30:31.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.761+0000 7f75201f6b80 20 client.5331 trim_cache size 0 max 16384 2023-11-06T13:30:31.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.781+0000 7f75201f6b80 1 Processor -- start 2023-11-06T13:30:31.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.781+0000 7f75201f6b80 1 -- start start 2023-11-06T13:30:31.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.788 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x561695684620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695684b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75201f6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695685000 con 0x561695371e90 2023-11-06T13:30:31.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75201f6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616955bd3f0 con 0x5616955f69a0 2023-11-06T13:30:31.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75201f6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616955b5320 con 0x5616955fe7f0 2023-11-06T13:30:31.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51852/0 (socket says 172.21.15.38:51852) 2023-11-06T13:30:31.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 -- 172.21.15.38:0/51299153 learned_addr learned my addr 172.21.15.38:0/51299153 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f750cdfb700 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695684b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75077fe700 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x561695684620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 -- 172.21.15.38:0/51299153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 msgr2=0x561695684b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695684b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 -- 172.21.15.38:0/51299153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 msgr2=0x561695684620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x561695684620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f7507fff700 1 -- 172.21.15.38:0/51299153 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750817f600 con 0x561695371e90 2023-11-06T13:30:31.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.782+0000 7f75077fe700 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x561695684620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:30:31.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.783+0000 7f7507fff700 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955b1b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f74f8003690 tx=0x7f74f8014000).ready entity=mon.0 client_cookie=b6c5ec751d39017d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.783+0000 7f74edffb700 1 -- 172.21.15.38:0/51299153 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8014d20 con 0x561695371e90 2023-11-06T13:30:31.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.783+0000 7f74edffb700 1 -- 172.21.15.38:0/51299153 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f801d040 con 0x561695371e90 2023-11-06T13:30:31.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.783+0000 7f74edffb700 1 -- 172.21.15.38:0/51299153 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f800fd90 con 0x561695371e90 2023-11-06T13:30:31.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.783+0000 7f75201f6b80 1 -- 172.21.15.38:0/51299153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 msgr2=0x5616955b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.783+0000 7f75201f6b80 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955b1b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f74f8003690 tx=0x7f74f8014000).stop 2023-11-06T13:30:31.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 -- 172.21.15.38:0/51299153 shutdown_connections 2023-11-06T13:30:31.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5616955fe7f0 0x561695684b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x561695371e90 0x5616955b1b30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 --2- 172.21.15.38:0/51299153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955f69a0 0x561695684620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 -- 172.21.15.38:0/51299153 >> 172.21.15.38:0/51299153 conn(0x56169541f4f0 msgr2=0x5616955b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 -- 172.21.15.38:0/51299153 shutdown_connections 2023-11-06T13:30:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 -- 172.21.15.38:0/51299153 wait complete. 2023-11-06T13:30:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 -- start start 2023-11-06T13:30:31.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.784+0000 7f75201f6b80 1 Processor -- start 2023-11-06T13:30:31.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.785+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x561695624e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.785+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 0x5616955fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.785+0000 7f75201f6b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955fe7f0 0x5616956827e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.785+0000 7f75201f6b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616955f70a0 con 0x5616955f69a0 2023-11-06T13:30:31.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.785+0000 7f75201f6b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x561695683750 con 0x5616955fe7f0 2023-11-06T13:30:31.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.785+0000 7f75201f6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616955b0a60 con 0x561695371e90 2023-11-06T13:30:31.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75201f6b80 10 client.0 ll_register_callbacks cb 0x5616955755b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:30:31.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 0x5616955fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 0x5616955fc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:51864/0 (socket says 172.21.15.38:51864) 2023-11-06T13:30:31.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 -- 172.21.15.38:0/1116018609 learned_addr learned my addr 172.21.15.38:0/1116018609 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:30:31.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f7507fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x561695624e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f750cdfb700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955fe7f0 0x5616956827e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 -- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 msgr2=0x561695624e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x561695624e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 -- 172.21.15.38:0/1116018609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955fe7f0 msgr2=0x5616956827e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:30:31.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955fe7f0 0x5616956827e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 -- 172.21.15.38:0/1116018609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616954fba10 con 0x5616955f69a0 2023-11-06T13:30:31.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f750cdfb700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955fe7f0 0x5616956827e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:30:31.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75077fe700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 0x5616955fc0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f74fc085d80 tx=0x7f74fc085e50).ready entity=mon.0 client_cookie=bb0cbc4e960da8e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:30:31.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f74e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:30:31.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f74e67fc700 1 -- 172.21.15.38:0/1116018609 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc057070 con 0x5616955f69a0 2023-11-06T13:30:31.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f750000bc90 con 0x5616955f69a0 2023-11-06T13:30:31.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f74e67fc700 1 -- 172.21.15.38:0/1116018609 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f74fc082790 con 0x5616955f69a0 2023-11-06T13:30:31.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f74e67fc700 1 -- 172.21.15.38:0/1116018609 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74fc082950 con 0x5616955f69a0 2023-11-06T13:30:31.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75201f6b80 10 client.5337 fetch_fsmap learned FSMap version 22 2023-11-06T13:30:31.804 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5616954fb760 con 0x5616955f69a0 2023-11-06T13:30:31.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.786+0000 7f74e67fc700 1 -- 172.21.15.38:0/1116018609 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750000bc90 con 0x5616955f69a0 2023-11-06T13:30:31.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f74e67fc700 1 -- 172.21.15.38:0/1116018609 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7f74fc08b4d0 con 0x5616955f69a0 2023-11-06T13:30:31.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 10 client.5337 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:30:31.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 10 client.5337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:30:31.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 20 client.5337 populate_metadata read hostname 'smithi038' 2023-11-06T13:30:31.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x561695683c80 0x561695682cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:30:31.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 4 client.5337 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:30:31.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5616953a4cf0 con 0x561695683c80 2023-11-06T13:30:31.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f7507fff700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x561695683c80 0x561695682cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:30:31.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f74e67fc700 10 client.5337 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f7507fff700 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x561695683c80 0x561695682cd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=389439f83483a8ab server_cookie=2deab0f05e62e96b in_seq=0 out_seq=0 2023-11-06T13:30:31.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f74e67fc700 1 -- 172.21.15.38:0/1116018609 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5616953a4cf0 con 0x561695683c80 2023-11-06T13:30:31.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f74e67fc700 10 client.5337 handle_command_reply: tid=0 2023-11-06T13:30:31.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.787+0000 7f75201f6b80 1 client.5337 shutdown 2023-11-06T13:30:31.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 msgr2=0x5616955fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 0x5616955fc0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f74fc085d80 tx=0x7f74fc085e50).stop 2023-11-06T13:30:31.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 shutdown_connections 2023-11-06T13:30:31.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616955fe7f0 0x5616956827e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x561695683c80 0x561695682cd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561695371e90 0x561695624e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f74e67fc700 0 client.5337 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:30:31.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 --2- 172.21.15.38:0/1116018609 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5616955f69a0 0x5616955fc0c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 >> 172.21.15.38:0/1116018609 conn(0x56169541f4f0 msgr2=0x56169561f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 shutdown_connections 2023-11-06T13:30:31.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 1 -- 172.21.15.38:0/1116018609 wait complete. 2023-11-06T13:30:31.810 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f75201f6b80 20 client.5337 trim_cache size 0 max 16384 2023-11-06T13:30:31.810 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:30:31.810 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "scrub active (0 inodes in the stack)", 2023-11-06T13:30:31.811 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:30:31.811 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:30:31.811 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:30:31.811 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:30:31.812 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:30:31.812 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:30:31.812 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:30:31.812 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:30:31.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f74f408cb40 msgr2=0x7f74f408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f74f408cb40 0x7f74f408f000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f74f80038c0 tx=0x7f74f8007d40).stop 2023-11-06T13:30:31.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 msgr2=0x7f75080cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:30:31.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 0x7f75080cc0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f74fc00c880 tx=0x7f74fc008040).stop 2023-11-06T13:30:31.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 shutdown_connections 2023-11-06T13:30:31.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f74f408cb40 0x7f74f408f000 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f750817cac0 0x7f75080cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75080f10d0 0x7f75080f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 --2- 172.21.15.38:0/32287970 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7508175890 0x7f75080cc0a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:30:31.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 >> 172.21.15.38:0/32287970 conn(0x7f75080f5d20 msgr2=0x7f7508170260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:30:31.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 shutdown_connections 2023-11-06T13:30:31.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:30:31.788+0000 7f750d5fc700 1 -- 172.21.15.38:0/32287970 wait complete. 2023-11-06T13:30:31.816 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:30:40.291 INFO:tasks.workunit.client.0.smithi038.stdout: 56 198976 968 130265 637 85364 521 2023-11-06T13:30:50.291 INFO:tasks.workunit.client.0.smithi038.stdout: 71 356294 742 225325 622 126920 377 2023-11-06T13:30:57.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:30:57.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:30:57.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:31:00.291 INFO:tasks.workunit.client.0.smithi038.stdout: 92 796935 1010 523296 1085 248684 50 2023-11-06T13:31:01.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:31:01.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.961+0000 7f6915f08700 1 Processor -- start 2023-11-06T13:31:01.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.961+0000 7f6915f08700 1 -- start start 2023-11-06T13:31:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.962+0000 7f6915f08700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f69101768a0 0x7f69101807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.967 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f6915f08700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691017fcc0 con 0x7f69100c29b0 2023-11-06T13:31:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f6915f08700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69100c1e10 con 0x7f6910176c80 2023-11-06T13:31:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f6915f08700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691017f420 con 0x7f69101768a0 2023-11-06T13:31:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f69100c29b0 0x7f691017c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34122/0 (socket says 172.21.15.38:34122) 2023-11-06T13:31:01.968 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690f7fe700 1 --2- 172.21.15.38:0/2776185593 >> v2:172.21.15.163:3300/0 conn(0x7f69101768a0 0x7f69101807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690ffff700 1 -- 172.21.15.38:0/2776185593 learned_addr learned my addr 172.21.15.38:0/2776185593 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:31:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308362366 0 0) 0x7f69100c1e10 con 0x7f6910176c80 2023-11-06T13:31:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68fc0033f0 con 0x7f6910176c80 2023-11-06T13:31:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276320866 0 0) 0x7f691017fcc0 con 0x7f69100c29b0 2023-11-06T13:31:01.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69100c1e10 con 0x7f69100c29b0 2023-11-06T13:31:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690f7fe700 1 -- 172.21.15.38:0/2776185593 >> v1:172.21.15.44:6789/0 conn(0x7f6910176c80 legacy=0x7f69100c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690f7fe700 1 -- 172.21.15.38:0/2776185593 >> v1:172.21.15.38:6789/0 conn(0x7f69100c29b0 legacy=0x7f691017c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690f7fe700 1 -- 172.21.15.38:0/2776185593 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691017f700 con 0x7f69101768a0 2023-11-06T13:31:01.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690f7fe700 1 --2- 172.21.15.38:0/2776185593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69101768a0 0x7f69101807f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6900009760 tx=0x7f6900009060).ready entity=mon.2 client_cookie=ae01346e6a30731e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.963+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900009120 con 0x7f69101768a0 2023-11-06T13:31:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690000d4a0 con 0x7f69101768a0 2023-11-06T13:31:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f690effd700 1 -- 172.21.15.38:0/2776185593 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000d820 con 0x7f69101768a0 2023-11-06T13:31:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 -- 172.21.15.38:0/2776185593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69101768a0 msgr2=0x7f69101807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:01.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 --2- 172.21.15.38:0/2776185593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69101768a0 0x7f69101807f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6900009760 tx=0x7f6900009060).stop 2023-11-06T13:31:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 -- 172.21.15.38:0/2776185593 shutdown_connections 2023-11-06T13:31:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 --2- 172.21.15.38:0/2776185593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f69101768a0 0x7f69101807f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 -- 172.21.15.38:0/2776185593 >> 172.21.15.38:0/2776185593 conn(0x7f69100f22b0 msgr2=0x7f69100ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 -- 172.21.15.38:0/2776185593 shutdown_connections 2023-11-06T13:31:01.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.964+0000 7f6915f08700 1 -- 172.21.15.38:0/2776185593 wait complete. 2023-11-06T13:31:01.975 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.966+0000 7f6915f08700 1 Processor -- start 2023-11-06T13:31:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.966+0000 7f6915f08700 1 -- start start 2023-11-06T13:31:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6915f08700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69100c29b0 0x7f69101579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6915f08700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 0x7f6910178a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6915f08700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6910176c80 0x7f6910178f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.976 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6915f08700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691018b650 con 0x7f69101768a0 2023-11-06T13:31:01.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6915f08700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69100c8260 con 0x7f69100c29b0 2023-11-06T13:31:01.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6915f08700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691018aa40 con 0x7f6910176c80 2023-11-06T13:31:01.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 0x7f6910178a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.977 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f690ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6910176c80 0x7f6910178f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 0x7f6910178a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36076/0 (socket says 172.21.15.38:36076) 2023-11-06T13:31:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 -- 172.21.15.38:0/1144325207 learned_addr learned my addr 172.21.15.38:0/1144325207 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f690f7fe700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69100c29b0 0x7f69101579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 -- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6910176c80 msgr2=0x7f6910178f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:01.978 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6910176c80 0x7f6910178f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 -- 172.21.15.38:0/1144325207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69100c29b0 msgr2=0x7f69101579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69100c29b0 0x7f69101579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 -- 172.21.15.38:0/1144325207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000092a0 con 0x7f69101768a0 2023-11-06T13:31:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f690ffff700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6910176c80 0x7f6910178f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:31:01.979 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f690f7fe700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69100c29b0 0x7f69101579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:31:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.967+0000 7f6907fff700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 0x7f6910178a70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f68f800c420 tx=0x7f68f8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.968+0000 7f69077fe700 1 -- 172.21.15.38:0/1144325207 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80123f0 con 0x7f69101768a0 2023-11-06T13:31:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.968+0000 7f69077fe700 1 -- 172.21.15.38:0/1144325207 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8012550 con 0x7f69101768a0 2023-11-06T13:31:01.980 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.968+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691018ad20 con 0x7f69101768a0 2023-11-06T13:31:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.968+0000 7f69077fe700 1 -- 172.21.15.38:0/1144325207 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8012910 con 0x7f69101768a0 2023-11-06T13:31:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.968+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691018b2e0 con 0x7f69101768a0 2023-11-06T13:31:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.970+0000 7f69077fe700 1 -- 172.21.15.38:0/1144325207 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f68f8012d00 con 0x7f69101768a0 2023-11-06T13:31:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.971+0000 7f69077fe700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f68f008cb10 0x7f68f008efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.971+0000 7f69077fe700 1 -- 172.21.15.38:0/1144325207 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f68f80b13c0 con 0x7f69101768a0 2023-11-06T13:31:01.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.971+0000 7f690f7fe700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f68f008cb10 0x7f68f008efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.971+0000 7f690f7fe700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f68f008cb10 0x7f68f008efd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f6900006d60 tx=0x7f6900016000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:01.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.972+0000 7f69278a0b80 1 Processor -- start 2023-11-06T13:31:01.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.973+0000 7f69278a0b80 1 -- start start 2023-11-06T13:31:01.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f3291a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f32918d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f32918d6e0 0x55f32918db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f69278a0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3290ebfd0 con 0x55f32918d6e0 2023-11-06T13:31:01.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f69278a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f329063240 con 0x55f328ee2e90 2023-11-06T13:31:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f69278a0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f329078490 con 0x55f3291a3470 2023-11-06T13:31:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f32918d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f3291a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f32918d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:60976/0 (socket says 172.21.15.38:60976) 2023-11-06T13:31:01.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 -- 172.21.15.38:0/1335191045 learned_addr learned my addr 172.21.15.38:0/1335191045 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f690ffff700 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f32918d6e0 0x55f32918db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 -- 172.21.15.38:0/1335191045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 msgr2=0x55f3291a2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f3291a2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 -- 172.21.15.38:0/1335191045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f32918d6e0 msgr2=0x55f32918db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:01.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f32918d6e0 0x55f32918db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 -- 172.21.15.38:0/1335191045 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f329071670 con 0x55f3291a3470 2023-11-06T13:31:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6907fff700 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f32918d1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f68f80850d0 tx=0x7f68f8081a80).ready entity=mon.2 client_cookie=ddce4d2faf2553e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6904ff9700 1 -- 172.21.15.38:0/1335191045 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8085460 con 0x55f3291a3470 2023-11-06T13:31:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6904ff9700 1 -- 172.21.15.38:0/1335191045 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f80b0030 con 0x55f3291a3470 2023-11-06T13:31:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.974+0000 7f6904ff9700 1 -- 172.21.15.38:0/1335191045 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8085690 con 0x55f3291a3470 2023-11-06T13:31:01.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 -- 172.21.15.38:0/1335191045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 msgr2=0x55f32918d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f32918d1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f68f80850d0 tx=0x7f68f8081a80).stop 2023-11-06T13:31:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 -- 172.21.15.38:0/1335191045 shutdown_connections 2023-11-06T13:31:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f32918d6e0 0x55f32918db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f3291a2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1335191045 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f32918d1f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 -- 172.21.15.38:0/1335191045 >> 172.21.15.38:0/1335191045 conn(0x55f328f904f0 msgr2=0x55f329126d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 -- 172.21.15.38:0/1335191045 shutdown_connections 2023-11-06T13:31:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.975+0000 7f69278a0b80 1 -- 172.21.15.38:0/1335191045 wait complete. 2023-11-06T13:31:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.976+0000 7f69278a0b80 1 -- start start 2023-11-06T13:31:01.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.976+0000 7f69278a0b80 1 Processor -- start 2023-11-06T13:31:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f328ee2e90 0x55f32912cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f329193690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3290785d0 con 0x55f328ee2e90 2023-11-06T13:31:01.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f329078850 con 0x55f32918d6e0 2023-11-06T13:31:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f329043e60 con 0x55f3291a3470 2023-11-06T13:31:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.977+0000 7f69278a0b80 10 client.0 ll_register_callbacks cb 0x55f3290e63d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:31:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f328ee2e90 0x55f32912cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f328ee2e90 0x55f32912cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36088/0 (socket says 172.21.15.38:36088) 2023-11-06T13:31:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291aa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:55052/0 (socket says 172.21.15.38:55052) 2023-11-06T13:31:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f690f7fe700 1 -- 172.21.15.38:0/510966823 learned_addr learned my addr 172.21.15.38:0/510966823 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f690ffff700 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f329193690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 -- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 msgr2=0x55f329193690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:01.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f329193690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 -- 172.21.15.38:0/510966823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f328ee2e90 msgr2=0x55f32912cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f328ee2e90 0x55f32912cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 -- 172.21.15.38:0/510966823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691018b2e0 con 0x55f32918d6e0 2023-11-06T13:31:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f6907fff700 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291aa3e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f68f8085390 tx=0x7f68f8054000).ready entity=mon.1 client_cookie=c2ba750f33cfdb91 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:01.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f68edffb700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:31:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f68edffb700 1 -- 172.21.15.38:0/510966823 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f808af70 con 0x55f32918d6e0 2023-11-06T13:31:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f32911a690 con 0x55f32918d6e0 2023-11-06T13:31:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f68edffb700 1 -- 172.21.15.38:0/510966823 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f68f80b11c0 con 0x55f32918d6e0 2023-11-06T13:31:01.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.978+0000 7f68edffb700 1 -- 172.21.15.38:0/510966823 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68f808acf0 con 0x55f32918d6e0 2023-11-06T13:31:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 10 client.5179 fetch_fsmap learned FSMap version 22 2023-11-06T13:31:01.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f32906ca10 con 0x55f32918d6e0 2023-11-06T13:31:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f68edffb700 1 -- 172.21.15.38:0/510966823 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f809b020 con 0x55f32918d6e0 2023-11-06T13:31:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f68edffb700 1 -- 172.21.15.38:0/510966823 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7f68f808f070 con 0x55f32918d6e0 2023-11-06T13:31:02.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 10 client.5179 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:31:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 10 client.5179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:31:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 20 client.5179 populate_metadata read hostname 'smithi038' 2023-11-06T13:31:02.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f32914cf80 0x55f3291a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 4 client.5179 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:31:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f328edecf0 con 0x55f32914cf80 2023-11-06T13:31:02.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.979+0000 7f690f7fe700 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f32914cf80 0x55f3291a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f68edffb700 10 client.5179 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f690f7fe700 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f32914cf80 0x55f3291a8f90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=154046258879ceca server_cookie=ca26a6eeb69bac49 in_seq=0 out_seq=0 2023-11-06T13:31:02.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f68edffb700 1 -- 172.21.15.38:0/510966823 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55f328edecf0 con 0x55f32914cf80 2023-11-06T13:31:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f68edffb700 10 client.5179 handle_command_reply: tid=0 2023-11-06T13:31:02.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 client.5179 shutdown 2023-11-06T13:31:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 msgr2=0x55f3291aa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291aa3e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f68f8085390 tx=0x7f68f8054000).stop 2023-11-06T13:31:02.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 shutdown_connections 2023-11-06T13:31:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f32914cf80 0x55f3291a8f90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f3291a3470 0x55f329193690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f328ee2e90 0x55f32912cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 --2- 172.21.15.38:0/510966823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291aa3e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f68edffb700 0 client.5179 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:02.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 >> 172.21.15.38:0/510966823 conn(0x55f328f904f0 msgr2=0x55f3291260e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:02.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 shutdown_connections 2023-11-06T13:31:02.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.980+0000 7f69278a0b80 1 -- 172.21.15.38:0/510966823 wait complete. 2023-11-06T13:31:02.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.981+0000 7f69278a0b80 20 client.5179 trim_cache size 0 max 16384 2023-11-06T13:31:02.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.997+0000 7f69278a0b80 1 Processor -- start 2023-11-06T13:31:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.997+0000 7f69278a0b80 1 -- start start 2023-11-06T13:31:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.998+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f329167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.998+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f32918d6e0 0x55f329126320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.998+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.998+0000 7f69278a0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3291aa560 con 0x55f3291a3470 2023-11-06T13:31:02.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.998+0000 7f69278a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f329193ea0 con 0x55f328ee2e90 2023-11-06T13:31:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.998+0000 7f69278a0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3291aa280 con 0x55f32918d6e0 2023-11-06T13:31:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f6907fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f32918d6e0 0x55f329126320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f329167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36100/0 (socket says 172.21.15.38:36100) 2023-11-06T13:31:02.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f329167240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:55064/0 (socket says 172.21.15.38:55064) 2023-11-06T13:31:02.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f6907fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f32918d6e0 0x55f329126320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:60986/0 (socket says 172.21.15.38:60986) 2023-11-06T13:31:02.026 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690ffff700 1 -- 172.21.15.38:0/2937401782 learned_addr learned my addr 172.21.15.38:0/2937401782 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 -- 172.21.15.38:0/2937401782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f32918d6e0 msgr2=0x55f329126320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f32918d6e0 0x55f329126320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 -- 172.21.15.38:0/2937401782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 msgr2=0x55f3291f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 -- 172.21.15.38:0/2937401782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f32911a2b0 con 0x55f328ee2e90 2023-11-06T13:31:02.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690ffff700 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:31:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f690f7fe700 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f329167240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x55f329194e80 tx=0x7f6900030280).ready entity=mon.1 client_cookie=677e5c5b13caf5b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f69057fa700 1 -- 172.21.15.38:0/2937401782 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900028410 con 0x55f328ee2e90 2023-11-06T13:31:02.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f69057fa700 1 -- 172.21.15.38:0/2937401782 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6900028570 con 0x55f328ee2e90 2023-11-06T13:31:02.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:01.999+0000 7f69057fa700 1 -- 172.21.15.38:0/2937401782 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000286e0 con 0x55f328ee2e90 2023-11-06T13:31:02.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 -- 172.21.15.38:0/2937401782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 msgr2=0x55f329167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:02.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f329167240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x55f329194e80 tx=0x7f6900030280).stop 2023-11-06T13:31:02.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 -- 172.21.15.38:0/2937401782 shutdown_connections 2023-11-06T13:31:02.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f328ee2e90 0x55f329167240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 --2- 172.21.15.38:0/2937401782 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f32918d6e0 0x55f329126320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 -- 172.21.15.38:0/2937401782 >> 172.21.15.38:0/2937401782 conn(0x55f328f904f0 msgr2=0x55f3291a2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 -- 172.21.15.38:0/2937401782 shutdown_connections 2023-11-06T13:31:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.000+0000 7f69278a0b80 1 -- 172.21.15.38:0/2937401782 wait complete. 2023-11-06T13:31:02.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.001+0000 7f69278a0b80 1 -- start start 2023-11-06T13:31:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.001+0000 7f69278a0b80 1 Processor -- start 2023-11-06T13:31:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f328ee2e90 0x55f3291943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3291579b0 con 0x55f3291a3470 2023-11-06T13:31:02.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f329203020 con 0x55f32918d6e0 2023-11-06T13:31:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3291250e0 con 0x55f328ee2e90 2023-11-06T13:31:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f69278a0b80 10 client.0 ll_register_callbacks cb 0x55f3290e63d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:31:02.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f690ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f6907fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f690ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36114/0 (socket says 172.21.15.38:36114) 2023-11-06T13:31:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f690f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f328ee2e90 0x55f3291943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.002+0000 7f690ffff700 1 -- 172.21.15.38:0/1320997720 learned_addr learned my addr 172.21.15.38:0/1320997720 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:02.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f6907fff700 1 -- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f328ee2e90 msgr2=0x55f3291943a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f6907fff700 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f328ee2e90 0x55f3291943a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f6907fff700 1 -- 172.21.15.38:0/1320997720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 msgr2=0x55f3291574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:02.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f6907fff700 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f6907fff700 1 -- 172.21.15.38:0/1320997720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69100c1e10 con 0x55f32918d6e0 2023-11-06T13:31:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f6907fff700 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291f4b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f68f8002210 tx=0x7f68f808f000).ready entity=mon.1 client_cookie=8c476f919ac00ffe server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:02.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f68edffb700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:31:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f68edffb700 1 -- 172.21.15.38:0/1320997720 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80b1210 con 0x55f32918d6e0 2023-11-06T13:31:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f68edffb700 1 -- 172.21.15.38:0/1320997720 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f68f809c080 con 0x55f32918d6e0 2023-11-06T13:31:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68f80b0030 con 0x55f32918d6e0 2023-11-06T13:31:02.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f68edffb700 1 -- 172.21.15.38:0/1320997720 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68f8085690 con 0x55f32918d6e0 2023-11-06T13:31:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f69278a0b80 10 client.5185 fetch_fsmap learned FSMap version 22 2023-11-06T13:31:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7f691017f700 con 0x55f32918d6e0 2023-11-06T13:31:02.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.003+0000 7f68edffb700 1 -- 172.21.15.38:0/1320997720 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f80b0030 con 0x55f32918d6e0 2023-11-06T13:31:02.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f68edffb700 1 -- 172.21.15.38:0/1320997720 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7f68f8081480 con 0x55f32918d6e0 2023-11-06T13:31:02.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 10 client.5185 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:31:02.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 10 client.5185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:31:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 20 client.5185 populate_metadata read hostname 'smithi038' 2023-11-06T13:31:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f329126290 0x55f329191ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 4 client.5185 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:31:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f328f15cf0 con 0x55f329126290 2023-11-06T13:31:02.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f690f7fe700 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f329126290 0x55f329191ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f68edffb700 10 client.5185 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f690f7fe700 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f329126290 0x55f329191ae0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b039f70c9a2f9111 server_cookie=d3beafd5c91cbf8c in_seq=0 out_seq=0 2023-11-06T13:31:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f68edffb700 1 -- 172.21.15.38:0/1320997720 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f328f15cf0 con 0x55f329126290 2023-11-06T13:31:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f68edffb700 10 client.5185 handle_command_reply: tid=0 2023-11-06T13:31:02.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.004+0000 7f69278a0b80 1 client.5185 shutdown 2023-11-06T13:31:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 msgr2=0x55f3291f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291f4b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f68f8002210 tx=0x7f68f808f000).stop 2023-11-06T13:31:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 shutdown_connections 2023-11-06T13:31:02.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f3291a3470 0x55f3291574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f329126290 0x55f329191ae0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f328ee2e90 0x55f3291943a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f68edffb700 0 client.5185 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:02.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 --2- 172.21.15.38:0/1320997720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f32918d6e0 0x55f3291f4b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 >> 172.21.15.38:0/1320997720 conn(0x55f328f904f0 msgr2=0x55f329193460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:02.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 shutdown_connections 2023-11-06T13:31:02.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 1 -- 172.21.15.38:0/1320997720 wait complete. 2023-11-06T13:31:02.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.005+0000 7f69278a0b80 20 client.5185 trim_cache size 0 max 16384 2023-11-06T13:31:02.048 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:31:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:31:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:31:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:31:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:31:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:31:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:31:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:31:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:31:02.050 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:31:02.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f68f008cb10 msgr2=0x7f68f008efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:02.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f68f008cb10 0x7f68f008efd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f6900006d60 tx=0x7f6900016000).stop 2023-11-06T13:31:02.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 msgr2=0x7f6910178a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:02.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 0x7f6910178a70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f68f800c420 tx=0x7f68f8007c40).stop 2023-11-06T13:31:02.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 shutdown_connections 2023-11-06T13:31:02.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6910176c80 0x7f6910178f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f68f008cb10 0x7f68f008efd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69100c29b0 0x7f69101579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 --2- 172.21.15.38:0/1144325207 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f69101768a0 0x7f6910178a70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:02.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 >> 172.21.15.38:0/1144325207 conn(0x7f69100f22b0 msgr2=0x7f691017ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:02.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 shutdown_connections 2023-11-06T13:31:02.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:02.006+0000 7f6915f08700 1 -- 172.21.15.38:0/1144325207 wait complete. 2023-11-06T13:31:02.054 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:31:10.291 INFO:tasks.workunit.client.0.smithi038.stdout: 109 717214 992 467725 718 183702 17 2023-11-06T13:31:20.291 INFO:tasks.workunit.client.0.smithi038.stdout: 119 676016 506 432378 501 171438 1218 2023-11-06T13:31:28.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:31:28.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:31:28.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:31:30.296 INFO:tasks.workunit.client.0.smithi038.stdout: 141 1713593 1123 1102963 1108 501884 659 2023-11-06T13:31:32.055 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:31:33.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.054+0000 7f8e58d62700 1 Processor -- start 2023-11-06T13:31:33.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.054+0000 7f8e58d62700 1 -- start start 2023-11-06T13:31:33.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.056+0000 7f8e58d62700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8e54171940 0x7f8e5417d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.056+0000 7f8e58d62700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e54171d20 0x7f8e5417d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.056+0000 7f8e58d62700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f8e5417dc90 0x7f8e54083bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.056+0000 7f8e58d62700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5417f500 con 0x7f8e5417dc90 2023-11-06T13:31:33.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.056+0000 7f8e58d62700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5417c510 con 0x7f8e54171d20 2023-11-06T13:31:33.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.056+0000 7f8e58d62700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e540c87f0 con 0x7f8e54171940 2023-11-06T13:31:33.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e5259c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8e54171940 0x7f8e5417d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e5259c700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f8e54171940 0x7f8e5417d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:37112/0 (socket says 172.21.15.38:37112) 2023-11-06T13:31:33.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e5259c700 1 -- 172.21.15.38:0/406555613 learned_addr learned my addr 172.21.15.38:0/406555613 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:33.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/406555613 >> v2:172.21.15.38:3300/0 conn(0x7f8e5417dc90 0x7f8e54083bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e52d9d700 1 -- 172.21.15.38:0/406555613 >> v2:172.21.15.163:3300/0 conn(0x7f8e54171940 msgr2=0x7f8e5417d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/406555613 >> v2:172.21.15.163:3300/0 conn(0x7f8e54171940 0x7f8e5417d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e52d9d700 1 -- 172.21.15.38:0/406555613 >> v2:172.21.15.44:3300/0 conn(0x7f8e54171d20 msgr2=0x7f8e5417d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.057+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/406555613 >> v2:172.21.15.44:3300/0 conn(0x7f8e54171d20 0x7f8e5417d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:31:33.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.058+0000 7f8e52d9d700 1 -- 172.21.15.38:0/406555613 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540c8ad0 con 0x7f8e5417dc90 2023-11-06T13:31:33.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.058+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/406555613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54083bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f8e540ef310 tx=0x7f8e4c009780).ready entity=mon.0 client_cookie=e1167c48121c7dd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.058+0000 7f8e5159a700 1 -- 172.21.15.38:0/406555613 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00bb30 con 0x7f8e5417dc90 2023-11-06T13:31:33.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.058+0000 7f8e5159a700 1 -- 172.21.15.38:0/406555613 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00bc90 con 0x7f8e5417dc90 2023-11-06T13:31:33.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.058+0000 7f8e5159a700 1 -- 172.21.15.38:0/406555613 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0106e0 con 0x7f8e5417dc90 2023-11-06T13:31:33.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.059+0000 7f8e58d62700 1 -- 172.21.15.38:0/406555613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 msgr2=0x7f8e54083bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.059+0000 7f8e58d62700 1 --2- 172.21.15.38:0/406555613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54083bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f8e540ef310 tx=0x7f8e4c009780).stop 2023-11-06T13:31:33.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.060+0000 7f8e58d62700 1 -- 172.21.15.38:0/406555613 shutdown_connections 2023-11-06T13:31:33.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.060+0000 7f8e58d62700 1 --2- 172.21.15.38:0/406555613 >> v2:172.21.15.163:3300/0 conn(0x7f8e54171940 0x7f8e5417d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.060+0000 7f8e58d62700 1 --2- 172.21.15.38:0/406555613 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54083bc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.060+0000 7f8e58d62700 1 --2- 172.21.15.38:0/406555613 >> v2:172.21.15.44:3300/0 conn(0x7f8e54171d20 0x7f8e5417d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:31:33.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.060+0000 7f8e58d62700 1 -- 172.21.15.38:0/406555613 >> 172.21.15.38:0/406555613 conn(0x7f8e540f22b0 msgr2=0x7f8e540ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:33.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.068+0000 7f8e58d62700 1 -- 172.21.15.38:0/406555613 shutdown_connections 2023-11-06T13:31:33.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.068+0000 7f8e58d62700 1 -- 172.21.15.38:0/406555613 wait complete. 2023-11-06T13:31:33.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.069+0000 7f8e58d62700 1 Processor -- start 2023-11-06T13:31:33.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.069+0000 7f8e58d62700 1 -- start start 2023-11-06T13:31:33.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.070+0000 7f8e58d62700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.070+0000 7f8e58d62700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5419f700 0x7f8e5419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.070+0000 7f8e58d62700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e5419e570 0x7f8e5419e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.070+0000 7f8e58d62700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5419e0e0 con 0x7f8e5417dc90 2023-11-06T13:31:33.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.070+0000 7f8e58d62700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e541a0070 con 0x7f8e5419f700 2023-11-06T13:31:33.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.070+0000 7f8e58d62700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5419d1f0 con 0x7f8e5419e570 2023-11-06T13:31:33.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e5259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e5259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54165bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36232/0 (socket says 172.21.15.38:36232) 2023-11-06T13:31:33.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e5259c700 1 -- 172.21.15.38:0/848279710 learned_addr learned my addr 172.21.15.38:0/848279710 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:33.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e5419e570 0x7f8e5419e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5419f700 0x7f8e5419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 -- 172.21.15.38:0/848279710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5419f700 msgr2=0x7f8e5419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5419f700 0x7f8e5419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 -- 172.21.15.38:0/848279710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 msgr2=0x7f8e54165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 -- 172.21.15.38:0/848279710 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c009a20 con 0x7f8e5419e570 2023-11-06T13:31:33.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5419f700 0x7f8e5419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:31:33.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.071+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e5419e570 0x7f8e5419e9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8e4c018000 tx=0x7f8e4c01b000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.072+0000 7f8e427fc700 1 -- 172.21.15.38:0/848279710 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00bb30 con 0x7f8e5419e570 2023-11-06T13:31:33.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.072+0000 7f8e427fc700 1 -- 172.21.15.38:0/848279710 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00f040 con 0x7f8e5419e570 2023-11-06T13:31:33.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.072+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5419d4d0 con 0x7f8e5419e570 2023-11-06T13:31:33.079 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.072+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5419da90 con 0x7f8e5419e570 2023-11-06T13:31:33.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.072+0000 7f8e427fc700 1 -- 172.21.15.38:0/848279710 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c010680 con 0x7f8e5419e570 2023-11-06T13:31:33.080 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.074+0000 7f8e427fc700 1 -- 172.21.15.38:0/848279710 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f8e4c016070 con 0x7f8e5419e570 2023-11-06T13:31:33.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.075+0000 7f8e427fc700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3408cb40 0x7f8e3408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.075+0000 7f8e427fc700 1 -- 172.21.15.38:0/848279710 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f8e4c0b3420 con 0x7f8e5419e570 2023-11-06T13:31:33.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.075+0000 7f8e5259c700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3408cb40 0x7f8e3408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.075+0000 7f8e5259c700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3408cb40 0x7f8e3408f000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f8e48006d40 tx=0x7f8e4800f040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.078+0000 7f8e6a6fab80 1 Processor -- start 2023-11-06T13:31:33.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.078+0000 7f8e6a6fab80 1 -- start start 2023-11-06T13:31:33.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6cd0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6c52fd0 con 0x55a8c6c8d110 2023-11-06T13:31:33.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6bca240 con 0x55a8c6cd08f0 2023-11-06T13:31:33.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6bdf490 con 0x55a8c6a49e90 2023-11-06T13:31:33.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e52d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e52d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36238/0 (socket says 172.21.15.38:36238) 2023-11-06T13:31:33.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e51d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e52d9d700 1 -- 172.21.15.38:0/955876097 learned_addr learned my addr 172.21.15.38:0/955876097 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:33.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.080+0000 7f8e5259c700 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6cd0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e51d9b700 1 -- 172.21.15.38:0/955876097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 msgr2=0x55a8c6cd0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6cd0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e51d9b700 1 -- 172.21.15.38:0/955876097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 msgr2=0x55a8c6ccdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e51d9b700 1 -- 172.21.15.38:0/955876097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8c6bd8670 con 0x55a8c6cd08f0 2023-11-06T13:31:33.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:31:33.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8cc20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8e5406c800 tx=0x7f8e44006f40).ready entity=mon.1 client_cookie=467ff4745b155471 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e3b7fe700 1 -- 172.21.15.38:0/955876097 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44009760 con 0x55a8c6cd08f0 2023-11-06T13:31:33.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e3b7fe700 1 -- 172.21.15.38:0/955876097 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400ea80 con 0x55a8c6cd08f0 2023-11-06T13:31:33.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.081+0000 7f8e3b7fe700 1 -- 172.21.15.38:0/955876097 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400ee00 con 0x55a8c6cd08f0 2023-11-06T13:31:33.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.082+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/955876097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 msgr2=0x55a8c6c8cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.082+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8cc20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8e5406c800 tx=0x7f8e44006f40).stop 2023-11-06T13:31:33.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.083+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/955876097 shutdown_connections 2023-11-06T13:31:33.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.083+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.083+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6cd0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.083+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/955876097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8cc20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.083+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/955876097 >> 172.21.15.38:0/955876097 conn(0x55a8c6af74f0 msgr2=0x55a8c6c8dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:33.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.083+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/955876097 shutdown_connections 2023-11-06T13:31:33.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.086+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/955876097 wait complete. 2023-11-06T13:31:33.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.087+0000 7f8e6a6fab80 1 -- start start 2023-11-06T13:31:33.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.087+0000 7f8e6a6fab80 1 Processor -- start 2023-11-06T13:31:33.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6a49e90 0x55a8c6d0bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6cd08f0 0x55a8c6cbcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6bdf5d0 con 0x55a8c6a49e90 2023-11-06T13:31:33.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6bdf850 con 0x55a8c6c8d110 2023-11-06T13:31:33.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6baae60 con 0x55a8c6cd08f0 2023-11-06T13:31:33.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e6a6fab80 10 client.0 ll_register_callbacks cb 0x55a8c6c4d3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:31:33.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:35884/0 (socket says 172.21.15.38:35884) 2023-11-06T13:31:33.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 -- 172.21.15.38:0/4215464401 learned_addr learned my addr 172.21.15.38:0/4215464401 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:33.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6cd08f0 0x55a8c6cbcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 -- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6cd08f0 msgr2=0x55a8c6cbcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6cd08f0 0x55a8c6cbcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 -- 172.21.15.38:0/4215464401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6a49e90 msgr2=0x55a8c6d0bbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:31:33.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6a49e90 0x55a8c6d0bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:31:33.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.090+0000 7f8e51d9b700 1 -- 172.21.15.38:0/4215464401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5419da90 con 0x55a8c6c8d110 2023-11-06T13:31:33.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.094+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccade0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8e54086160 tx=0x7f8e44017000).ready entity=mon.1 client_cookie=7c573c2595009cc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.094+0000 7f8e38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:31:33.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.094+0000 7f8e38ff9700 1 -- 172.21.15.38:0/4215464401 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4401d5a0 con 0x55a8c6c8d110 2023-11-06T13:31:33.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.094+0000 7f8e38ff9700 1 -- 172.21.15.38:0/4215464401 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f8e4401d700 con 0x55a8c6c8d110 2023-11-06T13:31:33.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.094+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8c6c81690 con 0x55a8c6c8d110 2023-11-06T13:31:33.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.094+0000 7f8e38ff9700 1 -- 172.21.15.38:0/4215464401 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e4401db10 con 0x55a8c6c8d110 2023-11-06T13:31:33.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.095+0000 7f8e6a6fab80 10 client.5194 fetch_fsmap learned FSMap version 22 2023-11-06T13:31:33.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.095+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7f8e44009950 con 0x55a8c6c8d110 2023-11-06T13:31:33.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.095+0000 7f8e38ff9700 1 -- 172.21.15.38:0/4215464401 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8c6c81690 con 0x55a8c6c8d110 2023-11-06T13:31:33.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e38ff9700 1 -- 172.21.15.38:0/4215464401 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7f8e44025020 con 0x55a8c6c8d110 2023-11-06T13:31:33.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e6a6fab80 10 client.5194 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:31:33.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e6a6fab80 10 client.5194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:31:33.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e6a6fab80 20 client.5194 populate_metadata read hostname 'smithi038' 2023-11-06T13:31:33.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6cfc600 0x55a8c6c8b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e6a6fab80 4 client.5194 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:31:33.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8c6a45cf0 con 0x55a8c6cfc600 2023-11-06T13:31:33.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.096+0000 7f8e5259c700 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6cfc600 0x55a8c6c8b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.097+0000 7f8e38ff9700 10 client.5194 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:33.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.097+0000 7f8e5259c700 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6cfc600 0x55a8c6c8b430 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2e6549f53e2072b5 server_cookie=50561114439fc66e in_seq=0 out_seq=0 2023-11-06T13:31:33.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.097+0000 7f8e38ff9700 1 -- 172.21.15.38:0/4215464401 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a8c6a45cf0 con 0x55a8c6cfc600 2023-11-06T13:31:33.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e38ff9700 10 client.5194 handle_command_reply: tid=0 2023-11-06T13:31:33.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 client.5194 shutdown 2023-11-06T13:31:33.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 msgr2=0x55a8c6ccade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccade0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f8e54086160 tx=0x7f8e44017000).stop 2023-11-06T13:31:33.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 shutdown_connections 2023-11-06T13:31:33.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6cfc600 0x55a8c6c8b430 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6cd08f0 0x55a8c6cbcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6a49e90 0x55a8c6d0bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:31:33.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/4215464401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8d110 0x55a8c6ccade0 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0x7f8e54086160 tx=0x7f8e44017000).stop 2023-11-06T13:31:33.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e38ff9700 0 client.5194 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:33.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 >> 172.21.15.38:0/4215464401 conn(0x55a8c6af74f0 msgr2=0x55a8c6c87ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:33.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 shutdown_connections 2023-11-06T13:31:33.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.098+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/4215464401 wait complete. 2023-11-06T13:31:33.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.099+0000 7f8e6a6fab80 20 client.5194 trim_cache size 0 max 16384 2023-11-06T13:31:33.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.134+0000 7f8e6a6fab80 1 Processor -- start 2023-11-06T13:31:33.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.142+0000 7f8e6a6fab80 1 -- start start 2023-11-06T13:31:33.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.144+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6ccf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.144+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.144+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8a3c0 0x55a8c6d5ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.144+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6ccd8a0 con 0x55a8c6cd08f0 2023-11-06T13:31:33.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.144+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6c8b5d0 con 0x55a8c6c8a3c0 2023-11-06T13:31:33.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.144+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6d54dd0 con 0x55a8c6a49e90 2023-11-06T13:31:33.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.145+0000 7f8e5259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6ccf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.145+0000 7f8e5259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6ccf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:37142/0 (socket says 172.21.15.38:37142) 2023-11-06T13:31:33.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.145+0000 7f8e5259c700 1 -- 172.21.15.38:0/1926027543 learned_addr learned my addr 172.21.15.38:0/1926027543 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:33.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.145+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8a3c0 0x55a8c6d5ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.148+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.149+0000 7f8e52d9d700 1 -- 172.21.15.38:0/1926027543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 msgr2=0x55a8c6ccf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.149+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6ccf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.149+0000 7f8e52d9d700 1 -- 172.21.15.38:0/1926027543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cd08f0 msgr2=0x55a8c6c8b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.149+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.149+0000 7f8e52d9d700 1 -- 172.21.15.38:0/1926027543 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8c6bd3a10 con 0x55a8c6c8a3c0 2023-11-06T13:31:33.168 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.165+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8a3c0 0x55a8c6d5ba40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x55a8c6c8a250 tx=0x7f8e4c089040).ready entity=mon.1 client_cookie=e0aa2a6904e7b5f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.170+0000 7f8e3bfff700 1 -- 172.21.15.38:0/1926027543 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0b3260 con 0x55a8c6c8a3c0 2023-11-06T13:31:33.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.170+0000 7f8e3bfff700 1 -- 172.21.15.38:0/1926027543 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c0876d0 con 0x55a8c6c8a3c0 2023-11-06T13:31:33.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.170+0000 7f8e3bfff700 1 -- 172.21.15.38:0/1926027543 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c08cfb0 con 0x55a8c6c8a3c0 2023-11-06T13:31:33.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.171+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/1926027543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8a3c0 msgr2=0x55a8c6d5ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.171+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8a3c0 0x55a8c6d5ba40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x55a8c6c8a250 tx=0x7f8e4c089040).stop 2023-11-06T13:31:33.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.184+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/1926027543 shutdown_connections 2023-11-06T13:31:33.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.184+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6c8a3c0 0x55a8c6d5ba40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.184+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6ccf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.184+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/1926027543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cd08f0 0x55a8c6c8b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.184+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/1926027543 >> 172.21.15.38:0/1926027543 conn(0x55a8c6af74f0 msgr2=0x55a8c6cc9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:33.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.195+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/1926027543 shutdown_connections 2023-11-06T13:31:33.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.206+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/1926027543 wait complete. 2023-11-06T13:31:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.208+0000 7f8e6a6fab80 1 -- start start 2023-11-06T13:31:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.208+0000 7f8e6a6fab80 1 Processor -- start 2023-11-06T13:31:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6d570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6d547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.215 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 0x55a8c6d00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6d0f9d0 con 0x55a8c6cc3e10 2023-11-06T13:31:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6cd47c0 con 0x55a8c6cd08f0 2023-11-06T13:31:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8c6cd5060 con 0x55a8c6a49e90 2023-11-06T13:31:33.216 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.210+0000 7f8e6a6fab80 10 client.0 ll_register_callbacks cb 0x55a8c6c4d3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:31:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e52d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 0x55a8c6d00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e52d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 0x55a8c6d00420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36270/0 (socket says 172.21.15.38:36270) 2023-11-06T13:31:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e52d9d700 1 -- 172.21.15.38:0/777719860 learned_addr learned my addr 172.21.15.38:0/777719860 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:31:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6d547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e51d9b700 1 -- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 msgr2=0x55a8c6d570d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:31:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6d570d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:31:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e51d9b700 1 -- 172.21.15.38:0/777719860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 msgr2=0x55a8c6d00420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:31:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 0x55a8c6d00420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.211+0000 7f8e51d9b700 1 -- 172.21.15.38:0/777719860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5419d4d0 con 0x55a8c6cd08f0 2023-11-06T13:31:33.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.214+0000 7f8e52d9d700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 0x55a8c6d00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:31:33.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.216+0000 7f8e51d9b700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6d547e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x55a8c6c8d5f0 tx=0x7f8e4401e000).ready entity=mon.1 client_cookie=7b2e1c49b3cfd1fd server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:31:33.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.221+0000 7f8e38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:31:33.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.221+0000 7f8e38ff9700 1 -- 172.21.15.38:0/777719860 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44012600 con 0x55a8c6cd08f0 2023-11-06T13:31:33.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.221+0000 7f8e38ff9700 1 -- 172.21.15.38:0/777719860 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f8e4401dd10 con 0x55a8c6cd08f0 2023-11-06T13:31:33.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.221+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e4400ea80 con 0x55a8c6cd08f0 2023-11-06T13:31:33.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.224+0000 7f8e38ff9700 1 -- 172.21.15.38:0/777719860 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e44011c10 con 0x55a8c6cd08f0 2023-11-06T13:31:33.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.224+0000 7f8e6a6fab80 10 client.5200 fetch_fsmap learned FSMap version 22 2023-11-06T13:31:33.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.224+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55a8c6bd3760 con 0x55a8c6cd08f0 2023-11-06T13:31:33.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e38ff9700 1 -- 172.21.15.38:0/777719860 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400ea80 con 0x55a8c6cd08f0 2023-11-06T13:31:33.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e38ff9700 1 -- 172.21.15.38:0/777719860 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 22) v1 ==== 7476+0+0 (secure 0 0 0) 0x7f8e44025070 con 0x55a8c6cd08f0 2023-11-06T13:31:33.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e6a6fab80 10 client.5200 fetch_fsmap finished waiting for FSMap version 22 2023-11-06T13:31:33.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e6a6fab80 10 client.5200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:31:33.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e6a6fab80 20 client.5200 populate_metadata read hostname 'smithi038' 2023-11-06T13:31:33.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6c88800 0x55a8c6d45d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:31:33.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e6a6fab80 4 client.5200 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:31:33.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a8c6a7ccf0 con 0x55a8c6c88800 2023-11-06T13:31:33.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.227+0000 7f8e5259c700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6c88800 0x55a8c6d45d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:31:33.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e38ff9700 10 client.5200 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:33.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e5259c700 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6c88800 0x55a8c6d45d50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6e09e866e0cb9be4 server_cookie=9038ee6752763fe6 in_seq=0 out_seq=0 2023-11-06T13:31:33.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e38ff9700 1 -- 172.21.15.38:0/777719860 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a8c6a7ccf0 con 0x55a8c6c88800 2023-11-06T13:31:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e38ff9700 10 client.5200 handle_command_reply: tid=0 2023-11-06T13:31:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 client.5200 shutdown 2023-11-06T13:31:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 msgr2=0x55a8c6d547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6d547e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x55a8c6c8d5f0 tx=0x7f8e4401e000).stop 2023-11-06T13:31:33.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 shutdown_connections 2023-11-06T13:31:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a8c6cc3e10 0x55a8c6d00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a8c6c88800 0x55a8c6d45d50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a8c6a49e90 0x55a8c6d570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:31:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 --2- 172.21.15.38:0/777719860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a8c6cd08f0 0x55a8c6d547e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 >> 172.21.15.38:0/777719860 conn(0x55a8c6af74f0 msgr2=0x55a8c6c94880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:33.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.228+0000 7f8e38ff9700 0 client.5200 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:31:33.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.231+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 shutdown_connections 2023-11-06T13:31:33.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.231+0000 7f8e6a6fab80 1 -- 172.21.15.38:0/777719860 wait complete. 2023-11-06T13:31:33.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.238+0000 7f8e6a6fab80 20 client.5200 trim_cache size 0 max 16384 2023-11-06T13:31:33.243 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:31:33.243 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:31:33.243 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:31:33.243 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:31:33.244 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:31:33.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:31:33.244 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:31:33.244 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:31:33.244 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:31:33.245 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:31:33.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.247+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3408cb40 msgr2=0x7f8e3408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.247+0000 7f8e58d62700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3408cb40 0x7f8e3408f000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f8e48006d40 tx=0x7f8e4800f040).stop 2023-11-06T13:31:33.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.247+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e5419e570 msgr2=0x7f8e5419e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:31:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.247+0000 7f8e58d62700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e5419e570 0x7f8e5419e9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8e4c018000 tx=0x7f8e4c01b000).stop 2023-11-06T13:31:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.248+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 shutdown_connections 2023-11-06T13:31:33.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.248+0000 7f8e58d62700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e5419e570 0x7f8e5419e9f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.248+0000 7f8e58d62700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8e5417dc90 0x7f8e54165bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.248+0000 7f8e58d62700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f8e3408cb40 0x7f8e3408f000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.248+0000 7f8e58d62700 1 --2- 172.21.15.38:0/848279710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5419f700 0x7f8e5419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:31:33.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.248+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 >> 172.21.15.38:0/848279710 conn(0x7f8e540f22b0 msgr2=0x7f8e540c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:31:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.249+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 shutdown_connections 2023-11-06T13:31:33.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:31:33.249+0000 7f8e58d62700 1 -- 172.21.15.38:0/848279710 wait complete. 2023-11-06T13:31:33.270 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:31:40.296 INFO:tasks.workunit.client.0.smithi038.stdout: 163 1802738 1060 1185969 1420 482732 415 2023-11-06T13:31:50.296 INFO:tasks.workunit.client.0.smithi038.stdout: 180 1583901 1022 1047497 647 381472 241 2023-11-06T13:31:58.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:31:58.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:31:58.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:32:00.297 INFO:tasks.workunit.client.0.smithi038.stdout: 194 1300205 829 845807 646 309909 592 2023-11-06T13:32:03.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:32:03.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.512+0000 7f40cb483700 1 Processor -- start 2023-11-06T13:32:03.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.513+0000 7f40cb483700 1 -- start start 2023-11-06T13:32:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40cb483700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40c41768a0 0x7f40c41807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40cb483700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f40c4176c80 0x7f40c40c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40cb483700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f40c40c2790 0x7f40c4083bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40cb483700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c417fcc0 con 0x7f40c40c2790 2023-11-06T13:32:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40cb483700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40c1e10 con 0x7f40c41768a0 2023-11-06T13:32:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40cb483700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c417f420 con 0x7f40c4176c80 2023-11-06T13:32:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40c8a1e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f40c4176c80 0x7f40c40c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40c9a20700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f40c40c2790 0x7f40c4083bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40c9a20700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f40c40c2790 0x7f40c4083bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50528/0 (socket says 172.21.15.38:50528) 2023-11-06T13:32:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40c8a1e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f40c4176c80 0x7f40c40c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:54850/0 (socket says 172.21.15.38:54850) 2023-11-06T13:32:03.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.515+0000 7f40c9a20700 1 -- 172.21.15.38:0/2793087518 learned_addr learned my addr 172.21.15.38:0/2793087518 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40c9a20700 1 -- 172.21.15.38:0/2793087518 >> v2:172.21.15.163:3300/0 conn(0x7f40c4176c80 msgr2=0x7f40c40c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40c9a20700 1 --2- 172.21.15.38:0/2793087518 >> v2:172.21.15.163:3300/0 conn(0x7f40c4176c80 0x7f40c40c22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40c9a20700 1 -- 172.21.15.38:0/2793087518 >> v2:172.21.15.44:3300/0 conn(0x7f40c41768a0 msgr2=0x7f40c41807f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:32:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40c9a20700 1 --2- 172.21.15.38:0/2793087518 >> v2:172.21.15.44:3300/0 conn(0x7f40c41768a0 0x7f40c41807f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:03.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40c9a20700 1 -- 172.21.15.38:0/2793087518 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c417f700 con 0x7f40c40c2790 2023-11-06T13:32:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40c9a20700 1 --2- 172.21.15.38:0/2793087518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c40c2790 0x7f40c4083bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f40c40ee190 tx=0x7f40c00090f0).ready entity=mon.0 client_cookie=7a465c64599fe838 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40bbfff700 1 -- 172.21.15.38:0/2793087518 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000b520 con 0x7f40c40c2790 2023-11-06T13:32:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40bbfff700 1 -- 172.21.15.38:0/2793087518 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000b680 con 0x7f40c40c2790 2023-11-06T13:32:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.516+0000 7f40bbfff700 1 -- 172.21.15.38:0/2793087518 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000ba20 con 0x7f40c40c2790 2023-11-06T13:32:03.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 -- 172.21.15.38:0/2793087518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c40c2790 msgr2=0x7f40c4083bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 --2- 172.21.15.38:0/2793087518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c40c2790 0x7f40c4083bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f40c40ee190 tx=0x7f40c00090f0).stop 2023-11-06T13:32:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 -- 172.21.15.38:0/2793087518 shutdown_connections 2023-11-06T13:32:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 --2- 172.21.15.38:0/2793087518 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c40c2790 0x7f40c4083bc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 --2- 172.21.15.38:0/2793087518 >> v2:172.21.15.44:3300/0 conn(0x7f40c41768a0 0x7f40c41807f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 --2- 172.21.15.38:0/2793087518 >> v2:172.21.15.163:3300/0 conn(0x7f40c4176c80 0x7f40c40c22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.517+0000 7f40cb483700 1 -- 172.21.15.38:0/2793087518 >> 172.21.15.38:0/2793087518 conn(0x7f40c40f22b0 msgr2=0x7f40c40ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.525+0000 7f40cb483700 1 -- 172.21.15.38:0/2793087518 shutdown_connections 2023-11-06T13:32:03.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.525+0000 7f40cb483700 1 -- 172.21.15.38:0/2793087518 wait complete. 2023-11-06T13:32:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.526+0000 7f40cb483700 1 Processor -- start 2023-11-06T13:32:03.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.527+0000 7f40cb483700 1 -- start start 2023-11-06T13:32:03.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40cb483700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40c40c2790 0x7f40c40ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40cb483700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c4176c80 0x7f40c40ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40cb483700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c416de30 0x7f40c41904f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40cb483700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c416f480 con 0x7f40c4176c80 2023-11-06T13:32:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40cb483700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40ed8f0 con 0x7f40c416de30 2023-11-06T13:32:03.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40cb483700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4191340 con 0x7f40c40c2790 2023-11-06T13:32:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40c921f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40c40c2790 0x7f40c40ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40c9a20700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c416de30 0x7f40c41904f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c4176c80 0x7f40c40ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40c921f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40c40c2790 0x7f40c40ecf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:54852/0 (socket says 172.21.15.38:54852) 2023-11-06T13:32:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.528+0000 7f40c921f700 1 -- 172.21.15.38:0/1482836819 learned_addr learned my addr 172.21.15.38:0/1482836819 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c9a20700 1 -- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40c40c2790 msgr2=0x7f40c40ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c9a20700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40c40c2790 0x7f40c40ecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c9a20700 1 -- 172.21.15.38:0/1482836819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c4176c80 msgr2=0x7f40c40ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c9a20700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c4176c80 0x7f40c40ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c9a20700 1 -- 172.21.15.38:0/1482836819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009370 con 0x7f40c416de30 2023-11-06T13:32:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c4176c80 0x7f40c40ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:32:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40c9a20700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c416de30 0x7f40c41904f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f40c40c3a30 tx=0x7f40c0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40b97fa700 1 -- 172.21.15.38:0/1482836819 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000b520 con 0x7f40c416de30 2023-11-06T13:32:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40b97fa700 1 -- 172.21.15.38:0/1482836819 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0006950 con 0x7f40c416de30 2023-11-06T13:32:03.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c416e870 con 0x7f40c416de30 2023-11-06T13:32:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40b97fa700 1 -- 172.21.15.38:0/1482836819 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000ba00 con 0x7f40c416de30 2023-11-06T13:32:03.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.529+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c416ee30 con 0x7f40c416de30 2023-11-06T13:32:03.540 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.532+0000 7f40b97fa700 1 -- 172.21.15.38:0/1482836819 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f40c001c630 con 0x7f40c416de30 2023-11-06T13:32:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.532+0000 7f40b97fa700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f40a808cb40 0x7f40a808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.533+0000 7f40b97fa700 1 -- 172.21.15.38:0/1482836819 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f40c00b3b60 con 0x7f40c416de30 2023-11-06T13:32:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.533+0000 7f40c921f700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f40a808cb40 0x7f40a808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.541 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.533+0000 7f40c921f700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f40a808cb40 0x7f40a808f000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f40bc0075f0 tx=0x7f40bc0097b0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.534+0000 7f40dce1bb80 1 Processor -- start 2023-11-06T13:32:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.534+0000 7f40dce1bb80 1 -- start start 2023-11-06T13:32:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189751e90 0x55e189a11f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18995afd0 con 0x55e1899fc6e0 2023-11-06T13:32:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1898d2240 con 0x55e189751e90 2023-11-06T13:32:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1898e7490 con 0x55e189a12470 2023-11-06T13:32:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40c9a20700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40c9a20700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899fcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50540/0 (socket says 172.21.15.38:50540) 2023-11-06T13:32:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:54860/0 (socket says 172.21.15.38:54860) 2023-11-06T13:32:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40c9a20700 1 -- 172.21.15.38:0/571425872 learned_addr learned my addr 172.21.15.38:0/571425872 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.535+0000 7f40c921f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189751e90 0x55e189a11f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40c9a20700 1 -- 172.21.15.38:0/571425872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 msgr2=0x55e1899fc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40c9a20700 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40c9a20700 1 -- 172.21.15.38:0/571425872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189751e90 msgr2=0x55e189a11f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40c9a20700 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189751e90 0x55e189a11f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40c9a20700 1 -- 172.21.15.38:0/571425872 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1898e0670 con 0x55e1899fc6e0 2023-11-06T13:32:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40c9a20700 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899fcb40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f40c0087c80 tx=0x7f40c0006bd0).ready entity=mon.0 client_cookie=8e35acbf92ec4b45 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40ae7fc700 1 -- 172.21.15.38:0/571425872 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c008d710 con 0x55e1899fc6e0 2023-11-06T13:32:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40ae7fc700 1 -- 172.21.15.38:0/571425872 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c00861d0 con 0x55e1899fc6e0 2023-11-06T13:32:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.536+0000 7f40ae7fc700 1 -- 172.21.15.38:0/571425872 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0084540 con 0x55e1899fc6e0 2023-11-06T13:32:03.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 -- 172.21.15.38:0/571425872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 msgr2=0x55e1899fcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899fcb40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f40c0087c80 tx=0x7f40c0006bd0).stop 2023-11-06T13:32:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 -- 172.21.15.38:0/571425872 shutdown_connections 2023-11-06T13:32:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899fcb40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189751e90 0x55e189a11f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/571425872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 -- 172.21.15.38:0/571425872 >> 172.21.15.38:0/571425872 conn(0x55e1897ff4f0 msgr2=0x55e189995d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 -- 172.21.15.38:0/571425872 shutdown_connections 2023-11-06T13:32:03.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.537+0000 7f40dce1bb80 1 -- 172.21.15.38:0/571425872 wait complete. 2023-11-06T13:32:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.538+0000 7f40dce1bb80 1 -- start start 2023-11-06T13:32:03.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.538+0000 7f40dce1bb80 1 Processor -- start 2023-11-06T13:32:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e189a17b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899d7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a12470 0x55e189a03860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1898e75d0 con 0x55e1899fc6e0 2023-11-06T13:32:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1898e7850 con 0x55e189a12470 2023-11-06T13:32:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1898b2e60 con 0x55e189751e90 2023-11-06T13:32:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40dce1bb80 10 client.0 ll_register_callbacks cb 0x55e1899553d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:32:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899d7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50544/0 (socket says 172.21.15.38:50544) 2023-11-06T13:32:03.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.539+0000 7f40c8a1e700 1 -- 172.21.15.38:0/2840454972 learned_addr learned my addr 172.21.15.38:0/2840454972 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:03.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c921f700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e189a17b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c9a20700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a12470 0x55e189a03860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c8a1e700 1 -- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 msgr2=0x55e189a17b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e189a17b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c8a1e700 1 -- 172.21.15.38:0/2840454972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a12470 msgr2=0x55e189a03860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a12470 0x55e189a03860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c8a1e700 1 -- 172.21.15.38:0/2840454972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c416ee30 con 0x55e1899fc6e0 2023-11-06T13:32:03.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899d7560 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f40b4014b50 tx=0x7f40b4009060).ready entity=mon.0 client_cookie=34af39f665509e18 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:32:03.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40a37fe700 1 -- 172.21.15.38:0/2840454972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4015700 con 0x55e1899fc6e0 2023-11-06T13:32:03.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e189989690 con 0x55e1899fc6e0 2023-11-06T13:32:03.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40a37fe700 1 -- 172.21.15.38:0/2840454972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f40b4015860 con 0x55e1899fc6e0 2023-11-06T13:32:03.557 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40a37fe700 1 -- 172.21.15.38:0/2840454972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40b4015a70 con 0x55e1899fc6e0 2023-11-06T13:32:03.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40dce1bb80 10 client.5382 fetch_fsmap learned FSMap version 25 2023-11-06T13:32:03.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e1898dba10 con 0x55e1899fc6e0 2023-11-06T13:32:03.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.540+0000 7f40a37fe700 1 -- 172.21.15.38:0/2840454972 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e189989690 con 0x55e1899fc6e0 2023-11-06T13:32:03.558 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40a37fe700 1 -- 172.21.15.38:0/2840454972 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 25) v1 ==== 7492+0+0 (secure 0 0 0) 0x7f40b4015bd0 con 0x55e1899fc6e0 2023-11-06T13:32:03.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40dce1bb80 10 client.5382 fetch_fsmap finished waiting for FSMap version 25 2023-11-06T13:32:03.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40dce1bb80 10 client.5382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:32:03.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40dce1bb80 20 client.5382 populate_metadata read hostname 'smithi038' 2023-11-06T13:32:03.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a18160 0x55e18999bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40dce1bb80 4 client.5382 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:32:03.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e18974dcf0 con 0x55e189a18160 2023-11-06T13:32:03.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40c921f700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a18160 0x55e18999bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40a37fe700 10 client.5382 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:03.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.541+0000 7f40c921f700 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a18160 0x55e18999bc00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5842ece74294528d server_cookie=8aa8d289f88bd3aa in_seq=0 out_seq=0 2023-11-06T13:32:03.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40a37fe700 1 -- 172.21.15.38:0/2840454972 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55e18974dcf0 con 0x55e189a18160 2023-11-06T13:32:03.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40a37fe700 10 client.5382 handle_command_reply: tid=0 2023-11-06T13:32:03.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 client.5382 shutdown 2023-11-06T13:32:03.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 msgr2=0x55e1899d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899d7560 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f40b4014b50 tx=0x7f40b4009060).stop 2023-11-06T13:32:03.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 shutdown_connections 2023-11-06T13:32:03.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a12470 0x55e189a03860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a18160 0x55e18999bc00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e189a17b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40a37fe700 0 client.5382 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/2840454972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e1899fc6e0 0x55e1899d7560 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0x7f40b4014b50 tx=0x7f40b4009060).stop 2023-11-06T13:32:03.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.549+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 >> 172.21.15.38:0/2840454972 conn(0x55e1897ff4f0 msgr2=0x55e189a11d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.550+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 shutdown_connections 2023-11-06T13:32:03.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.550+0000 7f40dce1bb80 1 -- 172.21.15.38:0/2840454972 wait complete. 2023-11-06T13:32:03.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.550+0000 7f40dce1bb80 20 client.5382 trim_cache size 0 max 16384 2023-11-06T13:32:03.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.580+0000 7f40dce1bb80 1 Processor -- start 2023-11-06T13:32:03.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.614+0000 7f40dce1bb80 1 -- start start 2023-11-06T13:32:03.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.616+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189751e90 0x55e189a03840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 0x55e189a04130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e189a07f70 con 0x55e189751e90 2023-11-06T13:32:03.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1899d59f0 con 0x55e189a18540 2023-11-06T13:32:03.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e189a04620 con 0x55e189a12470 2023-11-06T13:32:03.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 0x55e189a04130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 0x55e189a04130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:38584/0 (socket says 172.21.15.38:38584) 2023-11-06T13:32:03.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 -- 172.21.15.38:0/19986271 learned_addr learned my addr 172.21.15.38:0/19986271 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:03.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 -- 172.21.15.38:0/19986271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 msgr2=0x55e1899fcac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:32:03.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fcac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 -- 172.21.15.38:0/19986271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189751e90 msgr2=0x55e189a03840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:32:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189751e90 0x55e189a03840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.617+0000 7f40c9a20700 1 -- 172.21.15.38:0/19986271 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1898db760 con 0x55e189a18540 2023-11-06T13:32:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.618+0000 7f40c9a20700 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 0x55e189a04130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f40c0086180 tx=0x7f40c0059000).ready entity=mon.1 client_cookie=2830b50c8abbaff server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.618+0000 7f40aeffd700 1 -- 172.21.15.38:0/19986271 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0092070 con 0x55e189a18540 2023-11-06T13:32:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.618+0000 7f40aeffd700 1 -- 172.21.15.38:0/19986271 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0087e30 con 0x55e189a18540 2023-11-06T13:32:03.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.618+0000 7f40aeffd700 1 -- 172.21.15.38:0/19986271 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c008d710 con 0x55e189a18540 2023-11-06T13:32:03.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.619+0000 7f40dce1bb80 1 -- 172.21.15.38:0/19986271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 msgr2=0x55e189a04130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.619+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 0x55e189a04130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f40c0086180 tx=0x7f40c0059000).stop 2023-11-06T13:32:03.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.637+0000 7f40dce1bb80 1 -- 172.21.15.38:0/19986271 shutdown_connections 2023-11-06T13:32:03.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.637+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a18540 0x55e189a04130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.637+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189751e90 0x55e189a03840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:03.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.637+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/19986271 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189a12470 0x55e1899fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:03.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.637+0000 7f40dce1bb80 1 -- 172.21.15.38:0/19986271 >> 172.21.15.38:0/19986271 conn(0x55e1897ff4f0 msgr2=0x55e1899d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:03.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.647+0000 7f40dce1bb80 1 -- 172.21.15.38:0/19986271 shutdown_connections 2023-11-06T13:32:03.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.658+0000 7f40dce1bb80 1 -- 172.21.15.38:0/19986271 wait complete. 2023-11-06T13:32:03.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.659+0000 7f40dce1bb80 1 -- start start 2023-11-06T13:32:03.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.659+0000 7f40dce1bb80 1 Processor -- start 2023-11-06T13:32:03.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e1899cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 0x55e189995440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a02290 0x55e1899d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e189a16aa0 con 0x55e189a12470 2023-11-06T13:32:03.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1899fce50 con 0x55e189a02290 2023-11-06T13:32:03.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e189a19340 con 0x55e189751e90 2023-11-06T13:32:03.667 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.662+0000 7f40dce1bb80 10 client.0 ll_register_callbacks cb 0x55e1899553d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:32:03.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.664+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 0x55e189995440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.668 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.664+0000 7f40c8a1e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 0x55e189995440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50564/0 (socket says 172.21.15.38:50564) 2023-11-06T13:32:03.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.664+0000 7f40c8a1e700 1 -- 172.21.15.38:0/4161789705 learned_addr learned my addr 172.21.15.38:0/4161789705 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:03.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c921f700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e1899cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c8a1e700 1 -- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 msgr2=0x55e1899cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e1899cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c8a1e700 1 -- 172.21.15.38:0/4161789705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a02290 msgr2=0x55e1899d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:03.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c9a20700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a02290 0x55e1899d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a02290 0x55e1899d6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.667+0000 7f40c8a1e700 1 -- 172.21.15.38:0/4161789705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1898e0670 con 0x55e189a12470 2023-11-06T13:32:03.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.668+0000 7f40c8a1e700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 0x55e189995440 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x55e189990b70 tx=0x7f40b401c000).ready entity=mon.0 client_cookie=520eb79b40370038 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:03.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.668+0000 7f40a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:32:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.671+0000 7f40a37fe700 1 -- 172.21.15.38:0/4161789705 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4000be0 con 0x55e189a12470 2023-11-06T13:32:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.671+0000 7f40a37fe700 1 -- 172.21.15.38:0/4161789705 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f40b4000d40 con 0x55e189a12470 2023-11-06T13:32:03.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.671+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40c00861d0 con 0x55e189a12470 2023-11-06T13:32:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.672+0000 7f40a37fe700 1 -- 172.21.15.38:0/4161789705 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40b4005a90 con 0x55e189a12470 2023-11-06T13:32:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.672+0000 7f40dce1bb80 10 client.5385 fetch_fsmap learned FSMap version 25 2023-11-06T13:32:03.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.672+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e189752fd0 con 0x55e189a12470 2023-11-06T13:32:03.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.673+0000 7f40a37fe700 1 -- 172.21.15.38:0/4161789705 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c00861d0 con 0x55e189a12470 2023-11-06T13:32:03.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.673+0000 7f40a37fe700 1 -- 172.21.15.38:0/4161789705 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 25) v1 ==== 7492+0+0 (secure 0 0 0) 0x7f40b4005bf0 con 0x55e189a12470 2023-11-06T13:32:03.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.674+0000 7f40dce1bb80 10 client.5385 fetch_fsmap finished waiting for FSMap version 25 2023-11-06T13:32:03.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.674+0000 7f40dce1bb80 10 client.5385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:32:03.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.674+0000 7f40dce1bb80 20 client.5385 populate_metadata read hostname 'smithi038' 2023-11-06T13:32:03.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.674+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a11fc0 0x55e189a16ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:03.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.674+0000 7f40dce1bb80 4 client.5385 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:32:03.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.674+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e189784cf0 con 0x55e189a11fc0 2023-11-06T13:32:03.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.675+0000 7f40c921f700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a11fc0 0x55e189a16ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:03.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.676+0000 7f40a37fe700 10 client.5385 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:03.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.676+0000 7f40c921f700 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a11fc0 0x55e189a16ef0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f5830c740744c380 server_cookie=45331d9f28f03a8a in_seq=0 out_seq=0 2023-11-06T13:32:03.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.686+0000 7f40a37fe700 1 -- 172.21.15.38:0/4161789705 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e189784cf0 con 0x55e189a11fc0 2023-11-06T13:32:03.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.686+0000 7f40a37fe700 10 client.5385 handle_command_reply: tid=0 2023-11-06T13:32:03.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.687+0000 7f40dce1bb80 1 client.5385 shutdown 2023-11-06T13:32:03.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 msgr2=0x55e189995440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 0x55e189995440 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x55e189990b70 tx=0x7f40b401c000).stop 2023-11-06T13:32:03.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 shutdown_connections 2023-11-06T13:32:03.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e189a02290 0x55e1899d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e189a11fc0 0x55e189a16ef0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e189751e90 0x55e1899cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 --2- 172.21.15.38:0/4161789705 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e189a12470 0x55e189995440 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 >> 172.21.15.38:0/4161789705 conn(0x55e1897ff4f0 msgr2=0x55e189a646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:03.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40a37fe700 0 client.5385 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:03.710 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:32:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:32:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:32:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:32:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:32:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:32:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:32:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:32:03.712 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:32:03.712 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:32:03.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.693+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 shutdown_connections 2023-11-06T13:32:03.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.699+0000 7f40dce1bb80 1 -- 172.21.15.38:0/4161789705 wait complete. 2023-11-06T13:32:03.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.704+0000 7f40dce1bb80 20 client.5385 trim_cache size 0 max 16384 2023-11-06T13:32:03.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.716+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f40a808cb40 msgr2=0x7f40a808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.716+0000 7f40cb483700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f40a808cb40 0x7f40a808f000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f40bc0075f0 tx=0x7f40bc0097b0).stop 2023-11-06T13:32:03.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.716+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c416de30 msgr2=0x7f40c41904f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:03.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.716+0000 7f40cb483700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c416de30 0x7f40c41904f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f40c40c3a30 tx=0x7f40c0017000).stop 2023-11-06T13:32:03.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.717+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 shutdown_connections 2023-11-06T13:32:03.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.717+0000 7f40cb483700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f40a808cb40 0x7f40a808f000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.717+0000 7f40cb483700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40c416de30 0x7f40c41904f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.717+0000 7f40cb483700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f40c40c2790 0x7f40c40ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.717+0000 7f40cb483700 1 --2- 172.21.15.38:0/1482836819 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f40c4176c80 0x7f40c40ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:03.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.717+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 >> 172.21.15.38:0/1482836819 conn(0x7f40c40f22b0 msgr2=0x7f40c40ee1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:03.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.722+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 shutdown_connections 2023-11-06T13:32:03.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:03.722+0000 7f40cb483700 1 -- 172.21.15.38:0/1482836819 wait complete. 2023-11-06T13:32:03.752 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:32:10.297 INFO:tasks.workunit.client.0.smithi038.stdout: 212 2156409 1148 1385917 813 494350 850 2023-11-06T13:32:20.297 INFO:tasks.workunit.client.0.smithi038.stdout: 242 742749 1371 474591 1313 178044 2092 2023-11-06T13:32:29.215 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:32:29.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:32:29.221 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:32:30.297 INFO:tasks.workunit.client.0.smithi038.stdout: 273 55739 1658 35561 1668 13403 1607 2023-11-06T13:32:33.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:32:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.881+0000 7fa8fd1c4700 1 Processor -- start 2023-11-06T13:32:33.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.881+0000 7fa8fd1c4700 1 -- start start 2023-11-06T13:32:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8fd1c4700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8f817e430 0x7fa8f80eda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8fd1c4700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fa8f817f900 0x7fa8f80edf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8fd1c4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f80eca10 con 0x7fa8f817e810 2023-11-06T13:32:33.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8fd1c4700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80853c0 con 0x7fa8f817e430 2023-11-06T13:32:33.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8fd1c4700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f80ecc60 con 0x7fa8f817f900 2023-11-06T13:32:33.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8f817e430 0x7fa8f80eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fa8f817e430 0x7fa8f80eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49978/0 (socket says 172.21.15.38:49978) 2023-11-06T13:32:33.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/2508928981 learned_addr learned my addr 172.21.15.38:0/2508928981 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:33.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f759e700 1 --1- 172.21.15.38:0/2508928981 >> v1:172.21.15.44:6789/0 conn(0x7fa8f817e810 0x7fa8f8062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:50954/0 (socket says 172.21.15.38:50954) 2023-11-06T13:32:33.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f659c700 1 --2- 172.21.15.38:0/2508928981 >> v2:172.21.15.163:3300/0 conn(0x7fa8f817f900 0x7fa8f80edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/2508928981 >> v2:172.21.15.163:3300/0 conn(0x7fa8f817f900 msgr2=0x7fa8f80edf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/2508928981 >> v2:172.21.15.163:3300/0 conn(0x7fa8f817f900 0x7fa8f80edf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/2508928981 >> v1:172.21.15.44:6789/0 conn(0x7fa8f817e810 legacy=0x7fa8f8062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/2508928981 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80ecf40 con 0x7fa8f817e430 2023-11-06T13:32:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.883+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/2508928981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f80eda20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fa8f80f1fb0 tx=0x7fa8e80090f0).ready entity=mon.0 client_cookie=50a1cf819bf6993d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8f5d9b700 1 -- 172.21.15.38:0/2508928981 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800b520 con 0x7fa8f817e430 2023-11-06T13:32:33.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8f5d9b700 1 -- 172.21.15.38:0/2508928981 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800b680 con 0x7fa8f817e430 2023-11-06T13:32:33.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8f5d9b700 1 -- 172.21.15.38:0/2508928981 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800ba20 con 0x7fa8f817e430 2023-11-06T13:32:33.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/2508928981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 msgr2=0x7fa8f80eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/2508928981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f80eda20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fa8f80f1fb0 tx=0x7fa8e80090f0).stop 2023-11-06T13:32:33.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/2508928981 shutdown_connections 2023-11-06T13:32:33.893 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/2508928981 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f80eda20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/2508928981 >> v2:172.21.15.163:3300/0 conn(0x7fa8f817f900 0x7fa8f80edf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/2508928981 >> 172.21.15.38:0/2508928981 conn(0x7fa8f80f2b40 msgr2=0x7fa8f80eeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:33.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/2508928981 shutdown_connections 2023-11-06T13:32:33.894 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.884+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/2508928981 wait complete. 2023-11-06T13:32:33.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.886+0000 7fa8fd1c4700 1 Processor -- start 2023-11-06T13:32:33.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.886+0000 7fa8fd1c4700 1 -- start start 2023-11-06T13:32:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8fd1c4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f8190410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8fd1c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8f817e810 0x7fa8f816b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8fd1c4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8f817f900 0x7fa8f81629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8fd1c4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f816b380 con 0x7fa8f817e430 2023-11-06T13:32:33.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8fd1c4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f8190900 con 0x7fa8f817f900 2023-11-06T13:32:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8fd1c4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f816a490 con 0x7fa8f817e810 2023-11-06T13:32:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f8190410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f8190410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:49992/0 (socket says 172.21.15.38:49992) 2023-11-06T13:32:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1018952837 learned_addr learned my addr 172.21.15.38:0/1018952837 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:33.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8f817f900 0x7fa8f81629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8f817e810 msgr2=0x7fa8f816b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8f817e810 0x7fa8f816b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1018952837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8f817f900 msgr2=0x7fa8f81629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8f817f900 0x7fa8f81629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.887+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1018952837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e8009370 con 0x7fa8f817e430 2023-11-06T13:32:33.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.888+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f8190410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fa8f8086b80 tx=0x7fa8e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.888+0000 7fa8deffd700 1 -- 172.21.15.38:0/1018952837 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8006990 con 0x7fa8f817e430 2023-11-06T13:32:33.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.888+0000 7fa8deffd700 1 -- 172.21.15.38:0/1018952837 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e8000bc0 con 0x7fa8f817e430 2023-11-06T13:32:33.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.888+0000 7fa8deffd700 1 -- 172.21.15.38:0/1018952837 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e801c420 con 0x7fa8f817e430 2023-11-06T13:32:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.888+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f816a770 con 0x7fa8f817e430 2023-11-06T13:32:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.888+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f816ad30 con 0x7fa8f817e430 2023-11-06T13:32:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.890+0000 7fa8deffd700 1 -- 172.21.15.38:0/1018952837 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fa8e801c850 con 0x7fa8f817e430 2023-11-06T13:32:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.890+0000 7fa8deffd700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa8e408cb40 0x7fa8e408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.890+0000 7fa8deffd700 1 -- 172.21.15.38:0/1018952837 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fa8e80b3aa0 con 0x7fa8f817e430 2023-11-06T13:32:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.891+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa8e408cb40 0x7fa8e408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.891+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa8e408cb40 0x7fa8e408f000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa8f8190080 tx=0x7fa8ec009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.892+0000 7fa90eb5cb80 1 Processor -- start 2023-11-06T13:32:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.892+0000 7fa90eb5cb80 1 -- start start 2023-11-06T13:32:33.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.893+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b0d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.893+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16b0d8f0 0x55da16ac9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.893+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.893+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16a8ffd0 con 0x55da16b0d8f0 2023-11-06T13:32:33.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.893+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16a07240 con 0x55da16886e90 2023-11-06T13:32:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.893+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16a1c490 con 0x55da16aca110 2023-11-06T13:32:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16b0d8f0 0x55da16ac9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b0d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16b0d8f0 0x55da16ac9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50008/0 (socket says 172.21.15.38:50008) 2023-11-06T13:32:33.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f659c700 1 -- 172.21.15.38:0/1892942652 learned_addr learned my addr 172.21.15.38:0/1892942652 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1892942652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 msgr2=0x55da16b0ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b0ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1892942652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16b0d8f0 msgr2=0x55da16ac9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16b0d8f0 0x55da16ac9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1892942652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da16a15670 con 0x55da16886e90 2023-11-06T13:32:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b0d400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa8e8008000 tx=0x7fa8e800ba20).ready entity=mon.1 client_cookie=9302776f41d6f712 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8d7fff700 1 -- 172.21.15.38:0/1892942652 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80878b0 con 0x55da16886e90 2023-11-06T13:32:33.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8d7fff700 1 -- 172.21.15.38:0/1892942652 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80876d0 con 0x55da16886e90 2023-11-06T13:32:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.894+0000 7fa8d7fff700 1 -- 172.21.15.38:0/1892942652 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8087d70 con 0x55da16886e90 2023-11-06T13:32:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1892942652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 msgr2=0x55da16b0d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b0d400 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa8e8008000 tx=0x7fa8e800ba20).stop 2023-11-06T13:32:33.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1892942652 shutdown_connections 2023-11-06T13:32:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b0ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b0d400 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1892942652 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16b0d8f0 0x55da16ac9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1892942652 >> 172.21.15.38:0/1892942652 conn(0x55da169344f0 msgr2=0x55da16acad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:33.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1892942652 shutdown_connections 2023-11-06T13:32:33.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.895+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1892942652 wait complete. 2023-11-06T13:32:33.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.896+0000 7fa90eb5cb80 1 -- start start 2023-11-06T13:32:33.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.896+0000 7fa90eb5cb80 1 Processor -- start 2023-11-06T13:32:33.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b3aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 0x55da16afae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16b0d8f0 0x55da16b4a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16a1c5d0 con 0x55da16aca110 2023-11-06T13:32:33.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16a1c850 con 0x55da16886e90 2023-11-06T13:32:33.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da169e7e60 con 0x55da16b0d8f0 2023-11-06T13:32:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa90eb5cb80 10 client.0 ll_register_callbacks cb 0x55da16a8a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:32:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa8f659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 0x55da16afae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b3aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa8f659c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 0x55da16afae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50022/0 (socket says 172.21.15.38:50022) 2023-11-06T13:32:33.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa8f659c700 1 -- 172.21.15.38:0/1991895730 learned_addr learned my addr 172.21.15.38:0/1991895730 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.897+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16b0d8f0 0x55da16b4a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16b0d8f0 msgr2=0x55da16b4a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16b0d8f0 0x55da16b4a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1991895730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 msgr2=0x55da16afae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 0x55da16afae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1991895730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f816ad30 con 0x55da16886e90 2023-11-06T13:32:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b3aed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa8e8087a70 tx=0x7fa8e8056000).ready entity=mon.1 client_cookie=b487a9579ae18029 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 0x55da16afae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:32:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:32:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8d57fa700 1 -- 172.21.15.38:0/1991895730 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8087d70 con 0x55da16886e90 2023-11-06T13:32:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8d57fa700 1 -- 172.21.15.38:0/1991895730 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fa8e808d650 con 0x55da16886e90 2023-11-06T13:32:33.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da16abe690 con 0x55da16886e90 2023-11-06T13:32:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8d57fa700 1 -- 172.21.15.38:0/1991895730 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8e8087470 con 0x55da16886e90 2023-11-06T13:32:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 10 client.5224 fetch_fsmap learned FSMap version 27 2023-11-06T13:32:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55da16a10a10 con 0x55da16886e90 2023-11-06T13:32:33.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8d57fa700 1 -- 172.21.15.38:0/1991895730 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a0020 con 0x55da16886e90 2023-11-06T13:32:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa8d57fa700 1 -- 172.21.15.38:0/1991895730 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7fa8e808d1c0 con 0x55da16886e90 2023-11-06T13:32:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 10 client.5224 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:32:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 10 client.5224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:32:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 20 client.5224 populate_metadata read hostname 'smithi038' 2023-11-06T13:32:33.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16ac8d60 0x55da16b4c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.898+0000 7fa90eb5cb80 4 client.5224 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:32:33.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.899+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da16882cf0 con 0x55da16ac8d60 2023-11-06T13:32:33.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.899+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16ac8d60 0x55da16b4c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.900+0000 7fa8d57fa700 10 client.5224 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:33.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.900+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16ac8d60 0x55da16b4c090 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a880ce959ef4f1bf server_cookie=429cec360e3d3489 in_seq=0 out_seq=0 2023-11-06T13:32:33.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa8d57fa700 1 -- 172.21.15.38:0/1991895730 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55da16882cf0 con 0x55da16ac8d60 2023-11-06T13:32:33.926 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa8d57fa700 10 client.5224 handle_command_reply: tid=0 2023-11-06T13:32:33.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 client.5224 shutdown 2023-11-06T13:32:33.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 msgr2=0x55da16b3aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b3aed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa8e8087a70 tx=0x7fa8e8056000).stop 2023-11-06T13:32:33.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 shutdown_connections 2023-11-06T13:32:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16ac8d60 0x55da16b4c090 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16b0d8f0 0x55da16b4a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16886e90 0x55da16b3aed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.928 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1991895730 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16aca110 0x55da16afae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa8d57fa700 0 client.5224 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:33.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 >> 172.21.15.38:0/1991895730 conn(0x55da169344f0 msgr2=0x55da16ad1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:33.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 shutdown_connections 2023-11-06T13:32:33.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1991895730 wait complete. 2023-11-06T13:32:33.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.905+0000 7fa90eb5cb80 20 client.5224 trim_cache size 0 max 16384 2023-11-06T13:32:33.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.922+0000 7fa90eb5cb80 1 Processor -- start 2023-11-06T13:32:33.930 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.922+0000 7fa90eb5cb80 1 -- start start 2023-11-06T13:32:33.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b3c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b4c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16b49a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16aca870 con 0x55da16886e90 2023-11-06T13:32:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16b4a940 con 0x55da16b0d8f0 2023-11-06T13:32:33.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16b49f40 con 0x55da16aca110 2023-11-06T13:32:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.924+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b3c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b3c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50032/0 (socket says 172.21.15.38:50032) 2023-11-06T13:32:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/1146546607 learned_addr learned my addr 172.21.15.38:0/1146546607 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16b49a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f659c700 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b4c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 -- 172.21.15.38:0/1146546607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 msgr2=0x55da16b4c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b4c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 -- 172.21.15.38:0/1146546607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 msgr2=0x55da16b3c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b3c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 -- 172.21.15.38:0/1146546607 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da16a10760 con 0x55da16b0d8f0 2023-11-06T13:32:33.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b3c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:32:33.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8f759e700 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16b49a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x55da16b0f7a0 tx=0x7fa8f0006040).ready entity=mon.1 client_cookie=747a094a1e094d1c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8dcbcf700 1 -- 172.21.15.38:0/1146546607 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0001a90 con 0x55da16b0d8f0 2023-11-06T13:32:33.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8dcbcf700 1 -- 172.21.15.38:0/1146546607 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f001b030 con 0x55da16b0d8f0 2023-11-06T13:32:33.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.925+0000 7fa8dcbcf700 1 -- 172.21.15.38:0/1146546607 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0001e40 con 0x55da16b0d8f0 2023-11-06T13:32:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1146546607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 msgr2=0x55da16b49a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16b49a50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x55da16b0f7a0 tx=0x7fa8f0006040).stop 2023-11-06T13:32:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1146546607 shutdown_connections 2023-11-06T13:32:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16b49a50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b3c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/1146546607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b4c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1146546607 >> 172.21.15.38:0/1146546607 conn(0x55da169344f0 msgr2=0x55da16ac6910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:33.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1146546607 shutdown_connections 2023-11-06T13:32:33.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.926+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/1146546607 wait complete. 2023-11-06T13:32:33.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.927+0000 7fa90eb5cb80 1 -- start start 2023-11-06T13:32:33.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.927+0000 7fa90eb5cb80 1 Processor -- start 2023-11-06T13:32:33.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.928+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b0ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.928+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b38ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.928+0000 7fa90eb5cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16ba1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.928+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16b97fb0 con 0x55da16886e90 2023-11-06T13:32:33.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.928+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16b9eb20 con 0x55da16b0d8f0 2023-11-06T13:32:33.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.928+0000 7fa90eb5cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da16b0cfd0 con 0x55da16aca110 2023-11-06T13:32:33.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa90eb5cb80 10 client.0 ll_register_callbacks cb 0x7fa8ec0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:32:33.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b0ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b0ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50048/0 (socket says 172.21.15.38:50048) 2023-11-06T13:32:33.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/9120415 learned_addr learned my addr 172.21.15.38:0/9120415 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:32:33.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f759e700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16ba1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 msgr2=0x55da16b38ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b38ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/9120415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 msgr2=0x55da16ba1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:32:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16ba1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 -- 172.21.15.38:0/9120415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da16a10a10 con 0x55da16886e90 2023-11-06T13:32:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f759e700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16ba1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:32:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8f6d9d700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b0ddd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa8e8006ca0 tx=0x7fa8e808f070).ready entity=mon.0 client_cookie=93b3afada4d8f3b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:32:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:32:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8d57fa700 1 -- 172.21.15.38:0/9120415 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8087470 con 0x55da16886e90 2023-11-06T13:32:33.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8d57fa700 1 -- 172.21.15.38:0/9120415 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fa8e80a1080 con 0x55da16886e90 2023-11-06T13:32:33.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8e80876d0 con 0x55da16886e90 2023-11-06T13:32:33.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa8d57fa700 1 -- 172.21.15.38:0/9120415 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8e800b520 con 0x55da16886e90 2023-11-06T13:32:33.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa90eb5cb80 10 client.5403 fetch_fsmap learned FSMap version 27 2023-11-06T13:32:33.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.929+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x7fa8f80eca10 con 0x55da16886e90 2023-11-06T13:32:33.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa8d57fa700 1 -- 172.21.15.38:0/9120415 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80876d0 con 0x55da16886e90 2023-11-06T13:32:33.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa8d57fa700 1 -- 172.21.15.38:0/9120415 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7fa8e8083b60 con 0x55da16886e90 2023-11-06T13:32:33.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa90eb5cb80 10 client.5403 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:32:33.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa90eb5cb80 10 client.5403 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:32:33.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa90eb5cb80 20 client.5403 populate_metadata read hostname 'smithi038' 2023-11-06T13:32:33.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16b97630 0x55da16b904d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:32:33.950 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa90eb5cb80 4 client.5403 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:32:33.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55da168b9cf0 con 0x55da16b97630 2023-11-06T13:32:33.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa8f659c700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16b97630 0x55da16b904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:32:33.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa8d57fa700 10 client.5403 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:33.951 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.930+0000 7fa8f659c700 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16b97630 0x55da16b904d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5b0e5227262f59eb server_cookie=341722ee6590dd2c in_seq=0 out_seq=0 2023-11-06T13:32:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.933+0000 7fa8d57fa700 1 -- 172.21.15.38:0/9120415 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55da168b9cf0 con 0x55da16b97630 2023-11-06T13:32:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.933+0000 7fa8d57fa700 10 client.5403 handle_command_reply: tid=0 2023-11-06T13:32:33.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.933+0000 7fa90eb5cb80 1 client.5403 shutdown 2023-11-06T13:32:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 msgr2=0x55da16b0ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b0ddd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa8e8006ca0 tx=0x7fa8e808f070).stop 2023-11-06T13:32:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 shutdown_connections 2023-11-06T13:32:33.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55da16b0d8f0 0x55da16ba1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55da16886e90 0x55da16b0ddd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55da16b97630 0x55da16b904d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 --2- 172.21.15.38:0/9120415 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da16aca110 0x55da16b38ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:33.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa8d57fa700 0 client.5403 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:32:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 >> 172.21.15.38:0/9120415 conn(0x55da169344f0 msgr2=0x55da16afae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 shutdown_connections 2023-11-06T13:32:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 1 -- 172.21.15.38:0/9120415 wait complete. 2023-11-06T13:32:33.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.934+0000 7fa90eb5cb80 20 client.5403 trim_cache size 0 max 16384 2023-11-06T13:32:33.957 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:32:33.957 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:32:33.957 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:32:33.957 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:32:33.957 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:32:33.958 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:32:33.958 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:32:33.958 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:32:33.958 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:32:33.958 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:32:33.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa8e408cb40 msgr2=0x7fa8e408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa8e408cb40 0x7fa8e408f000 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fa8f8190080 tx=0x7fa8ec009060).stop 2023-11-06T13:32:33.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 msgr2=0x7fa8f8190410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:32:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f8190410 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fa8f8086b80 tx=0x7fa8e8017000).stop 2023-11-06T13:32:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 shutdown_connections 2023-11-06T13:32:33.961 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fa8e408cb40 0x7fa8e408f000 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa8f817f900 0x7fa8f81629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fa8f817e430 0x7fa8f8190410 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:32:33.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 --2- 172.21.15.38:0/1018952837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa8f817e810 0x7fa8f816b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:32:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 >> 172.21.15.38:0/1018952837 conn(0x7fa8f80f2b40 msgr2=0x7fa8f8174800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:32:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 shutdown_connections 2023-11-06T13:32:33.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:32:33.935+0000 7fa8fd1c4700 1 -- 172.21.15.38:0/1018952837 wait complete. 2023-11-06T13:32:33.963 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:32:40.297 INFO:tasks.workunit.client.0.smithi038.stdout: 312 7257 1843 4856 1897 2471 1266 2023-11-06T13:32:50.297 INFO:tasks.workunit.client.0.smithi038.stdout: 338 10214 1358 6437 1246 1997 913 2023-11-06T13:32:59.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:32:59.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:32:59.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:33:00.298 INFO:tasks.workunit.client.0.smithi038.stdout: 352 5187 517 3402 779 1845 656 2023-11-06T13:33:03.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:33:04.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.087+0000 7f29b359e700 1 Processor -- start 2023-11-06T13:33:04.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.087+0000 7f29b359e700 1 -- start start 2023-11-06T13:33:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b359e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b417dff0 0x7f29b417e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b359e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29b417f600 0x7f29b40c2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b359e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b417fa90 con 0x7f29b417f150 2023-11-06T13:33:04.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b359e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40edf70 con 0x7f29b417dff0 2023-11-06T13:33:04.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b359e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b406a880 con 0x7f29b417f600 2023-11-06T13:33:04.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b417dff0 0x7f29b417e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b259c700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f29b417dff0 0x7f29b417e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41078/0 (socket says 172.21.15.38:41078) 2023-11-06T13:33:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.088+0000 7f29b2d9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f29b417f600 0x7f29b40c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b259c700 1 -- 172.21.15.38:0/1191947945 learned_addr learned my addr 172.21.15.38:0/1191947945 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b259c700 1 -- 172.21.15.38:0/1191947945 >> v2:172.21.15.44:3300/0 conn(0x7f29b417f600 msgr2=0x7f29b40c2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b259c700 1 --2- 172.21.15.38:0/1191947945 >> v2:172.21.15.44:3300/0 conn(0x7f29b417f600 0x7f29b40c2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b259c700 1 -- 172.21.15.38:0/1191947945 >> v1:172.21.15.163:6789/0 conn(0x7f29b417f150 legacy=0x7f29b40c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b259c700 1 -- 172.21.15.38:0/1191947945 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40e8ad0 con 0x7f29b417dff0 2023-11-06T13:33:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b259c700 1 --2- 172.21.15.38:0/1191947945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417dff0 0x7f29b417e3d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f29b40eb060 tx=0x7f29a40090f0).ready entity=mon.0 client_cookie=d7fea4cebdf4fee2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b1d9b700 1 -- 172.21.15.38:0/1191947945 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400b520 con 0x7f29b417dff0 2023-11-06T13:33:04.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b1d9b700 1 -- 172.21.15.38:0/1191947945 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400b680 con 0x7f29b417dff0 2023-11-06T13:33:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b1d9b700 1 -- 172.21.15.38:0/1191947945 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400ba00 con 0x7f29b417dff0 2023-11-06T13:33:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b359e700 1 -- 172.21.15.38:0/1191947945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417dff0 msgr2=0x7f29b417e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.089+0000 7f29b359e700 1 --2- 172.21.15.38:0/1191947945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417dff0 0x7f29b417e3d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f29b40eb060 tx=0x7f29a40090f0).stop 2023-11-06T13:33:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.090+0000 7f29b359e700 1 -- 172.21.15.38:0/1191947945 shutdown_connections 2023-11-06T13:33:04.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.090+0000 7f29b359e700 1 --2- 172.21.15.38:0/1191947945 >> v2:172.21.15.44:3300/0 conn(0x7f29b417f600 0x7f29b40c2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.090+0000 7f29b359e700 1 --2- 172.21.15.38:0/1191947945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417dff0 0x7f29b417e3d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.090+0000 7f29b359e700 1 -- 172.21.15.38:0/1191947945 >> 172.21.15.38:0/1191947945 conn(0x7f29b405e1b0 msgr2=0x7f29b405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.090+0000 7f29b359e700 1 -- 172.21.15.38:0/1191947945 shutdown_connections 2023-11-06T13:33:04.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.090+0000 7f29b359e700 1 -- 172.21.15.38:0/1191947945 wait complete. 2023-11-06T13:33:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.091+0000 7f29b359e700 1 Processor -- start 2023-11-06T13:33:04.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.091+0000 7f29b359e700 1 -- start start 2023-11-06T13:33:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.092+0000 7f29b359e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b417dff0 0x7f29b4156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.092+0000 7f29b359e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417f150 0x7f29b4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.092+0000 7f29b359e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 0x7f29b418d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.092+0000 7f29b359e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b418ce80 con 0x7f29b417f600 2023-11-06T13:33:04.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.092+0000 7f29b359e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c86e0 con 0x7f29b417f150 2023-11-06T13:33:04.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.092+0000 7f29b359e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40c89c0 con 0x7f29b417dff0 2023-11-06T13:33:04.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 0x7f29b418d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 0x7f29b418d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41086/0 (socket says 172.21.15.38:41086) 2023-11-06T13:33:04.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1047544280 learned_addr learned my addr 172.21.15.38:0/1047544280 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b259c700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b417dff0 0x7f29b4156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29abfff700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417f150 0x7f29b4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b417dff0 msgr2=0x7f29b4156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b417dff0 0x7f29b4156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1047544280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417f150 msgr2=0x7f29b4156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417f150 0x7f29b4156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1047544280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a4009370 con 0x7f29b417f600 2023-11-06T13:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b259c700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b417dff0 0x7f29b4156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 0x7f29b418d640 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f29ac009e90 tx=0x7f29ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29aa7fc700 1 -- 172.21.15.38:0/1047544280 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00cb50 con 0x7f29b417f600 2023-11-06T13:33:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29aa7fc700 1 -- 172.21.15.38:0/1047544280 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00f040 con 0x7f29b417f600 2023-11-06T13:33:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40c8ca0 con 0x7f29b417f600 2023-11-06T13:33:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29aa7fc700 1 -- 172.21.15.38:0/1047544280 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00cec0 con 0x7f29b417f600 2023-11-06T13:33:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.093+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40c8f80 con 0x7f29b417f600 2023-11-06T13:33:04.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.095+0000 7f29aa7fc700 1 -- 172.21.15.38:0/1047544280 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f29ac013610 con 0x7f29b417f600 2023-11-06T13:33:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.096+0000 7f29aa7fc700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cb40 0x7f299408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.096+0000 7f29aa7fc700 1 -- 172.21.15.38:0/1047544280 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f29ac0b28c0 con 0x7f29b417f600 2023-11-06T13:33:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.096+0000 7f29b259c700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cb40 0x7f299408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.097+0000 7f29b259c700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cb40 0x7f299408f000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f29a4009130 tx=0x7f29a4017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.098+0000 7f29ca52bb80 1 Processor -- start 2023-11-06T13:33:04.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.098+0000 7f29ca52bb80 1 -- start start 2023-11-06T13:33:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.113 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a131fd0 con 0x56549a1b57f0 2023-11-06T13:33:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a0a9240 con 0x56549a1ad9a0 2023-11-06T13:33:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a0be490 con 0x565499f28e90 2023-11-06T13:33:04.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29abfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41098/0 (socket says 172.21.15.38:41098) 2023-11-06T13:33:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29b2d9d700 1 -- 172.21.15.38:0/2895699515 learned_addr learned my addr 172.21.15.38:0/2895699515 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29b259c700 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29abfff700 1 -- 172.21.15.38:0/2895699515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 msgr2=0x56549a1ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29abfff700 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29abfff700 1 -- 172.21.15.38:0/2895699515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 msgr2=0x56549a1b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29abfff700 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29abfff700 1 -- 172.21.15.38:0/2895699515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549a0b7670 con 0x56549a1ad9a0 2023-11-06T13:33:04.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.099+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:33:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29abfff700 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1b5300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f299c003840 tx=0x7f299c007d40).ready entity=mon.1 client_cookie=166b814cfe3e1fe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29937fe700 1 -- 172.21.15.38:0/2895699515 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c003040 con 0x56549a1ad9a0 2023-11-06T13:33:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29937fe700 1 -- 172.21.15.38:0/2895699515 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c003270 con 0x56549a1ad9a0 2023-11-06T13:33:04.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29937fe700 1 -- 172.21.15.38:0/2895699515 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c007240 con 0x56549a1ad9a0 2023-11-06T13:33:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2895699515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 msgr2=0x56549a1b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1b5300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f299c003840 tx=0x7f299c007d40).stop 2023-11-06T13:33:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2895699515 shutdown_connections 2023-11-06T13:33:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2895699515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1b5300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.100+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2895699515 >> 172.21.15.38:0/2895699515 conn(0x565499fd64f0 msgr2=0x56549a16c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:04.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.101+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2895699515 shutdown_connections 2023-11-06T13:33:04.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.101+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2895699515 wait complete. 2023-11-06T13:33:04.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.101+0000 7f29ca52bb80 1 -- start start 2023-11-06T13:33:04.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.101+0000 7f29ca52bb80 1 Processor -- start 2023-11-06T13:33:04.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.102+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 0x56549a1d9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.102+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1b57f0 0x56549a1a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a0be5d0 con 0x565499f28e90 2023-11-06T13:33:04.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a0be850 con 0x56549a1ad9a0 2023-11-06T13:33:04.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a089e60 con 0x56549a1b57f0 2023-11-06T13:33:04.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 10 client.0 ll_register_callbacks cb 0x56549a12c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:33:04.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 0x56549a1d9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29abfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1b57f0 0x56549a1a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 0x56549a1d9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41106/0 (socket says 172.21.15.38:41106) 2023-11-06T13:33:04.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 -- 172.21.15.38:0/824647804 learned_addr learned my addr 172.21.15.38:0/824647804 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:04.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 -- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1b57f0 msgr2=0x56549a1a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1b57f0 0x56549a1a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 -- 172.21.15.38:0/824647804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 msgr2=0x56549a1d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 -- 172.21.15.38:0/824647804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40c8f80 con 0x565499f28e90 2023-11-06T13:33:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29b259c700 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 0x56549a1d9060 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f29b4086140 tx=0x7f29a401e070).ready entity=mon.0 client_cookie=821d5a38a1a94ed7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f2990ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:33:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f2990ff9700 1 -- 172.21.15.38:0/824647804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a401ce20 con 0x565499f28e90 2023-11-06T13:33:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56549a160690 con 0x565499f28e90 2023-11-06T13:33:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f2990ff9700 1 -- 172.21.15.38:0/824647804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f29a4026610 con 0x565499f28e90 2023-11-06T13:33:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f2990ff9700 1 -- 172.21.15.38:0/824647804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29a4026a30 con 0x565499f28e90 2023-11-06T13:33:04.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 10 client.5415 fetch_fsmap learned FSMap version 27 2023-11-06T13:33:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.103+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x7f299c003460 con 0x565499f28e90 2023-11-06T13:33:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f2990ff9700 1 -- 172.21.15.38:0/824647804 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56549a160690 con 0x565499f28e90 2023-11-06T13:33:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f2990ff9700 1 -- 172.21.15.38:0/824647804 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7f29a4026b90 con 0x565499f28e90 2023-11-06T13:33:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29ca52bb80 10 client.5415 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:33:04.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29ca52bb80 10 client.5415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:33:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29ca52bb80 20 client.5415 populate_metadata read hostname 'smithi038' 2023-11-06T13:33:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1ec240 0x56549a1d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29ca52bb80 4 client.5415 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:33:04.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565499f24cf0 con 0x56549a1ec240 2023-11-06T13:33:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29abfff700 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1ec240 0x56549a1d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f2990ff9700 10 client.5415 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.104+0000 7f29abfff700 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1ec240 0x56549a1d86f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=96d2bb2c6eb4469d server_cookie=e750f830cc6c4eed in_seq=0 out_seq=0 2023-11-06T13:33:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.106+0000 7f2990ff9700 1 -- 172.21.15.38:0/824647804 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x565499f24cf0 con 0x56549a1ec240 2023-11-06T13:33:04.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.106+0000 7f2990ff9700 10 client.5415 handle_command_reply: tid=0 2023-11-06T13:33:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 client.5415 shutdown 2023-11-06T13:33:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 msgr2=0x56549a1d9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 0x56549a1d9060 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f29b4086140 tx=0x7f29a401e070).stop 2023-11-06T13:33:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 shutdown_connections 2023-11-06T13:33:04.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1ec240 0x56549a1d86f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1b57f0 0x56549a1a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x565499f28e90 0x56549a1d9060 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/824647804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1ad9a0 0x56549a1d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f2990ff9700 0 client.5415 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:04.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 >> 172.21.15.38:0/824647804 conn(0x565499fd64f0 msgr2=0x56549a1a9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 shutdown_connections 2023-11-06T13:33:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 1 -- 172.21.15.38:0/824647804 wait complete. 2023-11-06T13:33:04.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.107+0000 7f29ca52bb80 20 client.5415 trim_cache size 0 max 16384 2023-11-06T13:33:04.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.124+0000 7f29ca52bb80 1 Processor -- start 2023-11-06T13:33:04.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.124+0000 7f29ca52bb80 1 -- start start 2023-11-06T13:33:04.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1dbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 0x56549a1a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1b57f0 0x56549a1ac500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a16cb60 con 0x56549a1ad9a0 2023-11-06T13:33:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a1d9370 con 0x56549a1b57f0 2023-11-06T13:33:04.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a166b20 con 0x565499f28e90 2023-11-06T13:33:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 0x56549a1a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 0x56549a1a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41118/0 (socket says 172.21.15.38:41118) 2023-11-06T13:33:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 -- 172.21.15.38:0/2898264022 learned_addr learned my addr 172.21.15.38:0/2898264022 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1b57f0 0x56549a1ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.138 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29b259c700 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1dbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 -- 172.21.15.38:0/2898264022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 msgr2=0x56549a1dbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1dbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 -- 172.21.15.38:0/2898264022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1b57f0 msgr2=0x56549a1ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1b57f0 0x56549a1ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.139 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 -- 172.21.15.38:0/2898264022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549a1ad810 con 0x56549a1ad9a0 2023-11-06T13:33:04.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.125+0000 7f29abfff700 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 0x56549a1a7320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f299c003e30 tx=0x7f299c016000).ready entity=mon.0 client_cookie=8c2f4a19b898d335 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f2993fff700 1 -- 172.21.15.38:0/2898264022 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c007030 con 0x56549a1ad9a0 2023-11-06T13:33:04.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f2993fff700 1 -- 172.21.15.38:0/2898264022 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c007190 con 0x56549a1ad9a0 2023-11-06T13:33:04.140 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f2993fff700 1 -- 172.21.15.38:0/2898264022 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c0066a0 con 0x56549a1ad9a0 2023-11-06T13:33:04.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2898264022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 msgr2=0x56549a1a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 0x56549a1a7320 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f299c003e30 tx=0x7f299c016000).stop 2023-11-06T13:33:04.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2898264022 shutdown_connections 2023-11-06T13:33:04.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56549a1b57f0 0x56549a1ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x565499f28e90 0x56549a1dbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/2898264022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1ad9a0 0x56549a1a7320 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2898264022 >> 172.21.15.38:0/2898264022 conn(0x565499fd64f0 msgr2=0x56549a1eec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:04.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2898264022 shutdown_connections 2023-11-06T13:33:04.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.126+0000 7f29ca52bb80 1 -- 172.21.15.38:0/2898264022 wait complete. 2023-11-06T13:33:04.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.127+0000 7f29ca52bb80 1 -- start start 2023-11-06T13:33:04.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.127+0000 7f29ca52bb80 1 Processor -- start 2023-11-06T13:33:04.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565499f28e90 0x56549a16cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1ad9a0 0x56549a227e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a1d2c90 con 0x56549a1b57f0 2023-11-06T13:33:04.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a1d1f00 con 0x565499f28e90 2023-11-06T13:33:04.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a16db80 con 0x56549a1ad9a0 2023-11-06T13:33:04.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29ca52bb80 10 client.0 ll_register_callbacks cb 0x56549a12c5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:33:04.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29b259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565499f28e90 0x56549a16cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29b259c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565499f28e90 0x56549a16cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:49898/0 (socket says 172.21.15.38:49898) 2023-11-06T13:33:04.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29b259c700 1 -- 172.21.15.38:0/1370893929 learned_addr learned my addr 172.21.15.38:0/1370893929 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:04.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29b2d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:41120/0 (socket says 172.21.15.38:41120) 2023-11-06T13:33:04.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.128+0000 7f29abfff700 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1ad9a0 0x56549a227e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1ad9a0 msgr2=0x56549a227e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1ad9a0 0x56549a227e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1370893929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565499f28e90 msgr2=0x56549a16cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:04.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565499f28e90 0x56549a16cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29b2d9d700 1 -- 172.21.15.38:0/1370893929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c019040 con 0x56549a1b57f0 2023-11-06T13:33:04.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29b2d9d700 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1d2070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x56549a16c640 tx=0x7f29ac088040).ready entity=mon.0 client_cookie=2501cecf9f5a9fbd server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:04.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f2990ff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:33:04.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f2990ff9700 1 -- 172.21.15.38:0/1370893929 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac058070 con 0x56549a1b57f0 2023-11-06T13:33:04.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f2990ff9700 1 -- 172.21.15.38:0/1370893929 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f29ac086290 con 0x56549a1b57f0 2023-11-06T13:33:04.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f299c003270 con 0x56549a1b57f0 2023-11-06T13:33:04.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f2990ff9700 1 -- 172.21.15.38:0/1370893929 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29ac085000 con 0x56549a1b57f0 2023-11-06T13:33:04.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29ca52bb80 10 client.5421 fetch_fsmap learned FSMap version 27 2023-11-06T13:33:04.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x56549a0b2a10 con 0x56549a1b57f0 2023-11-06T13:33:04.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f2990ff9700 1 -- 172.21.15.38:0/1370893929 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c003270 con 0x56549a1b57f0 2023-11-06T13:33:04.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f2990ff9700 1 -- 172.21.15.38:0/1370893929 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7f29ac082980 con 0x56549a1b57f0 2023-11-06T13:33:04.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29ca52bb80 10 client.5421 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:33:04.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.129+0000 7f29ca52bb80 10 client.5421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:33:04.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f29ca52bb80 20 client.5421 populate_metadata read hostname 'smithi038' 2023-11-06T13:33:04.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1af430 0x56549a232930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:04.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f29ca52bb80 4 client.5421 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:33:04.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565499f5bcf0 con 0x56549a1af430 2023-11-06T13:33:04.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f29b259c700 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1af430 0x56549a232930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:04.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f29b259c700 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1af430 0x56549a232930 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=58968e16263bf779 server_cookie=57c9560ce73ce767 in_seq=0 out_seq=0 2023-11-06T13:33:04.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.130+0000 7f2990ff9700 10 client.5421 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:04.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.131+0000 7f2990ff9700 1 -- 172.21.15.38:0/1370893929 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x565499f5bcf0 con 0x56549a1af430 2023-11-06T13:33:04.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.131+0000 7f2990ff9700 10 client.5421 handle_command_reply: tid=0 2023-11-06T13:33:04.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.131+0000 7f29ca52bb80 1 client.5421 shutdown 2023-11-06T13:33:04.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 msgr2=0x56549a1d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1d2070 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x56549a16c640 tx=0x7f29ac088040).stop 2023-11-06T13:33:04.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 shutdown_connections 2023-11-06T13:33:04.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56549a1b57f0 0x56549a1d2070 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x565499f28e90 0x56549a16cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56549a1af430 0x56549a232930 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 --2- 172.21.15.38:0/1370893929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56549a1ad9a0 0x56549a227e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f2990ff9700 0 client.5421 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:04.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 >> 172.21.15.38:0/1370893929 conn(0x565499fd64f0 msgr2=0x56549a1d6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:04.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 shutdown_connections 2023-11-06T13:33:04.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 1 -- 172.21.15.38:0/1370893929 wait complete. 2023-11-06T13:33:04.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29ca52bb80 20 client.5421 trim_cache size 0 max 16384 2023-11-06T13:33:04.154 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:33:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:33:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:33:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:33:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:33:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:33:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:33:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:33:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:33:04.156 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:33:04.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cb40 msgr2=0x7f299408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cb40 0x7f299408f000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f29a4009130 tx=0x7f29a4017000).stop 2023-11-06T13:33:04.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 msgr2=0x7f29b418d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:04.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 0x7f29b418d640 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f29ac009e90 tx=0x7f29ac00b040).stop 2023-11-06T13:33:04.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 shutdown_connections 2023-11-06T13:33:04.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f29b417f600 0x7f29b418d640 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f29b417dff0 0x7f29b4156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f299408cb40 0x7f299408f000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 --2- 172.21.15.38:0/1047544280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29b417f150 0x7f29b4156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:04.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.132+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 >> 172.21.15.38:0/1047544280 conn(0x7f29b405e1b0 msgr2=0x7f29b4174460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:04.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.133+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 shutdown_connections 2023-11-06T13:33:04.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:04.133+0000 7f29b359e700 1 -- 172.21.15.38:0/1047544280 wait complete. 2023-11-06T13:33:04.160 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:33:10.298 INFO:tasks.workunit.client.0.smithi038.stdout: 375 1409 1166 760 1094 640 1127 2023-11-06T13:33:20.299 INFO:tasks.workunit.client.0.smithi038.stdout: 397 34227 1300 23752 1170 9274 469 2023-11-06T13:33:30.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:33:30.195 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:33:30.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:33:30.299 INFO:tasks.workunit.client.0.smithi038.stdout: 410 1486083 635 986517 652 404300 757 2023-11-06T13:33:34.162 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:33:35.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.329+0000 7fb834625700 1 Processor -- start 2023-11-06T13:33:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.329+0000 7fb834625700 1 -- start start 2023-11-06T13:33:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.331+0000 7fb834625700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb82c175460 0x7fb82c1797b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.332+0000 7fb834625700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fb82c17c620 0x7fb82c17cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.332+0000 7fb834625700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82c17d5e0 con 0x7fb82c175080 2023-11-06T13:33:35.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.332+0000 7fb834625700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c0c3ea0 con 0x7fb82c175460 2023-11-06T13:33:35.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.332+0000 7fb834625700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c17d8c0 con 0x7fb82c17c620 2023-11-06T13:33:35.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.349+0000 7fb8323c1700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb82c175080 0x7fb82c1790a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:52888/0 (socket says 172.21.15.38:52888) 2023-11-06T13:33:35.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.349+0000 7fb8323c1700 1 -- 172.21.15.38:0/895053003 learned_addr learned my addr 172.21.15.38:0/895053003 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:33:35.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.352+0000 7fb832bc2700 1 --2- 172.21.15.38:0/895053003 >> v2:172.21.15.163:3300/0 conn(0x7fb82c17c620 0x7fb82c17cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.353+0000 7fb832bc2700 1 -- 172.21.15.38:0/895053003 >> v2:172.21.15.44:3300/0 conn(0x7fb82c175460 msgr2=0x7fb82c1797b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:33:35.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.353+0000 7fb832bc2700 1 --2- 172.21.15.38:0/895053003 >> v2:172.21.15.44:3300/0 conn(0x7fb82c175460 0x7fb82c1797b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.353+0000 7fb832bc2700 1 -- 172.21.15.38:0/895053003 >> v1:172.21.15.44:6789/0 conn(0x7fb82c175080 legacy=0x7fb82c1790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.353+0000 7fb832bc2700 1 -- 172.21.15.38:0/895053003 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c17dba0 con 0x7fb82c17c620 2023-11-06T13:33:35.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.353+0000 7fb832bc2700 1 --2- 172.21.15.38:0/895053003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 0x7fb82c17cab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb82c0ebe50 tx=0x7fb82400a890).ready entity=mon.2 client_cookie=ea7e0ec9ca052569 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.397+0000 7fb8313bf700 1 -- 172.21.15.38:0/895053003 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400f070 con 0x7fb82c17c620 2023-11-06T13:33:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.397+0000 7fb8313bf700 1 -- 172.21.15.38:0/895053003 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400a2e0 con 0x7fb82c17c620 2023-11-06T13:33:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.397+0000 7fb8313bf700 1 -- 172.21.15.38:0/895053003 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400cbe0 con 0x7fb82c17c620 2023-11-06T13:33:35.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.401+0000 7fb834625700 1 -- 172.21.15.38:0/895053003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 msgr2=0x7fb82c17cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.401+0000 7fb834625700 1 --2- 172.21.15.38:0/895053003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 0x7fb82c17cab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fb82c0ebe50 tx=0x7fb82400a890).stop 2023-11-06T13:33:35.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.427+0000 7fb834625700 1 -- 172.21.15.38:0/895053003 shutdown_connections 2023-11-06T13:33:35.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.427+0000 7fb834625700 1 --2- 172.21.15.38:0/895053003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 0x7fb82c17cab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.427+0000 7fb834625700 1 --2- 172.21.15.38:0/895053003 >> v2:172.21.15.44:3300/0 conn(0x7fb82c175460 0x7fb82c1797b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.427+0000 7fb834625700 1 -- 172.21.15.38:0/895053003 >> 172.21.15.38:0/895053003 conn(0x7fb82c0ee2a0 msgr2=0x7fb82c0ee6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:35.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.427+0000 7fb834625700 1 -- 172.21.15.38:0/895053003 shutdown_connections 2023-11-06T13:33:35.452 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.446+0000 7fb834625700 1 -- 172.21.15.38:0/895053003 wait complete. 2023-11-06T13:33:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.449+0000 7fb834625700 1 Processor -- start 2023-11-06T13:33:35.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.449+0000 7fb834625700 1 -- start start 2023-11-06T13:33:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.451+0000 7fb834625700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 0x7fb82c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.451+0000 7fb834625700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c175460 0x7fb82c1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.451+0000 7fb834625700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 0x7fb82c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.451+0000 7fb834625700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0c6060 con 0x7fb82c175460 2023-11-06T13:33:35.456 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.451+0000 7fb834625700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c16f900 con 0x7fb82c175080 2023-11-06T13:33:35.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.451+0000 7fb834625700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0c56e0 con 0x7fb82c17c620 2023-11-06T13:33:35.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.452+0000 7fb8323c1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 0x7fb82c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.457 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.452+0000 7fb8323c1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 0x7fb82c0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:34426/0 (socket says 172.21.15.38:34426) 2023-11-06T13:33:35.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.452+0000 7fb8323c1700 1 -- 172.21.15.38:0/2581783006 learned_addr learned my addr 172.21.15.38:0/2581783006 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:35.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.453+0000 7fb8323c1700 1 -- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 msgr2=0x7fb82c152c70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:33:35.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.453+0000 7fb8323c1700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 0x7fb82c152c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.453+0000 7fb8323c1700 1 -- 172.21.15.38:0/2581783006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c175460 msgr2=0x7fb82c1534c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:33:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.453+0000 7fb8323c1700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c175460 0x7fb82c1534c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.453+0000 7fb8323c1700 1 -- 172.21.15.38:0/2581783006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82400ab30 con 0x7fb82c175080 2023-11-06T13:33:35.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.453+0000 7fb8323c1700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 0x7fb82c0c5b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb81c00c5e0 tx=0x7fb81c007db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.469+0000 7fb8227fc700 1 -- 172.21.15.38:0/2581783006 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0072e0 con 0x7fb82c175080 2023-11-06T13:33:35.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.469+0000 7fb8227fc700 1 -- 172.21.15.38:0/2581783006 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c007440 con 0x7fb82c175080 2023-11-06T13:33:35.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.469+0000 7fb8227fc700 1 -- 172.21.15.38:0/2581783006 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0057a0 con 0x7fb82c175080 2023-11-06T13:33:35.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.469+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c193e50 con 0x7fb82c175080 2023-11-06T13:33:35.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.469+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c194410 con 0x7fb82c175080 2023-11-06T13:33:35.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.483+0000 7fb845fbdb80 1 Processor -- start 2023-11-06T13:33:35.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.485+0000 7fb8227fc700 1 -- 172.21.15.38:0/2581783006 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fb81c005b10 con 0x7fb82c175080 2023-11-06T13:33:35.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.486+0000 7fb8227fc700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb81008cb60 0x7fb81008f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.498 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.486+0000 7fb8227fc700 1 -- 172.21.15.38:0/2581783006 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb81c0b1870 con 0x7fb82c175080 2023-11-06T13:33:35.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.486+0000 7fb832bc2700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb81008cb60 0x7fb81008f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.486+0000 7fb845fbdb80 1 -- start start 2023-11-06T13:33:35.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.487+0000 7fb832bc2700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb81008cb60 0x7fb81008f020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb82400afd0 tx=0x7fb82400a890).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.499 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c248400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c204c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c245c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c1cafd0 con 0x56265bfc1e90 2023-11-06T13:33:35.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c142240 con 0x56265c2488f0 2023-11-06T13:33:35.500 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c157490 con 0x56265c205110 2023-11-06T13:33:35.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.488+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c204c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c204c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:34442/0 (socket says 172.21.15.38:34442) 2023-11-06T13:33:35.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 -- 172.21.15.38:0/1311969139 learned_addr learned my addr 172.21.15.38:0/1311969139 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:35.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb832bc2700 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c245c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 -- 172.21.15.38:0/1311969139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 msgr2=0x56265c245c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c245c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 -- 172.21.15.38:0/1311969139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 msgr2=0x56265c248400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c248400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 -- 172.21.15.38:0/1311969139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56265c150670 con 0x56265c2488f0 2023-11-06T13:33:35.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.489+0000 7fb831bc0700 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c204c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb82800b6b0 tx=0x7fb828006e60).ready entity=mon.1 client_cookie=a4c8d7f26892fed server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.513+0000 7fb80f7fe700 1 -- 172.21.15.38:0/1311969139 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82802f4b0 con 0x56265c2488f0 2023-11-06T13:33:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.513+0000 7fb80f7fe700 1 -- 172.21.15.38:0/1311969139 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82802f610 con 0x56265c2488f0 2023-11-06T13:33:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.513+0000 7fb80f7fe700 1 -- 172.21.15.38:0/1311969139 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82802f9d0 con 0x56265c2488f0 2023-11-06T13:33:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 -- 172.21.15.38:0/1311969139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 msgr2=0x56265c204c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c204c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fb82800b6b0 tx=0x7fb828006e60).stop 2023-11-06T13:33:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 -- 172.21.15.38:0/1311969139 shutdown_connections 2023-11-06T13:33:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c245c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c248400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/1311969139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c204c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.514+0000 7fb845fbdb80 1 -- 172.21.15.38:0/1311969139 >> 172.21.15.38:0/1311969139 conn(0x56265c06f4f0 msgr2=0x56265c205d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:35.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.515+0000 7fb845fbdb80 1 -- 172.21.15.38:0/1311969139 shutdown_connections 2023-11-06T13:33:35.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.515+0000 7fb845fbdb80 1 -- 172.21.15.38:0/1311969139 wait complete. 2023-11-06T13:33:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.517+0000 7fb845fbdb80 1 -- start start 2023-11-06T13:33:35.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.517+0000 7fb845fbdb80 1 Processor -- start 2023-11-06T13:33:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265bfc1e90 0x56265c236230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c24c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 0x56265c244960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c1575d0 con 0x56265c2488f0 2023-11-06T13:33:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c157850 con 0x56265bfc1e90 2023-11-06T13:33:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c122e60 con 0x56265c205110 2023-11-06T13:33:35.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb845fbdb80 10 client.0 ll_register_callbacks cb 0x56265c1c53d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:33:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c24c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.520+0000 7fb8323c1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265bfc1e90 0x56265c236230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb8323c1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265bfc1e90 0x56265c236230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:34458/0 (socket says 172.21.15.38:34458) 2023-11-06T13:33:35.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb8323c1700 1 -- 172.21.15.38:0/636322857 learned_addr learned my addr 172.21.15.38:0/636322857 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb831bc0700 1 -- 172.21.15.38:0/636322857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265bfc1e90 msgr2=0x56265c236230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb831bc0700 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265bfc1e90 0x56265c236230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb831bc0700 1 -- 172.21.15.38:0/636322857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 msgr2=0x56265c244960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb831bc0700 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 0x56265c244960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.521+0000 7fb831bc0700 1 -- 172.21.15.38:0/636322857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82800b200 con 0x56265c205110 2023-11-06T13:33:35.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.522+0000 7fb831bc0700 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c24c640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fb82800b680 tx=0x7fb828035000).ready entity=mon.2 client_cookie=c18b6abac9eda06d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.534+0000 7fb80cff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:33:35.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.534+0000 7fb80cff9700 1 -- 172.21.15.38:0/636322857 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82802f4b0 con 0x56265c205110 2023-11-06T13:33:35.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.534+0000 7fb80cff9700 1 -- 172.21.15.38:0/636322857 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb82802fe00 con 0x56265c205110 2023-11-06T13:33:35.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.534+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56265c1f9690 con 0x56265c205110 2023-11-06T13:33:35.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.546+0000 7fb80cff9700 1 -- 172.21.15.38:0/636322857 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb828000bc0 con 0x56265c205110 2023-11-06T13:33:35.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.546+0000 7fb845fbdb80 10 client.5300 fetch_fsmap learned FSMap version 27 2023-11-06T13:33:35.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.546+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x56265c14ba10 con 0x56265c205110 2023-11-06T13:33:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb80cff9700 1 -- 172.21.15.38:0/636322857 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56265c1f9690 con 0x56265c205110 2023-11-06T13:33:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb80cff9700 1 -- 172.21.15.38:0/636322857 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7fb828047070 con 0x56265c205110 2023-11-06T13:33:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb845fbdb80 10 client.5300 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:33:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb845fbdb80 10 client.5300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:33:35.559 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb845fbdb80 20 client.5300 populate_metadata read hostname 'smithi038' 2023-11-06T13:33:35.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c204760 0x56265c204b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb845fbdb80 4 client.5300 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:33:35.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.555+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56265bfbdcf0 con 0x56265c204760 2023-11-06T13:33:35.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.556+0000 7fb8323c1700 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c204760 0x56265c204b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.566+0000 7fb80cff9700 10 client.5300 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.577+0000 7fb8323c1700 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c204760 0x56265c204b70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5803f8e47984406e server_cookie=d689ffa0a1b67272 in_seq=0 out_seq=0 2023-11-06T13:33:35.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.589+0000 7fb80cff9700 1 -- 172.21.15.38:0/636322857 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56265bfbdcf0 con 0x56265c204760 2023-11-06T13:33:35.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.589+0000 7fb80cff9700 10 client.5300 handle_command_reply: tid=0 2023-11-06T13:33:35.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.600+0000 7fb845fbdb80 1 client.5300 shutdown 2023-11-06T13:33:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.603+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 msgr2=0x56265c24c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.603+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c24c640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fb82800b680 tx=0x7fb828035000).stop 2023-11-06T13:33:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.604+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 shutdown_connections 2023-11-06T13:33:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.604+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 0x56265c244960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.604+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265bfc1e90 0x56265c236230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.604+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c204760 0x56265c204b70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.604+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/636322857 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c24c640 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.604+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 >> 172.21.15.38:0/636322857 conn(0x56265c06f4f0 msgr2=0x56265c247640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.608+0000 7fb80cff9700 0 client.5300 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:35.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.608+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 shutdown_connections 2023-11-06T13:33:35.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.617+0000 7fb845fbdb80 1 -- 172.21.15.38:0/636322857 wait complete. 2023-11-06T13:33:35.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.633+0000 7fb845fbdb80 20 client.5300 trim_cache size 0 max 16384 2023-11-06T13:33:35.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.710+0000 7fb845fbdb80 1 Processor -- start 2023-11-06T13:33:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.721+0000 7fb845fbdb80 1 -- start start 2023-11-06T13:33:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.723+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265bfc1e90 0x56265c2cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.723+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 0x56265c2cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.723+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 0x56265c2d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.723+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c204e50 con 0x56265c2488f0 2023-11-06T13:33:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.723+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c2437b0 con 0x56265c205110 2023-11-06T13:33:35.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.723+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c204890 con 0x56265bfc1e90 2023-11-06T13:33:35.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.725+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 0x56265c2cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.725+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 0x56265c2cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:34468/0 (socket says 172.21.15.38:34468) 2023-11-06T13:33:35.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.725+0000 7fb831bc0700 1 -- 172.21.15.38:0/3399683843 learned_addr learned my addr 172.21.15.38:0/3399683843 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:35.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.725+0000 7fb8323c1700 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265bfc1e90 0x56265c2cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.726+0000 7fb831bc0700 1 -- 172.21.15.38:0/3399683843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265bfc1e90 msgr2=0x56265c2cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.726+0000 7fb831bc0700 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265bfc1e90 0x56265c2cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.726+0000 7fb831bc0700 1 -- 172.21.15.38:0/3399683843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 msgr2=0x56265c2d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.726+0000 7fb831bc0700 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 0x56265c2d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.726+0000 7fb831bc0700 1 -- 172.21.15.38:0/3399683843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56265c1f92b0 con 0x56265c205110 2023-11-06T13:33:35.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.726+0000 7fb831bc0700 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 0x56265c2cfe50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb82800b4f0 tx=0x7fb82803e000).ready entity=mon.1 client_cookie=8ab0554ad2a020d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.743+0000 7fb80ffff700 1 -- 172.21.15.38:0/3399683843 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828006a80 con 0x56265c205110 2023-11-06T13:33:35.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.743+0000 7fb80ffff700 1 -- 172.21.15.38:0/3399683843 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82802f780 con 0x56265c205110 2023-11-06T13:33:35.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.743+0000 7fb80ffff700 1 -- 172.21.15.38:0/3399683843 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82802f1d0 con 0x56265c205110 2023-11-06T13:33:35.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.744+0000 7fb845fbdb80 1 -- 172.21.15.38:0/3399683843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 msgr2=0x56265c2cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.744+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 0x56265c2cfe50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb82800b4f0 tx=0x7fb82803e000).stop 2023-11-06T13:33:35.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.754+0000 7fb845fbdb80 1 -- 172.21.15.38:0/3399683843 shutdown_connections 2023-11-06T13:33:35.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.754+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265c2488f0 0x56265c2d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.754+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265bfc1e90 0x56265c2cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.754+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/3399683843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c205110 0x56265c2cfe50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.758 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.754+0000 7fb845fbdb80 1 -- 172.21.15.38:0/3399683843 >> 172.21.15.38:0/3399683843 conn(0x56265c06f4f0 msgr2=0x56265c2440e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:35.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.759+0000 7fb845fbdb80 1 -- 172.21.15.38:0/3399683843 shutdown_connections 2023-11-06T13:33:35.762 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.759+0000 7fb845fbdb80 1 -- 172.21.15.38:0/3399683843 wait complete. 2023-11-06T13:33:35.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.761+0000 7fb845fbdb80 1 -- start start 2023-11-06T13:33:35.779 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.761+0000 7fb845fbdb80 1 Processor -- start 2023-11-06T13:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c20afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c2ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c2ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c20ba40 con 0x56265bfc1e90 2023-11-06T13:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c2ca4f0 con 0x56265c2488f0 2023-11-06T13:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56265c2bf460 con 0x56265c205110 2023-11-06T13:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb845fbdb80 10 client.0 ll_register_callbacks cb 0x56265c1c53d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:33:35.783 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.778+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c2ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c2ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:46982/0 (socket says 172.21.15.38:46982) 2023-11-06T13:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 -- 172.21.15.38:0/95267440 learned_addr learned my addr 172.21.15.38:0/95267440 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb832bc2700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c2ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.784 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb8323c1700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c20afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 -- 172.21.15.38:0/95267440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 msgr2=0x56265c2ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.785 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c2ddd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 -- 172.21.15.38:0/95267440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 msgr2=0x56265c20afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:33:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c20afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 -- 172.21.15.38:0/95267440 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56265c14ba10 con 0x56265c205110 2023-11-06T13:33:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb8323c1700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c20afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:33:35.786 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb831bc0700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c2ca000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fb828000e10 tx=0x7fb828051000).ready entity=mon.2 client_cookie=689910e70fe6cb4f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:33:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.779+0000 7fb80cff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:33:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.780+0000 7fb80cff9700 1 -- 172.21.15.38:0/95267440 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828034b80 con 0x56265c205110 2023-11-06T13:33:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.780+0000 7fb80cff9700 1 -- 172.21.15.38:0/95267440 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb828034ce0 con 0x56265c205110 2023-11-06T13:33:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.780+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb82802f610 con 0x56265c205110 2023-11-06T13:33:35.787 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.780+0000 7fb80cff9700 1 -- 172.21.15.38:0/95267440 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb828034ea0 con 0x56265c205110 2023-11-06T13:33:35.789 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.786+0000 7fb845fbdb80 10 client.5306 fetch_fsmap learned FSMap version 27 2023-11-06T13:33:35.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.786+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x56265c14b760 con 0x56265c205110 2023-11-06T13:33:35.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.786+0000 7fb80cff9700 1 -- 172.21.15.38:0/95267440 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82802f610 con 0x56265c205110 2023-11-06T13:33:35.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb80cff9700 1 -- 172.21.15.38:0/95267440 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7fb82800bb20 con 0x56265c205110 2023-11-06T13:33:35.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb845fbdb80 10 client.5306 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:33:35.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb845fbdb80 10 client.5306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:33:35.791 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb845fbdb80 20 client.5306 populate_metadata read hostname 'smithi038' 2023-11-06T13:33:35.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c2c6660 0x56265c2da250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:33:35.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb845fbdb80 4 client.5306 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:33:35.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56265bff4cf0 con 0x56265c2c6660 2023-11-06T13:33:35.792 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.787+0000 7fb8323c1700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c2c6660 0x56265c2da250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:33:35.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.788+0000 7fb80cff9700 10 client.5306 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:35.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.788+0000 7fb8323c1700 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c2c6660 0x56265c2da250 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=43bb52246f2f767a server_cookie=8426c00307775cf7 in_seq=0 out_seq=0 2023-11-06T13:33:35.793 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.788+0000 7fb80cff9700 1 -- 172.21.15.38:0/95267440 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56265bff4cf0 con 0x56265c2c6660 2023-11-06T13:33:35.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.788+0000 7fb80cff9700 10 client.5306 handle_command_reply: tid=0 2023-11-06T13:33:35.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.788+0000 7fb845fbdb80 1 client.5306 shutdown 2023-11-06T13:33:35.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.798+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 msgr2=0x56265c2ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.798+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c2ca000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fb828000e10 tx=0x7fb828051000).stop 2023-11-06T13:33:35.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 shutdown_connections 2023-11-06T13:33:35.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56265c2488f0 0x56265c2ddd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56265bfc1e90 0x56265c20afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56265c2c6660 0x56265c2da250 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb845fbdb80 1 --2- 172.21.15.38:0/95267440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56265c205110 0x56265c2ca000 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 >> 172.21.15.38:0/95267440 conn(0x56265c06f4f0 msgr2=0x56265c203430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:35.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.809+0000 7fb80cff9700 0 client.5306 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:33:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.814+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 shutdown_connections 2023-11-06T13:33:35.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.814+0000 7fb845fbdb80 1 -- 172.21.15.38:0/95267440 wait complete. 2023-11-06T13:33:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:33:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:33:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:33:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:33:35.824 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:33:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:33:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:33:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:33:35.825 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:33:35.825 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:33:35.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.815+0000 7fb845fbdb80 20 client.5306 trim_cache size 0 max 16384 2023-11-06T13:33:35.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.820+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb81008cb60 msgr2=0x7fb81008f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.820+0000 7fb834625700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb81008cb60 0x7fb81008f020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb82400afd0 tx=0x7fb82400a890).stop 2023-11-06T13:33:35.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.820+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 msgr2=0x7fb82c0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:33:35.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.820+0000 7fb834625700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 0x7fb82c0c5b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb81c00c5e0 tx=0x7fb81c007db0).stop 2023-11-06T13:33:35.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 shutdown_connections 2023-11-06T13:33:35.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb82c17c620 0x7fb82c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb81008cb60 0x7fb81008f020 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb82c175080 0x7fb82c0c5b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:33:35.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 --2- 172.21.15.38:0/2581783006 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb82c175460 0x7fb82c1534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:33:35.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 >> 172.21.15.38:0/2581783006 conn(0x7fb82c0ee2a0 msgr2=0x7fb82c17a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:33:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.825+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 shutdown_connections 2023-11-06T13:33:35.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:33:35.828+0000 7fb834625700 1 -- 172.21.15.38:0/2581783006 wait complete. 2023-11-06T13:33:35.864 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:33:40.299 INFO:tasks.workunit.client.0.smithi038.stdout: 428 2083878 1057 1382757 1036 556216 999 2023-11-06T13:33:50.308 INFO:tasks.workunit.client.0.smithi038.stdout: 443 2223054 979 1476836 966 617744 1512 2023-11-06T13:34:00.310 INFO:tasks.workunit.client.0.smithi038.stdout: 451 1674424 654 1115299 512 477073 1104 2023-11-06T13:34:00.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:34:00.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:34:00.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:34:05.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:34:09.782 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.778+0000 7fe45759e700 1 Processor -- start 2023-11-06T13:34:09.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.791+0000 7fe45759e700 1 -- start start 2023-11-06T13:34:09.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.794+0000 7fe45759e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe458179bc0 0x7fe45817a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:09.805 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.794+0000 7fe45759e700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe45817a560 0x7fe45817ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:09.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.794+0000 7fe45759e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe458178840 con 0x7fe458171660 2023-11-06T13:34:09.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.794+0000 7fe45759e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe458178b20 con 0x7fe458179bc0 2023-11-06T13:34:09.806 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.794+0000 7fe45759e700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe458178e00 con 0x7fe45817a560 2023-11-06T13:34:09.807 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.802+0000 7fe456d9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe45817a560 0x7fe45817ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:09.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.802+0000 7fe456d9d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe45817a560 0x7fe45817ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:51404/0 (socket says 172.21.15.38:51404) 2023-11-06T13:34:09.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.802+0000 7fe456d9d700 1 -- 172.21.15.38:0/4210396636 learned_addr learned my addr 172.21.15.38:0/4210396636 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:09.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.803+0000 7fe456d9d700 1 -- 172.21.15.38:0/4210396636 >> v2:172.21.15.44:3300/0 conn(0x7fe458179bc0 msgr2=0x7fe45817a070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:34:09.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.803+0000 7fe456d9d700 1 --2- 172.21.15.38:0/4210396636 >> v2:172.21.15.44:3300/0 conn(0x7fe458179bc0 0x7fe45817a070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:09.808 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.803+0000 7fe456d9d700 1 -- 172.21.15.38:0/4210396636 >> v1:172.21.15.163:6789/0 conn(0x7fe458171660 legacy=0x7fe45817e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:34:09.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.803+0000 7fe456d9d700 1 -- 172.21.15.38:0/4210396636 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4581790e0 con 0x7fe45817a560 2023-11-06T13:34:09.809 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.803+0000 7fe456d9d700 1 --2- 172.21.15.38:0/4210396636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe45817ab30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe458060b00 tx=0x7fe450007690).ready entity=mon.2 client_cookie=f098bf2035f8682d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:09.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.870+0000 7fe45559a700 1 -- 172.21.15.38:0/4210396636 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450010070 con 0x7fe45817a560 2023-11-06T13:34:09.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.870+0000 7fe45559a700 1 -- 172.21.15.38:0/4210396636 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000de50 con 0x7fe45817a560 2023-11-06T13:34:09.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.870+0000 7fe45559a700 1 -- 172.21.15.38:0/4210396636 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450015680 con 0x7fe45817a560 2023-11-06T13:34:09.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.871+0000 7fe45759e700 1 -- 172.21.15.38:0/4210396636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 msgr2=0x7fe45817ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:09.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.871+0000 7fe45759e700 1 --2- 172.21.15.38:0/4210396636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe45817ab30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fe458060b00 tx=0x7fe450007690).stop 2023-11-06T13:34:09.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.935+0000 7fe45759e700 1 -- 172.21.15.38:0/4210396636 shutdown_connections 2023-11-06T13:34:09.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.935+0000 7fe45759e700 1 --2- 172.21.15.38:0/4210396636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe45817ab30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:09.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.935+0000 7fe45759e700 1 --2- 172.21.15.38:0/4210396636 >> v2:172.21.15.44:3300/0 conn(0x7fe458179bc0 0x7fe45817a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:09.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.935+0000 7fe45759e700 1 -- 172.21.15.38:0/4210396636 >> 172.21.15.38:0/4210396636 conn(0x7fe4580f18c0 msgr2=0x7fe4580ed8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:09.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.935+0000 7fe45759e700 1 -- 172.21.15.38:0/4210396636 shutdown_connections 2023-11-06T13:34:09.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.935+0000 7fe45759e700 1 -- 172.21.15.38:0/4210396636 wait complete. 2023-11-06T13:34:09.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.938+0000 7fe45759e700 1 Processor -- start 2023-11-06T13:34:09.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.939+0000 7fe45759e700 1 -- start start 2023-11-06T13:34:09.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe45759e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe458171660 0x7fe458193380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:09.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe45759e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe458179bc0 0x7fe45815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:09.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe45759e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe4581636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:09.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe45759e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458163230 con 0x7fe458171660 2023-11-06T13:34:09.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe45759e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458162f30 con 0x7fe458179bc0 2023-11-06T13:34:09.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe45759e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458193920 con 0x7fe45817a560 2023-11-06T13:34:09.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.941+0000 7fe455d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe458179bc0 0x7fe45815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:09.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe455d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe458179bc0 0x7fe45815b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40082/0 (socket says 172.21.15.38:40082) 2023-11-06T13:34:09.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe455d9b700 1 -- 172.21.15.38:0/3487468093 learned_addr learned my addr 172.21.15.38:0/3487468093 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:09.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe456d9d700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe4581636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:09.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe456d9d700 1 -- 172.21.15.38:0/3487468093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe458179bc0 msgr2=0x7fe45815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:09.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe456d9d700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe458179bc0 0x7fe45815b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:09.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe456d9d700 1 -- 172.21.15.38:0/3487468093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe458171660 msgr2=0x7fe458193380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:09.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe456d9d700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe458171660 0x7fe458193380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:09.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.942+0000 7fe456d9d700 1 -- 172.21.15.38:0/3487468093 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45000be70 con 0x7fe45817a560 2023-11-06T13:34:09.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:09.943+0000 7fe456d9d700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe4581636c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fe450017000 tx=0x7fe450007690).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:10.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.116+0000 7fe4467fc700 1 -- 172.21.15.38:0/3487468093 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500070e0 con 0x7fe45817a560 2023-11-06T13:34:10.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.116+0000 7fe4467fc700 1 -- 172.21.15.38:0/3487468093 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe450007810 con 0x7fe45817a560 2023-11-06T13:34:10.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.116+0000 7fe4467fc700 1 -- 172.21.15.38:0/3487468093 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450008480 con 0x7fe45817a560 2023-11-06T13:34:10.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.116+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe458193c00 con 0x7fe45817a560 2023-11-06T13:34:10.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.116+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45815b530 con 0x7fe45817a560 2023-11-06T13:34:10.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.123+0000 7fe46e4a9b80 1 Processor -- start 2023-11-06T13:34:10.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.124+0000 7fe4467fc700 1 -- 172.21.15.38:0/3487468093 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fe45001c070 con 0x7fe45817a560 2023-11-06T13:34:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.126+0000 7fe4467fc700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe43808cb60 0x7fe43808f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.126+0000 7fe4467fc700 1 -- 172.21.15.38:0/3487468093 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe4500b3990 con 0x7fe45817a560 2023-11-06T13:34:10.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.127+0000 7fe455d9b700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe43808cb60 0x7fe43808f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.127+0000 7fe46e4a9b80 1 -- start start 2023-11-06T13:34:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.127+0000 7fe455d9b700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe43808cb60 0x7fe43808f020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe44c009930 tx=0x7fe44c006f10).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.129+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c202ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.129+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1ffdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.129+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c1ffe460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.129+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1f82fd0 con 0x55a2c202b050 2023-11-06T13:34:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.129+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1efa240 con 0x55a2c1ffe020 2023-11-06T13:34:10.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.129+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1f0f490 con 0x55a2c1d79e90 2023-11-06T13:34:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1ffdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1ffdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54050/0 (socket says 172.21.15.38:54050) 2023-11-06T13:34:10.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 -- 172.21.15.38:0/4143575949 learned_addr learned my addr 172.21.15.38:0/4143575949 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:10.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 -- 172.21.15.38:0/4143575949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 msgr2=0x55a2c202ab60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:34:10.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c202ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 -- 172.21.15.38:0/4143575949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 msgr2=0x55a2c1ffe460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:34:10.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c1ffe460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.130+0000 7fe455d9b700 1 -- 172.21.15.38:0/4143575949 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2c1f08670 con 0x55a2c202b050 2023-11-06T13:34:10.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.131+0000 7fe455d9b700 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1ffdb30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe44c00e9d0 tx=0x7fe44c012000).ready entity=mon.0 client_cookie=ab94a9462b9a7d6c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.213+0000 7fe43f7fe700 1 -- 172.21.15.38:0/4143575949 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c009e60 con 0x55a2c202b050 2023-11-06T13:34:10.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.213+0000 7fe43f7fe700 1 -- 172.21.15.38:0/4143575949 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0136e0 con 0x55a2c202b050 2023-11-06T13:34:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.213+0000 7fe43f7fe700 1 -- 172.21.15.38:0/4143575949 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c013a60 con 0x55a2c202b050 2023-11-06T13:34:10.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.214+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/4143575949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 msgr2=0x55a2c1ffdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.214+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1ffdb30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe44c00e9d0 tx=0x7fe44c012000).stop 2023-11-06T13:34:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/4143575949 shutdown_connections 2023-11-06T13:34:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c1ffe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c202ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/4143575949 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1ffdb30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/4143575949 >> 172.21.15.38:0/4143575949 conn(0x55a2c1e274f0 msgr2=0x55a2c1fbdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/4143575949 shutdown_connections 2023-11-06T13:34:10.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.215+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/4143575949 wait complete. 2023-11-06T13:34:10.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.216+0000 7fe46e4a9b80 1 -- start start 2023-11-06T13:34:10.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.216+0000 7fe46e4a9b80 1 Processor -- start 2023-11-06T13:34:10.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c202c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c2027af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1f0f5d0 con 0x55a2c202b050 2023-11-06T13:34:10.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1f0f850 con 0x55a2c1ffe020 2023-11-06T13:34:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1edae60 con 0x55a2c1d79e90 2023-11-06T13:34:10.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.219+0000 7fe46e4a9b80 10 client.0 ll_register_callbacks cb 0x55a2c1f7d5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:34:10.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.220+0000 7fe456d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c2027af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.220+0000 7fe456d9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c2027af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:54058/0 (socket says 172.21.15.38:54058) 2023-11-06T13:34:10.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.220+0000 7fe456d9d700 1 -- 172.21.15.38:0/1919958642 learned_addr learned my addr 172.21.15.38:0/1919958642 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:10.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.221+0000 7fe456d9d700 1 -- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 msgr2=0x55a2c2005a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:34:10.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.221+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2005a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.221+0000 7fe456d9d700 1 -- 172.21.15.38:0/1919958642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 msgr2=0x55a2c202c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:34:10.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.221+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c202c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.221+0000 7fe456d9d700 1 -- 172.21.15.38:0/1919958642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c00e5f0 con 0x55a2c202b050 2023-11-06T13:34:10.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.221+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c2027af0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe450008670 tx=0x7fe4500085e0).ready entity=mon.0 client_cookie=701a248c48443159 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:10.310 INFO:tasks.workunit.client.0.smithi038.stdout: 464 2149043 664 1432229 690 631973 1424 2023-11-06T13:34:10.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.348+0000 7fe43cff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:34:10.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.348+0000 7fe43cff9700 1 -- 172.21.15.38:0/1919958642 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450008ac0 con 0x55a2c202b050 2023-11-06T13:34:10.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.348+0000 7fe43cff9700 1 -- 172.21.15.38:0/1919958642 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe450087c60 con 0x55a2c202b050 2023-11-06T13:34:10.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.348+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2c1fb18e0 con 0x55a2c202b050 2023-11-06T13:34:10.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.349+0000 7fe43cff9700 1 -- 172.21.15.38:0/1919958642 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe45008d540 con 0x55a2c202b050 2023-11-06T13:34:10.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.349+0000 7fe46e4a9b80 10 client.5430 fetch_fsmap learned FSMap version 27 2023-11-06T13:34:10.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.349+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55a2c1f03a10 con 0x55a2c202b050 2023-11-06T13:34:10.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.350+0000 7fe43cff9700 1 -- 172.21.15.38:0/1919958642 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a2c1fb18e0 con 0x55a2c202b050 2023-11-06T13:34:10.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.350+0000 7fe43cff9700 1 -- 172.21.15.38:0/1919958642 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7fe450087150 con 0x55a2c202b050 2023-11-06T13:34:10.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe46e4a9b80 10 client.5430 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:34:10.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe46e4a9b80 10 client.5430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:34:10.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe46e4a9b80 20 client.5430 populate_metadata read hostname 'smithi038' 2023-11-06T13:34:10.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c202a1b0 0x55a2c203bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe46e4a9b80 4 client.5430 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:34:10.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2c1d75cf0 con 0x55a2c202a1b0 2023-11-06T13:34:10.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.351+0000 7fe45659c700 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c202a1b0 0x55a2c203bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.362+0000 7fe43cff9700 10 client.5430 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:10.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.362+0000 7fe45659c700 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c202a1b0 0x55a2c203bd10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1b1e54abdc18db30 server_cookie=e65d555bd9ac3d61 in_seq=0 out_seq=0 2023-11-06T13:34:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe43cff9700 1 -- 172.21.15.38:0/1919958642 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a2c1d75cf0 con 0x55a2c202a1b0 2023-11-06T13:34:10.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe43cff9700 10 client.5430 handle_command_reply: tid=0 2023-11-06T13:34:10.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 client.5430 shutdown 2023-11-06T13:34:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 msgr2=0x55a2c2027af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c2027af0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe450008670 tx=0x7fe4500085e0).stop 2023-11-06T13:34:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 shutdown_connections 2023-11-06T13:34:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c2027af0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c202a1b0 0x55a2c203bd10 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2005a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1919958642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c202c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.367+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 >> 172.21.15.38:0/1919958642 conn(0x55a2c1e274f0 msgr2=0x55a2c202a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.368+0000 7fe43cff9700 0 client.5430 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:10.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.368+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 shutdown_connections 2023-11-06T13:34:10.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.368+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1919958642 wait complete. 2023-11-06T13:34:10.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.368+0000 7fe46e4a9b80 20 client.5430 trim_cache size 0 max 16384 2023-11-06T13:34:10.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.461+0000 7fe46e4a9b80 1 Processor -- start 2023-11-06T13:34:10.465 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.461+0000 7fe46e4a9b80 1 -- start start 2023-11-06T13:34:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.463+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 0x55a2c2006770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.467 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c1ffe020 0x55a2c2027d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe45659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 0x55a2c2006770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c202b050 0x55a2c2007860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe45659c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 0x55a2c2006770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40102/0 (socket says 172.21.15.38:40102) 2023-11-06T13:34:10.468 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe45659c700 1 -- 172.21.15.38:0/3818951369 learned_addr learned my addr 172.21.15.38:0/3818951369 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1fbb210 con 0x55a2c1ffe020 2023-11-06T13:34:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c2008be0 con 0x55a2c1d79e90 2023-11-06T13:34:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c2005430 con 0x55a2c202b050 2023-11-06T13:34:10.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe455d9b700 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c1ffe020 0x55a2c2027d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe456d9d700 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c202b050 0x55a2c2007860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe45659c700 1 -- 172.21.15.38:0/3818951369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c202b050 msgr2=0x55a2c2007860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe45659c700 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c202b050 0x55a2c2007860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.464+0000 7fe45659c700 1 -- 172.21.15.38:0/3818951369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c1ffe020 msgr2=0x55a2c2027d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:10.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.465+0000 7fe45659c700 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c1ffe020 0x55a2c2027d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.465+0000 7fe45659c700 1 -- 172.21.15.38:0/3818951369 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2c20062e0 con 0x55a2c1d79e90 2023-11-06T13:34:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.465+0000 7fe455d9b700 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c1ffe020 0x55a2c2027d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:34:10.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.465+0000 7fe45659c700 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 0x55a2c2006770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe4480098b0 tx=0x7fe448002040).ready entity=mon.1 client_cookie=fcc97ae4ac248aa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:10.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.518+0000 7fe43ffff700 1 -- 172.21.15.38:0/3818951369 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480125a0 con 0x55a2c1d79e90 2023-11-06T13:34:10.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.518+0000 7fe43ffff700 1 -- 172.21.15.38:0/3818951369 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448012700 con 0x55a2c1d79e90 2023-11-06T13:34:10.522 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.518+0000 7fe43ffff700 1 -- 172.21.15.38:0/3818951369 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448012aa0 con 0x55a2c1d79e90 2023-11-06T13:34:10.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.550+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 msgr2=0x55a2c2006770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:10.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.550+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 0x55a2c2006770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe4480098b0 tx=0x7fe448002040).stop 2023-11-06T13:34:10.560 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.557+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 shutdown_connections 2023-11-06T13:34:10.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.557+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c202b050 0x55a2c2007860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.557+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1d79e90 0x55a2c2006770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.557+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/3818951369 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c1ffe020 0x55a2c2027d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.557+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 >> 172.21.15.38:0/3818951369 conn(0x55a2c1e274f0 msgr2=0x55a2c1fb7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:10.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.561+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 shutdown_connections 2023-11-06T13:34:10.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.562+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/3818951369 wait complete. 2023-11-06T13:34:10.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.563+0000 7fe46e4a9b80 1 -- start start 2023-11-06T13:34:10.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.563+0000 7fe46e4a9b80 1 Processor -- start 2023-11-06T13:34:10.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2007a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c2091220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1fbe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1ffc650 con 0x55a2c202b050 2023-11-06T13:34:10.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c1ffcef0 con 0x55a2c1ffe020 2023-11-06T13:34:10.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2c20077f0 con 0x55a2c1d79e90 2023-11-06T13:34:10.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.566+0000 7fe46e4a9b80 10 client.0 ll_register_callbacks cb 0x55a2c1f7d5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:34:10.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe455d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c2091220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe455d9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c2091220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40118/0 (socket says 172.21.15.38:40118) 2023-11-06T13:34:10.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe455d9b700 1 -- 172.21.15.38:0/1164972768 learned_addr learned my addr 172.21.15.38:0/1164972768 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:10.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1fbe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe45659c700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2007a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe456d9d700 1 -- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 msgr2=0x55a2c2007a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:10.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2007a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe456d9d700 1 -- 172.21.15.38:0/1164972768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 msgr2=0x55a2c2091220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:10.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c2091220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.567+0000 7fe456d9d700 1 -- 172.21.15.38:0/1164972768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2c1f08670 con 0x55a2c202b050 2023-11-06T13:34:10.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.568+0000 7fe455d9b700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c2091220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:34:10.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.568+0000 7fe456d9d700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1fbe4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe45000d8c0 tx=0x7fe45008f000).ready entity=mon.0 client_cookie=ed715dfc25e0e489 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:10.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.597+0000 7fe43cff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:34:10.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.597+0000 7fe43cff9700 1 -- 172.21.15.38:0/1164972768 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500875c0 con 0x55a2c202b050 2023-11-06T13:34:10.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.597+0000 7fe43cff9700 1 -- 172.21.15.38:0/1164972768 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe450087c60 con 0x55a2c202b050 2023-11-06T13:34:10.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.597+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe44c0136e0 con 0x55a2c202b050 2023-11-06T13:34:10.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.598+0000 7fe43cff9700 1 -- 172.21.15.38:0/1164972768 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe45008d540 con 0x55a2c202b050 2023-11-06T13:34:10.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.598+0000 7fe46e4a9b80 10 client.5436 fetch_fsmap learned FSMap version 27 2023-11-06T13:34:10.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.598+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x7fe4480095b0 con 0x55a2c202b050 2023-11-06T13:34:10.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.598+0000 7fe43cff9700 1 -- 172.21.15.38:0/1164972768 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0136e0 con 0x55a2c202b050 2023-11-06T13:34:10.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.598+0000 7fe43cff9700 1 -- 172.21.15.38:0/1164972768 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 27) v1 ==== 7504+0+0 (secure 0 0 0) 0x7fe4500b1020 con 0x55a2c202b050 2023-11-06T13:34:10.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.606+0000 7fe46e4a9b80 10 client.5436 fetch_fsmap finished waiting for FSMap version 27 2023-11-06T13:34:10.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.606+0000 7fe46e4a9b80 10 client.5436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:34:10.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.606+0000 7fe46e4a9b80 20 client.5436 populate_metadata read hostname 'smithi038' 2023-11-06T13:34:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.606+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c1ff79d0 0x55a2c1ff93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.606+0000 7fe46e4a9b80 4 client.5436 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:34:10.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.606+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a2c1daccf0 con 0x55a2c1ff79d0 2023-11-06T13:34:10.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.627+0000 7fe45659c700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c1ff79d0 0x55a2c1ff93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:10.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.632+0000 7fe43cff9700 10 client.5436 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:10.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.632+0000 7fe45659c700 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c1ff79d0 0x55a2c1ff93e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1a86dd732e4e7ac0 server_cookie=50e21bc49592eddd in_seq=0 out_seq=0 2023-11-06T13:34:10.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.632+0000 7fe43cff9700 1 -- 172.21.15.38:0/1164972768 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a2c1daccf0 con 0x55a2c1ff79d0 2023-11-06T13:34:10.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.632+0000 7fe43cff9700 10 client.5436 handle_command_reply: tid=0 2023-11-06T13:34:10.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.632+0000 7fe46e4a9b80 1 client.5436 shutdown 2023-11-06T13:34:10.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.649+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 msgr2=0x55a2c1fbe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:10.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.649+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1fbe4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe45000d8c0 tx=0x7fe45008f000).stop 2023-11-06T13:34:10.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 shutdown_connections 2023-11-06T13:34:10.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55a2c202b050 0x55a2c1fbe4d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55a2c1ff79d0 0x55a2c1ff93e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a2c1d79e90 0x55a2c2007a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 --2- 172.21.15.38:0/1164972768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a2c1ffe020 0x55a2c2091220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 >> 172.21.15.38:0/1164972768 conn(0x55a2c1e274f0 msgr2=0x55a2c1ffd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:10.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe43cff9700 0 client.5436 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:10.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 shutdown_connections 2023-11-06T13:34:10.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.652+0000 7fe46e4a9b80 1 -- 172.21.15.38:0/1164972768 wait complete. 2023-11-06T13:34:10.666 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.654+0000 7fe46e4a9b80 20 client.5436 trim_cache size 0 max 16384 2023-11-06T13:34:10.667 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:34:10.667 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:34:10.667 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:34:10.667 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:34:10.668 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:34:10.668 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:34:10.668 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:34:10.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:34:10.669 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:34:10.669 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:34:10.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.714+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe43808cb60 msgr2=0x7fe43808f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.714+0000 7fe45759e700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe43808cb60 0x7fe43808f020 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fe44c009930 tx=0x7fe44c006f10).stop 2023-11-06T13:34:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.714+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 msgr2=0x7fe4581636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:10.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.714+0000 7fe45759e700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe4581636c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fe450017000 tx=0x7fe450007690).stop 2023-11-06T13:34:10.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.725+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 shutdown_connections 2023-11-06T13:34:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.725+0000 7fe45759e700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe45817a560 0x7fe4581636c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.725+0000 7fe45759e700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe458171660 0x7fe458193380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:34:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.725+0000 7fe45759e700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe43808cb60 0x7fe43808f020 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.725+0000 7fe45759e700 1 --2- 172.21.15.38:0/3487468093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe458179bc0 0x7fe45815b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:10.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.725+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 >> 172.21.15.38:0/3487468093 conn(0x7fe4580f18c0 msgr2=0x7fe45815ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:10.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.729+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 shutdown_connections 2023-11-06T13:34:10.732 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:10.729+0000 7fe45759e700 1 -- 172.21.15.38:0/3487468093 wait complete. 2023-11-06T13:34:10.832 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:34:20.310 INFO:tasks.workunit.client.0.smithi038.stdout: 487 2025951 1245 1348558 872 611347 851 2023-11-06T13:34:30.310 INFO:tasks.workunit.client.0.smithi038.stdout: 503 2044916 889 1342621 773 589341 738 2023-11-06T13:34:31.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:34:31.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:34:31.229 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:34:31.411 INFO:tasks.ceph.mds.f.smithi163.stderr:2023-11-06T13:34:31.407+0000 7ffabe90f700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95794) UID: 0 2023-11-06T13:34:31.412 INFO:tasks.ceph.mds.c.smithi163.stderr:2023-11-06T13:34:31.407+0000 7f44a0d8d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95794) UID: 0 2023-11-06T13:34:31.412 INFO:tasks.ceph.mds.i.smithi163.stderr:2023-11-06T13:34:31.407+0000 7f68ea7a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95794) UID: 0 2023-11-06T13:34:31.413 INFO:tasks.ceph.mds.l.smithi163.stderr:2023-11-06T13:34:31.408+0000 7f2dabb63700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95794) UID: 0 2023-11-06T13:34:40.314 INFO:tasks.workunit.client.0.smithi038.stdout: 520 1586509 705 1049786 694 454784 297 2023-11-06T13:34:40.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:34:40.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.954+0000 7fe433950700 1 Processor -- start 2023-11-06T13:34:40.958 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.955+0000 7fe433950700 1 -- start start 2023-11-06T13:34:40.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe433950700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe42c180830 0x7fe42c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.959 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe433950700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0ee3c0 con 0x7fe42c0c9eb0 2023-11-06T13:34:40.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe433950700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c183090 con 0x7fe42c175640 2023-11-06T13:34:40.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe433950700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0ed4d0 con 0x7fe42c180830 2023-11-06T13:34:40.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe430eeb700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe42c180830 0x7fe42c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe431eed700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe42c0c9eb0 0x7fe42c0ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:43764/0 (socket says 172.21.15.38:43764) 2023-11-06T13:34:40.960 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe431eed700 1 -- 172.21.15.38:0/134795499 learned_addr learned my addr 172.21.15.38:0/134795499 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:34:40.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe430eeb700 1 -- 172.21.15.38:0/134795499 >> v1:172.21.15.44:6789/0 conn(0x7fe42c175640 legacy=0x7fe42c180120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.962 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe430eeb700 1 -- 172.21.15.38:0/134795499 >> v1:172.21.15.38:6789/0 conn(0x7fe42c0c9eb0 legacy=0x7fe42c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe423fff700 1 -- 172.21.15.38:0/134795499 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726058474 0 0) 0x7fe42c183090 con 0x7fe42c175640 2023-11-06T13:34:40.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe430eeb700 1 -- 172.21.15.38:0/134795499 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0ed7b0 con 0x7fe42c180830 2023-11-06T13:34:40.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.956+0000 7fe430eeb700 1 --2- 172.21.15.38:0/134795499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c0c99c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fe41c009760 tx=0x7fe41c009060).ready entity=mon.0 client_cookie=7d4c5a1cca30ac27 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:40.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe423fff700 1 -- 172.21.15.38:0/134795499 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0090d0 con 0x7fe42c180830 2023-11-06T13:34:40.963 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe423fff700 1 -- 172.21.15.38:0/134795499 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c00f510 con 0x7fe42c180830 2023-11-06T13:34:40.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe423fff700 1 -- 172.21.15.38:0/134795499 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00f890 con 0x7fe42c180830 2023-11-06T13:34:40.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 -- 172.21.15.38:0/134795499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 msgr2=0x7fe42c0c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 --2- 172.21.15.38:0/134795499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c0c99c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fe41c009760 tx=0x7fe41c009060).stop 2023-11-06T13:34:40.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 -- 172.21.15.38:0/134795499 shutdown_connections 2023-11-06T13:34:40.964 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 --2- 172.21.15.38:0/134795499 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c0c99c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 -- 172.21.15.38:0/134795499 >> 172.21.15.38:0/134795499 conn(0x7fe42c0f2090 msgr2=0x7fe42c0f24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:40.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 -- 172.21.15.38:0/134795499 shutdown_connections 2023-11-06T13:34:40.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.957+0000 7fe433950700 1 -- 172.21.15.38:0/134795499 wait complete. 2023-11-06T13:34:40.965 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.959+0000 7fe433950700 1 Processor -- start 2023-11-06T13:34:40.966 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.959+0000 7fe433950700 1 -- start start 2023-11-06T13:34:40.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe433950700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe42c0c9eb0 0x7fe42c192ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe433950700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42c175640 0x7fe42c192fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe433950700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c170ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.969 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe433950700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c190ab0 con 0x7fe42c180830 2023-11-06T13:34:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe433950700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0f12b0 con 0x7fe42c175640 2023-11-06T13:34:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe433950700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0f1590 con 0x7fe42c0c9eb0 2023-11-06T13:34:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c170ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c170ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47016/0 (socket says 172.21.15.38:47016) 2023-11-06T13:34:40.970 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 -- 172.21.15.38:0/1448066849 learned_addr learned my addr 172.21.15.38:0/1448066849 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe430eeb700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42c175640 0x7fe42c192fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe4316ec700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe42c0c9eb0 0x7fe42c192ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 -- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe42c0c9eb0 msgr2=0x7fe42c192ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe42c0c9eb0 0x7fe42c192ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.971 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 -- 172.21.15.38:0/1448066849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42c175640 msgr2=0x7fe42c192fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42c175640 0x7fe42c192fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 -- 172.21.15.38:0/1448066849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0092a0 con 0x7fe42c180830 2023-11-06T13:34:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.960+0000 7fe431eed700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c170ac0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fe42400c890 tx=0x7fe424001610).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.961+0000 7fe4217fa700 1 -- 172.21.15.38:0/1448066849 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424005d30 con 0x7fe42c180830 2023-11-06T13:34:40.972 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.961+0000 7fe4217fa700 1 -- 172.21.15.38:0/1448066849 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424005e90 con 0x7fe42c180830 2023-11-06T13:34:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.961+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0f1870 con 0x7fe42c180830 2023-11-06T13:34:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.961+0000 7fe4217fa700 1 -- 172.21.15.38:0/1448066849 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424007360 con 0x7fe42c180830 2023-11-06T13:34:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.961+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c190740 con 0x7fe42c180830 2023-11-06T13:34:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.963+0000 7fe4217fa700 1 -- 172.21.15.38:0/1448066849 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fe424007750 con 0x7fe42c180830 2023-11-06T13:34:40.973 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.963+0000 7fe4217fa700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe41008cb40 0x7fe41008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.963+0000 7fe4217fa700 1 -- 172.21.15.38:0/1448066849 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe4240b1f80 con 0x7fe42c180830 2023-11-06T13:34:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.963+0000 7fe4316ec700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe41008cb40 0x7fe41008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.964+0000 7fe4316ec700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe41008cb40 0x7fe41008f000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe42c1746d0 tx=0x7fe428009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.965+0000 7fe4452e8b80 1 Processor -- start 2023-11-06T13:34:40.974 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.965+0000 7fe4452e8b80 1 -- start start 2023-11-06T13:34:40.981 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 0x56097c7fa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c7b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c7b7110 0x56097c7f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c77cfd0 con 0x56097c7fa8f0 2023-11-06T13:34:40.982 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c6f4240 con 0x56097c573e90 2023-11-06T13:34:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c709490 con 0x56097c7b7110 2023-11-06T13:34:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe430eeb700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c7b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 0x56097c7fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 0x56097c7fa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56710/0 (socket says 172.21.15.38:56710) 2023-11-06T13:34:40.983 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 -- 172.21.15.38:0/1769539425 learned_addr learned my addr 172.21.15.38:0/1769539425 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe430eeb700 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c7b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47032/0 (socket says 172.21.15.38:47032) 2023-11-06T13:34:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe431eed700 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c7b7110 0x56097c7f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 -- 172.21.15.38:0/1769539425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c7b7110 msgr2=0x56097c7f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c7b7110 0x56097c7f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.984 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 -- 172.21.15.38:0/1769539425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 msgr2=0x56097c7b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c7b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe4316ec700 1 -- 172.21.15.38:0/1769539425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56097c702670 con 0x56097c573e90 2023-11-06T13:34:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.966+0000 7fe430eeb700 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c7b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:34:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4316ec700 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 0x56097c7fa400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe42800fa60 tx=0x7fe428013000).ready entity=mon.1 client_cookie=38afbd60d0b61e7c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:40.985 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4167fc700 1 -- 172.21.15.38:0/1769539425 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428013600 con 0x56097c573e90 2023-11-06T13:34:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4167fc700 1 -- 172.21.15.38:0/1769539425 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428013760 con 0x56097c573e90 2023-11-06T13:34:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4167fc700 1 -- 172.21.15.38:0/1769539425 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4280138d0 con 0x56097c573e90 2023-11-06T13:34:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 -- 172.21.15.38:0/1769539425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 msgr2=0x56097c7fa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 0x56097c7fa400 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fe42800fa60 tx=0x7fe428013000).stop 2023-11-06T13:34:40.986 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 -- 172.21.15.38:0/1769539425 shutdown_connections 2023-11-06T13:34:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c7b7110 0x56097c7f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c573e90 0x56097c7fa400 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/1769539425 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c7b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 -- 172.21.15.38:0/1769539425 >> 172.21.15.38:0/1769539425 conn(0x56097c6214f0 msgr2=0x56097c7b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:40.987 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 -- 172.21.15.38:0/1769539425 shutdown_connections 2023-11-06T13:34:40.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.967+0000 7fe4452e8b80 1 -- 172.21.15.38:0/1769539425 wait complete. 2023-11-06T13:34:40.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.968+0000 7fe4452e8b80 1 -- start start 2023-11-06T13:34:40.988 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.968+0000 7fe4452e8b80 1 Processor -- start 2023-11-06T13:34:40.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.969+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c839320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.969+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c7ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c8376b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c7095d0 con 0x56097c7fa8f0 2023-11-06T13:34:40.989 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c709850 con 0x56097c7b7110 2023-11-06T13:34:40.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c6d4e60 con 0x56097c573e90 2023-11-06T13:34:40.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 10 client.0 ll_register_callbacks cb 0x56097c7773d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:34:40.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c8376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.990 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c8376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47046/0 (socket says 172.21.15.38:47046) 2023-11-06T13:34:40.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 -- 172.21.15.38:0/3482136237 learned_addr learned my addr 172.21.15.38:0/3482136237 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:40.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4316ec700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c839320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe430eeb700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c7ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 -- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 msgr2=0x56097c839320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:40.991 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c839320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 -- 172.21.15.38:0/3482136237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 msgr2=0x56097c7ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:40.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c7ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 -- 172.21.15.38:0/3482136237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c0ed7b0 con 0x56097c7fa8f0 2023-11-06T13:34:40.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe431eed700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c8376b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fe4240861e0 tx=0x7fe424082640).ready entity=mon.0 client_cookie=abe499022a62fe16 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:40.992 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe40b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:34:40.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3482136237 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424058340 con 0x56097c7fa8f0 2023-11-06T13:34:40.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3482136237 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe42408bb30 con 0x56097c7fa8f0 2023-11-06T13:34:40.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56097c7ab690 con 0x56097c7fa8f0 2023-11-06T13:34:40.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3482136237 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe424085950 con 0x56097c7fa8f0 2023-11-06T13:34:40.993 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 10 client.5451 fetch_fsmap learned FSMap version 30 2023-11-06T13:34:40.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.970+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x7fe42800f680 con 0x56097c7fa8f0 2023-11-06T13:34:40.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3482136237 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56097c7ab690 con 0x56097c7fa8f0 2023-11-06T13:34:40.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3482136237 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) v1 ==== 7492+0+0 (secure 0 0 0) 0x7fe42408b6a0 con 0x56097c7fa8f0 2023-11-06T13:34:40.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4452e8b80 10 client.5451 fetch_fsmap finished waiting for FSMap version 30 2023-11-06T13:34:40.994 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4452e8b80 10 client.5451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:34:40.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4452e8b80 20 client.5451 populate_metadata read hostname 'smithi038' 2023-11-06T13:34:40.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c7f7c70 0x56097c7f8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:40.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4452e8b80 4 client.5451 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:34:40.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56097c56fcf0 con 0x56097c7f7c70 2023-11-06T13:34:40.995 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4316ec700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c7f7c70 0x56097c7f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:40.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe40b7fe700 10 client.5451 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:40.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.971+0000 7fe4316ec700 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c7f7c70 0x56097c7f8080 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6546e31b0cb626ef server_cookie=2560e94365636d4 in_seq=0 out_seq=0 2023-11-06T13:34:40.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3482136237 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56097c56fcf0 con 0x56097c7f7c70 2023-11-06T13:34:40.996 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe40b7fe700 10 client.5451 handle_command_reply: tid=0 2023-11-06T13:34:40.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 client.5451 shutdown 2023-11-06T13:34:40.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 msgr2=0x56097c8376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:40.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c8376b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fe4240861e0 tx=0x7fe424082640).stop 2023-11-06T13:34:40.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 shutdown_connections 2023-11-06T13:34:40.997 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c8376b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c7f7c70 0x56097c7f8080 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c839320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe40b7fe700 0 client.5451 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:40.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3482136237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c7ddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:40.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.972+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 >> 172.21.15.38:0/3482136237 conn(0x56097c6214f0 msgr2=0x56097c7bec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:40.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.973+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 shutdown_connections 2023-11-06T13:34:40.999 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.973+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3482136237 wait complete. 2023-11-06T13:34:41.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.973+0000 7fe4452e8b80 20 client.5451 trim_cache size 0 max 16384 2023-11-06T13:34:41.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.989+0000 7fe4452e8b80 1 Processor -- start 2023-11-06T13:34:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.989+0000 7fe4452e8b80 1 -- start start 2023-11-06T13:34:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c827a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c837290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c878c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c7b7900 con 0x56097c7fa8f0 2023-11-06T13:34:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c7b84e0 con 0x56097c7b7110 2023-11-06T13:34:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c7f9020 con 0x56097c573e90 2023-11-06T13:34:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c878c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c878c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47050/0 (socket says 172.21.15.38:47050) 2023-11-06T13:34:41.007 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 -- 172.21.15.38:0/2042913553 learned_addr learned my addr 172.21.15.38:0/2042913553 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:41.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe430eeb700 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c837290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe4316ec700 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c827a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 -- 172.21.15.38:0/2042913553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 msgr2=0x56097c827a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:41.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c827a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.008 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 -- 172.21.15.38:0/2042913553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 msgr2=0x56097c837290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c837290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 -- 172.21.15.38:0/2042913553 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56097c7ab2b0 con 0x56097c7fa8f0 2023-11-06T13:34:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.990+0000 7fe431eed700 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c878c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fe424085f50 tx=0x7fe42408d000).ready entity=mon.0 client_cookie=f8a8e7b5cf68edcf server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe416ffd700 1 -- 172.21.15.38:0/2042913553 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400e040 con 0x56097c7fa8f0 2023-11-06T13:34:41.009 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe416ffd700 1 -- 172.21.15.38:0/2042913553 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424055040 con 0x56097c7fa8f0 2023-11-06T13:34:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe416ffd700 1 -- 172.21.15.38:0/2042913553 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424058340 con 0x56097c7fa8f0 2023-11-06T13:34:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 -- 172.21.15.38:0/2042913553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 msgr2=0x56097c878c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c878c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fe424085f50 tx=0x7fe42408d000).stop 2023-11-06T13:34:41.010 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 -- 172.21.15.38:0/2042913553 shutdown_connections 2023-11-06T13:34:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c878c50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c827a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/2042913553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c837290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 -- 172.21.15.38:0/2042913553 >> 172.21.15.38:0/2042913553 conn(0x56097c6214f0 msgr2=0x56097c826a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:41.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 -- 172.21.15.38:0/2042913553 shutdown_connections 2023-11-06T13:34:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.991+0000 7fe4452e8b80 1 -- 172.21.15.38:0/2042913553 wait complete. 2023-11-06T13:34:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.992+0000 7fe4452e8b80 1 -- start start 2023-11-06T13:34:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.992+0000 7fe4452e8b80 1 Processor -- start 2023-11-06T13:34:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c7e8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c836ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c874860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c7b82b0 con 0x56097c7fa8f0 2023-11-06T13:34:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c838db0 con 0x56097c7b7110 2023-11-06T13:34:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56097c837af0 con 0x56097c573e90 2023-11-06T13:34:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4452e8b80 10 client.0 ll_register_callbacks cb 0x56097c7773d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:34:41.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c874860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe430eeb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c836ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe430eeb700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c836ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56736/0 (socket says 172.21.15.38:56736) 2023-11-06T13:34:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe4316ec700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c7e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe431eed700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c874860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47064/0 (socket says 172.21.15.38:47064) 2023-11-06T13:34:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.993+0000 7fe430eeb700 1 -- 172.21.15.38:0/3978622736 learned_addr learned my addr 172.21.15.38:0/3978622736 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:34:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe431eed700 1 -- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 msgr2=0x56097c7e8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe431eed700 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c7e8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe431eed700 1 -- 172.21.15.38:0/3978622736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 msgr2=0x56097c836ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:34:41.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe431eed700 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c836ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe431eed700 1 -- 172.21.15.38:0/3978622736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42800f680 con 0x56097c7fa8f0 2023-11-06T13:34:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe430eeb700 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c836ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:34:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe431eed700 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c874860 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fe4240845a0 tx=0x7fe42409d000).ready entity=mon.0 client_cookie=c021f9166c4b97ed server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:34:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe40b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:34:41.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3978622736 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424058340 con 0x56097c7fa8f0 2023-11-06T13:34:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3978622736 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe424086250 con 0x56097c7fa8f0 2023-11-06T13:34:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe428013760 con 0x56097c7fa8f0 2023-11-06T13:34:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3978622736 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe42408bb30 con 0x56097c7fa8f0 2023-11-06T13:34:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 10 client.5457 fetch_fsmap learned FSMap version 30 2023-11-06T13:34:41.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x56097c6fda10 con 0x56097c7fa8f0 2023-11-06T13:34:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3978622736 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4240af080 con 0x56097c7fa8f0 2023-11-06T13:34:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3978622736 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 30) v1 ==== 7492+0+0 (secure 0 0 0) 0x7fe4240a3040 con 0x56097c7fa8f0 2023-11-06T13:34:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 10 client.5457 fetch_fsmap finished waiting for FSMap version 30 2023-11-06T13:34:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 10 client.5457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:34:41.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 20 client.5457 populate_metadata read hostname 'smithi038' 2023-11-06T13:34:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c874d50 0x56097c7e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:34:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 4 client.5457 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:34:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.994+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56097c5a6cf0 con 0x56097c874d50 2023-11-06T13:34:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.995+0000 7fe4316ec700 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c874d50 0x56097c7e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:34:41.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.995+0000 7fe4316ec700 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c874d50 0x56097c7e05e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=480c65c6abab4f61 server_cookie=eaa986f9151631d1 in_seq=0 out_seq=0 2023-11-06T13:34:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.995+0000 7fe40b7fe700 10 client.5457 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.995+0000 7fe40b7fe700 1 -- 172.21.15.38:0/3978622736 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56097c5a6cf0 con 0x56097c874d50 2023-11-06T13:34:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.995+0000 7fe40b7fe700 10 client.5457 handle_command_reply: tid=0 2023-11-06T13:34:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.995+0000 7fe4452e8b80 1 client.5457 shutdown 2023-11-06T13:34:41.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 msgr2=0x56097c874860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c874860 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fe4240845a0 tx=0x7fe42409d000).stop 2023-11-06T13:34:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 shutdown_connections 2023-11-06T13:34:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56097c7fa8f0 0x56097c874860 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x56097c874d50 0x56097c7e05e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56097c573e90 0x56097c7e8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 --2- 172.21.15.38:0/3978622736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56097c7b7110 0x56097c836ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe40b7fe700 0 client.5457 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:34:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 >> 172.21.15.38:0/3978622736 conn(0x56097c6214f0 msgr2=0x56097c7b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:41.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 shutdown_connections 2023-11-06T13:34:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 1 -- 172.21.15.38:0/3978622736 wait complete. 2023-11-06T13:34:41.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe4452e8b80 20 client.5457 trim_cache size 0 max 16384 2023-11-06T13:34:41.023 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:34:41.023 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:34:41.024 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:34:41.024 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:34:41.024 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:34:41.024 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:34:41.024 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:34:41.025 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:34:41.025 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:34:41.025 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:34:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe41008cb40 msgr2=0x7fe41008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe41008cb40 0x7fe41008f000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe42c1746d0 tx=0x7fe428009040).stop 2023-11-06T13:34:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 msgr2=0x7fe42c170ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:34:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c170ac0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fe42400c890 tx=0x7fe424001610).stop 2023-11-06T13:34:41.027 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 shutdown_connections 2023-11-06T13:34:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe42c180830 0x7fe42c170ac0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe42c0c9eb0 0x7fe42c192ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe41008cb40 0x7fe41008f000 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.028 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 --2- 172.21.15.38:0/1448066849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42c175640 0x7fe42c192fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:34:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.996+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 >> 172.21.15.38:0/1448066849 conn(0x7fe42c0f2090 msgr2=0x7fe42c153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:34:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.997+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 shutdown_connections 2023-11-06T13:34:41.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:34:40.997+0000 7fe433950700 1 -- 172.21.15.38:0/1448066849 wait complete. 2023-11-06T13:34:41.029 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:35:11.030 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:35:11.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.164+0000 7fd676d8e700 1 Processor -- start 2023-11-06T13:35:11.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.165+0000 7fd676d8e700 1 -- start start 2023-11-06T13:35:11.172 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd676d8e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd670178a70 0x7fd670178e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd676d8e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd670064150 0x7fd670064600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd676d8e700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67017dc00 con 0x7fd67017e090 2023-11-06T13:35:11.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd676d8e700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd670064af0 con 0x7fd670064150 2023-11-06T13:35:11.173 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd676d8e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67017cd10 con 0x7fd670178a70 2023-11-06T13:35:11.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd670064150 0x7fd670064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd674b2a700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd670178a70 0x7fd670178e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fd670064150 0x7fd670064600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55312/0 (socket says 172.21.15.38:55312) 2023-11-06T13:35:11.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 -- 172.21.15.38:0/2932939934 learned_addr learned my addr 172.21.15.38:0/2932939934 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:11.174 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd67532b700 1 --1- 172.21.15.38:0/2932939934 >> v1:172.21.15.44:6789/0 conn(0x7fd67017e090 0x7fd67017e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:44008/0 (socket says 172.21.15.38:44008) 2023-11-06T13:35:11.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 -- 172.21.15.38:0/2932939934 >> v2:172.21.15.44:3300/0 conn(0x7fd670178a70 msgr2=0x7fd670178e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2932939934 >> v2:172.21.15.44:3300/0 conn(0x7fd670178a70 0x7fd670178e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 -- 172.21.15.38:0/2932939934 >> v1:172.21.15.44:6789/0 conn(0x7fd67017e090 legacy=0x7fd67017e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.175 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 -- 172.21.15.38:0/2932939934 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67017cff0 con 0x7fd670064150 2023-11-06T13:35:11.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2932939934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670064150 0x7fd670064600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fd67006a9f0 tx=0x7fd6640090f0).ready entity=mon.0 client_cookie=a67c49ec39c3da2e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.166+0000 7fd66f7fe700 1 -- 172.21.15.38:0/2932939934 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400b520 con 0x7fd670064150 2023-11-06T13:35:11.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd66f7fe700 1 -- 172.21.15.38:0/2932939934 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66400b680 con 0x7fd670064150 2023-11-06T13:35:11.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd66f7fe700 1 -- 172.21.15.38:0/2932939934 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400ba00 con 0x7fd670064150 2023-11-06T13:35:11.176 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 -- 172.21.15.38:0/2932939934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670064150 msgr2=0x7fd670064600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 --2- 172.21.15.38:0/2932939934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670064150 0x7fd670064600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fd67006a9f0 tx=0x7fd6640090f0).stop 2023-11-06T13:35:11.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 -- 172.21.15.38:0/2932939934 shutdown_connections 2023-11-06T13:35:11.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 --2- 172.21.15.38:0/2932939934 >> v2:172.21.15.44:3300/0 conn(0x7fd670178a70 0x7fd670178e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 --2- 172.21.15.38:0/2932939934 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670064150 0x7fd670064600 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.177 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 -- 172.21.15.38:0/2932939934 >> 172.21.15.38:0/2932939934 conn(0x7fd670069ea0 msgr2=0x7fd67006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:11.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 -- 172.21.15.38:0/2932939934 shutdown_connections 2023-11-06T13:35:11.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.167+0000 7fd676d8e700 1 -- 172.21.15.38:0/2932939934 wait complete. 2023-11-06T13:35:11.178 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.168+0000 7fd676d8e700 1 Processor -- start 2023-11-06T13:35:11.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.169+0000 7fd676d8e700 1 -- start start 2023-11-06T13:35:11.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd676d8e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 0x7fd6701617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd676d8e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 0x7fd670176360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.187 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd676d8e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd67017e090 0x7fd6701903e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd676d8e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670161cb0 con 0x7fd670178a70 2023-11-06T13:35:11.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd676d8e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6701779b0 con 0x7fd670064150 2023-11-06T13:35:11.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd676d8e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670176850 con 0x7fd67017e090 2023-11-06T13:35:11.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 0x7fd670176360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.188 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 0x7fd6701617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 0x7fd6701617c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58642/0 (socket says 172.21.15.38:58642) 2023-11-06T13:35:11.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 0x7fd670176360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55322/0 (socket says 172.21.15.38:55322) 2023-11-06T13:35:11.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 -- 172.21.15.38:0/590810452 learned_addr learned my addr 172.21.15.38:0/590810452 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:11.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd67532b700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd67017e090 0x7fd6701903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.189 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 -- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd67017e090 msgr2=0x7fd6701903e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd67017e090 0x7fd6701903e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 -- 172.21.15.38:0/590810452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 msgr2=0x7fd670176360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 0x7fd670176360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 -- 172.21.15.38:0/590810452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd664009370 con 0x7fd670064150 2023-11-06T13:35:11.190 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd66ffff700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 0x7fd670176360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:35:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd674b2a700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 0x7fd6701617c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd66000e960 tx=0x7fd660009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.170+0000 7fd66cff9700 1 -- 172.21.15.38:0/590810452 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000c6a0 con 0x7fd670064150 2023-11-06T13:35:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.171+0000 7fd66cff9700 1 -- 172.21.15.38:0/590810452 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66000c800 con 0x7fd670064150 2023-11-06T13:35:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.171+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd670176ac0 con 0x7fd670064150 2023-11-06T13:35:11.191 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.171+0000 7fd66cff9700 1 -- 172.21.15.38:0/590810452 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000cb80 con 0x7fd670064150 2023-11-06T13:35:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.171+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd670177080 con 0x7fd670064150 2023-11-06T13:35:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.173+0000 7fd66cff9700 1 -- 172.21.15.38:0/590810452 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fd66001b400 con 0x7fd670064150 2023-11-06T13:35:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.173+0000 7fd66cff9700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd65c08cb40 0x7fd65c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.174+0000 7fd66cff9700 1 -- 172.21.15.38:0/590810452 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd6600b24f0 con 0x7fd670064150 2023-11-06T13:35:11.192 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.174+0000 7fd66ffff700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd65c08cb40 0x7fd65c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.174+0000 7fd66ffff700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd65c08cb40 0x7fd65c08f000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd664009130 tx=0x7fd664017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.175+0000 7fd688726b80 1 Processor -- start 2023-11-06T13:35:11.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.175+0000 7fd688726b80 1 -- start start 2023-11-06T13:35:11.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd688726b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e41538be90 0x55e415612400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.193 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd688726b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 0x55e4155cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd688726b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e41560fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd688726b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415594fd0 con 0x55e4155cf110 2023-11-06T13:35:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd688726b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41550c240 con 0x55e4156128f0 2023-11-06T13:35:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd688726b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415521490 con 0x55e41538be90 2023-11-06T13:35:11.194 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 0x55e4155cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd67532b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e41560fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e41538be90 0x55e415612400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 0x55e4155cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:58644/0 (socket says 172.21.15.38:58644) 2023-11-06T13:35:11.195 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e41538be90 0x55e415612400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:51686/0 (socket says 172.21.15.38:51686) 2023-11-06T13:35:11.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd66ffff700 1 -- 172.21.15.38:0/1304074892 learned_addr learned my addr 172.21.15.38:0/1304074892 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:11.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd67532b700 1 -- 172.21.15.38:0/1304074892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e41538be90 msgr2=0x55e415612400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd67532b700 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e41538be90 0x55e415612400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd67532b700 1 -- 172.21.15.38:0/1304074892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 msgr2=0x55e4155cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.196 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd67532b700 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 0x55e4155cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd67532b700 1 -- 172.21.15.38:0/1304074892 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e41551a670 con 0x55e4155cf110 2023-11-06T13:35:11.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.176+0000 7fd66ffff700 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 0x55e4155cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:35:11.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd67532b700 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e41560fc00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fd668007270 tx=0x7fd668005ca0).ready entity=mon.0 client_cookie=6de34f7f9564f251 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd655ffb700 1 -- 172.21.15.38:0/1304074892 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668004c40 con 0x55e4155cf110 2023-11-06T13:35:11.197 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd655ffb700 1 -- 172.21.15.38:0/1304074892 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668004da0 con 0x55e4155cf110 2023-11-06T13:35:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd655ffb700 1 -- 172.21.15.38:0/1304074892 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668005240 con 0x55e4155cf110 2023-11-06T13:35:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 -- 172.21.15.38:0/1304074892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 msgr2=0x55e41560fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e41560fc00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fd668007270 tx=0x7fd668005ca0).stop 2023-11-06T13:35:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 -- 172.21.15.38:0/1304074892 shutdown_connections 2023-11-06T13:35:11.198 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e41560fc00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e41538be90 0x55e415612400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 --2- 172.21.15.38:0/1304074892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4156128f0 0x55e4155cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 -- 172.21.15.38:0/1304074892 >> 172.21.15.38:0/1304074892 conn(0x55e4154394f0 msgr2=0x55e4155cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 -- 172.21.15.38:0/1304074892 shutdown_connections 2023-11-06T13:35:11.199 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.177+0000 7fd688726b80 1 -- 172.21.15.38:0/1304074892 wait complete. 2023-11-06T13:35:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.178+0000 7fd688726b80 1 -- start start 2023-11-06T13:35:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.178+0000 7fd688726b80 1 Processor -- start 2023-11-06T13:35:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.179+0000 7fd688726b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 0x55e4156064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.179+0000 7fd688726b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4155cf110 0x55e41564e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.200 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.179+0000 7fd688726b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e4155fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.179+0000 7fd688726b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4155215d0 con 0x55e41538be90 2023-11-06T13:35:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.179+0000 7fd688726b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415521850 con 0x55e4155cf110 2023-11-06T13:35:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.179+0000 7fd688726b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4154ece60 con 0x55e4156128f0 2023-11-06T13:35:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd688726b80 10 client.0 ll_register_callbacks cb 0x55e41558f3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:35:11.201 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 0x55e4156064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 0x55e4156064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55338/0 (socket says 172.21.15.38:55338) 2023-11-06T13:35:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 -- 172.21.15.38:0/2915506809 learned_addr learned my addr 172.21.15.38:0/2915506809 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:11.202 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4155cf110 0x55e41564e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd67532b700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e4155fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 -- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 msgr2=0x55e4155fe8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e4155fe8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.203 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 -- 172.21.15.38:0/2915506809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4155cf110 msgr2=0x55e41564e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4155cf110 0x55e41564e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 -- 172.21.15.38:0/2915506809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67017cff0 con 0x55e41538be90 2023-11-06T13:35:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd674b2a700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 0x55e4156064f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fd6600aff20 tx=0x7fd6600095c0).ready entity=mon.0 client_cookie=ff3c4cdda2c7aa1e server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.204 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd64effd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:35:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd64effd700 1 -- 172.21.15.38:0/2915506809 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600b2270 con 0x55e41538be90 2023-11-06T13:35:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd64effd700 1 -- 172.21.15.38:0/2915506809 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd660085c30 con 0x55e41538be90 2023-11-06T13:35:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4155c3690 con 0x55e41538be90 2023-11-06T13:35:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd64effd700 1 -- 172.21.15.38:0/2915506809 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd66008bb90 con 0x55e41538be90 2023-11-06T13:35:11.205 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd688726b80 10 client.5469 fetch_fsmap learned FSMap version 31 2023-11-06T13:35:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.180+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x7fd66800f040 con 0x55e41538be90 2023-11-06T13:35:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd64effd700 1 -- 172.21.15.38:0/2915506809 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66009a070 con 0x55e41538be90 2023-11-06T13:35:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd64effd700 1 -- 172.21.15.38:0/2915506809 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 31) v1 ==== 7500+0+0 (secure 0 0 0) 0x7fd660082530 con 0x55e41538be90 2023-11-06T13:35:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd688726b80 10 client.5469 fetch_fsmap finished waiting for FSMap version 31 2023-11-06T13:35:11.206 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd688726b80 10 client.5469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:35:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd688726b80 20 client.5469 populate_metadata read hostname 'smithi038' 2023-11-06T13:35:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd688726b80 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e41564dcf0 0x55e4155d65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd688726b80 4 client.5469 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:35:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e415387cf0 con 0x55e41564dcf0 2023-11-06T13:35:11.207 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e41564dcf0 0x55e4155d65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd64effd700 10 client.5469 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.181+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e41564dcf0 0x55e4155d65e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ef5279a9621caf1e server_cookie=f1a3cc342adb6d07 in_seq=0 out_seq=0 2023-11-06T13:35:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.182+0000 7fd64effd700 1 -- 172.21.15.38:0/2915506809 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55e415387cf0 con 0x55e41564dcf0 2023-11-06T13:35:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.182+0000 7fd64effd700 10 client.5469 handle_command_reply: tid=0 2023-11-06T13:35:11.208 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.182+0000 7fd688726b80 1 client.5469 shutdown 2023-11-06T13:35:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.182+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 msgr2=0x55e4156064f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 0x55e4156064f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fd6600aff20 tx=0x7fd6600095c0).stop 2023-11-06T13:35:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 shutdown_connections 2023-11-06T13:35:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e41564dcf0 0x55e4155d65e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.209 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e4155fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e41538be90 0x55e4156064f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 --2- 172.21.15.38:0/2915506809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e4155cf110 0x55e41564e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd64effd700 0 client.5469 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:11.210 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 >> 172.21.15.38:0/2915506809 conn(0x55e4154394f0 msgr2=0x55e41563f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:11.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 shutdown_connections 2023-11-06T13:35:11.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 1 -- 172.21.15.38:0/2915506809 wait complete. 2023-11-06T13:35:11.211 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.183+0000 7fd688726b80 20 client.5469 trim_cache size 0 max 16384 2023-11-06T13:35:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.199+0000 7fd688726b80 1 Processor -- start 2023-11-06T13:35:11.217 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.199+0000 7fd688726b80 1 -- start start 2023-11-06T13:35:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd688726b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd688726b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415699990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd688726b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e41563f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd688726b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415695430 con 0x55e4155cf110 2023-11-06T13:35:11.218 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd688726b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415611f30 con 0x55e41538be90 2023-11-06T13:35:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd688726b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415605690 con 0x55e4156128f0 2023-11-06T13:35:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415699990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415699990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55340/0 (socket says 172.21.15.38:55340) 2023-11-06T13:35:11.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 -- 172.21.15.38:0/2572220900 learned_addr learned my addr 172.21.15.38:0/2572220900 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd67532b700 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e41563f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 -- 172.21.15.38:0/2572220900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 msgr2=0x55e41563f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e41563f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 -- 172.21.15.38:0/2572220900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 msgr2=0x55e4155cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 -- 172.21.15.38:0/2572220900 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e415515a10 con 0x55e4155cf110 2023-11-06T13:35:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd674b2a700 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:35:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd66ffff700 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415699990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fd664006ec0 tx=0x7fd664003040).ready entity=mon.0 client_cookie=268ef241cb4a3648 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd6567fc700 1 -- 172.21.15.38:0/2572220900 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66402e040 con 0x55e4155cf110 2023-11-06T13:35:11.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd6567fc700 1 -- 172.21.15.38:0/2572220900 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664011d00 con 0x55e4155cf110 2023-11-06T13:35:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.200+0000 7fd6567fc700 1 -- 172.21.15.38:0/2572220900 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664011e70 con 0x55e4155cf110 2023-11-06T13:35:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 -- 172.21.15.38:0/2572220900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 msgr2=0x55e415699990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415699990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fd664006ec0 tx=0x7fd664003040).stop 2023-11-06T13:35:11.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 -- 172.21.15.38:0/2572220900 shutdown_connections 2023-11-06T13:35:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e41563f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 --2- 172.21.15.38:0/2572220900 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415699990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 -- 172.21.15.38:0/2572220900 >> 172.21.15.38:0/2572220900 conn(0x55e4154394f0 msgr2=0x55e4155cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:11.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 -- 172.21.15.38:0/2572220900 shutdown_connections 2023-11-06T13:35:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.201+0000 7fd688726b80 1 -- 172.21.15.38:0/2572220900 wait complete. 2023-11-06T13:35:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.202+0000 7fd688726b80 1 -- start start 2023-11-06T13:35:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.202+0000 7fd688726b80 1 Processor -- start 2023-11-06T13:35:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415613220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e415635380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4156a8040 con 0x55e4155cf110 2023-11-06T13:35:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415634ef0 con 0x55e41538be90 2023-11-06T13:35:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e415613710 con 0x55e4156128f0 2023-11-06T13:35:11.225 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd688726b80 10 client.0 ll_register_callbacks cb 0x55e41558f3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:35:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415613220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415613220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55346/0 (socket says 172.21.15.38:55346) 2023-11-06T13:35:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd674b2a700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 -- 172.21.15.38:0/3365576133 learned_addr learned my addr 172.21.15.38:0/3365576133 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:11.226 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd67532b700 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e415635380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 -- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 msgr2=0x55e415635380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e415635380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 -- 172.21.15.38:0/3365576133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 msgr2=0x55e4155d6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155d6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.227 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.203+0000 7fd66ffff700 1 -- 172.21.15.38:0/3365576133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66800f040 con 0x55e4155cf110 2023-11-06T13:35:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd66ffff700 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415613220 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd66402b040 tx=0x7fd664030000).ready entity=mon.0 client_cookie=95fa3a88e64b6bfc server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd64effd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:35:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd64effd700 1 -- 172.21.15.38:0/3365576133 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66402e040 con 0x55e4155cf110 2023-11-06T13:35:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd668004da0 con 0x55e4155cf110 2023-11-06T13:35:11.228 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd64effd700 1 -- 172.21.15.38:0/3365576133 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fd664033cd0 con 0x55e4155cf110 2023-11-06T13:35:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd64effd700 1 -- 172.21.15.38:0/3365576133 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd664033e90 con 0x55e4155cf110 2023-11-06T13:35:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 10 client.5475 fetch_fsmap learned FSMap version 31 2023-11-06T13:35:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x7fd6640117c0 con 0x55e4155cf110 2023-11-06T13:35:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd64effd700 1 -- 172.21.15.38:0/3365576133 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664046020 con 0x55e4155cf110 2023-11-06T13:35:11.229 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd64effd700 1 -- 172.21.15.38:0/3365576133 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 31) v1 ==== 7500+0+0 (secure 0 0 0) 0x7fd664031020 con 0x55e4155cf110 2023-11-06T13:35:11.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 10 client.5475 fetch_fsmap finished waiting for FSMap version 31 2023-11-06T13:35:11.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 10 client.5475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:35:11.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 20 client.5475 populate_metadata read hostname 'smithi038' 2023-11-06T13:35:11.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e4155cdca0 0x55e4155ff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:11.230 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 4 client.5475 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:35:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4153becf0 con 0x55e4155cdca0 2023-11-06T13:35:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.204+0000 7fd674b2a700 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e4155cdca0 0x55e4155ff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd674b2a700 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e4155cdca0 0x55e4155ff4d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e263df208c0fdb40 server_cookie=24bed664c6e00f8a in_seq=0 out_seq=0 2023-11-06T13:35:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd64effd700 10 client.5475 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:11.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd64effd700 1 -- 172.21.15.38:0/3365576133 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e4153becf0 con 0x55e4155cdca0 2023-11-06T13:35:11.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd64effd700 10 client.5475 handle_command_reply: tid=0 2023-11-06T13:35:11.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 client.5475 shutdown 2023-11-06T13:35:11.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 msgr2=0x55e415613220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415613220 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fd66402b040 tx=0x7fd664030000).stop 2023-11-06T13:35:11.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 shutdown_connections 2023-11-06T13:35:11.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e4155cdca0 0x55e4155ff4d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e4156128f0 0x55e415635380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd64effd700 0 client.5475 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:11.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e41538be90 0x55e4155d6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 --2- 172.21.15.38:0/3365576133 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e4155cf110 0x55e415613220 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 >> 172.21.15.38:0/3365576133 conn(0x55e4154394f0 msgr2=0x55e4155fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 shutdown_connections 2023-11-06T13:35:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.205+0000 7fd688726b80 1 -- 172.21.15.38:0/3365576133 wait complete. 2023-11-06T13:35:11.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd688726b80 20 client.5475 trim_cache size 0 max 16384 2023-11-06T13:35:11.235 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:35:11.235 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:35:11.235 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:35:11.236 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:35:11.236 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:35:11.236 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:35:11.236 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:35:11.236 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:35:11.237 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:35:11.237 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:35:11.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd65c08cb40 msgr2=0x7fd65c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd65c08cb40 0x7fd65c08f000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd664009130 tx=0x7fd664017000).stop 2023-11-06T13:35:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 msgr2=0x7fd6701617c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 0x7fd6701617c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fd66000e960 tx=0x7fd660009060).stop 2023-11-06T13:35:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 shutdown_connections 2023-11-06T13:35:11.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd67017e090 0x7fd6701903e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fd65c08cb40 0x7fd65c08f000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd670064150 0x7fd6701617c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 --2- 172.21.15.38:0/590810452 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fd670178a70 0x7fd670176360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:11.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 >> 172.21.15.38:0/590810452 conn(0x7fd670069ea0 msgr2=0x7fd6700cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:11.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 shutdown_connections 2023-11-06T13:35:11.241 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:11.206+0000 7fd676d8e700 1 -- 172.21.15.38:0/590810452 wait complete. 2023-11-06T13:35:11.241 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:35:41.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:35:41.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.374+0000 7f634aff0700 1 Processor -- start 2023-11-06T13:35:41.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.374+0000 7f634aff0700 1 -- start start 2023-11-06T13:35:41.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634aff0700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6344178a70 0x7f6344178e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634aff0700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f634417e7a0 0x7f6344064600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634aff0700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634417dc00 con 0x7f6344064150 2023-11-06T13:35:41.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634aff0700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6344064af0 con 0x7f6344178a70 2023-11-06T13:35:41.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634aff0700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634417cd10 con 0x7f634417e7a0 2023-11-06T13:35:41.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634958d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f634417e7a0 0x7f6344064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f6343fff700 1 --1- >> v1:172.21.15.163:6789/0 conn(0x7f6344064150 0x7f634417e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:44646/0 (socket says 172.21.15.38:44646) 2023-11-06T13:35:41.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634958d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f634417e7a0 0x7f6344064600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:45238/0 (socket says 172.21.15.38:45238) 2023-11-06T13:35:41.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f6343fff700 1 -- 172.21.15.38:0/1943756976 learned_addr learned my addr 172.21.15.38:0/1943756976 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:35:41.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f6348d8c700 1 --2- 172.21.15.38:0/1943756976 >> v2:172.21.15.44:3300/0 conn(0x7f6344178a70 0x7f6344178e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634958d700 1 -- 172.21.15.38:0/1943756976 >> v2:172.21.15.44:3300/0 conn(0x7f6344178a70 msgr2=0x7f6344178e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.375+0000 7f634958d700 1 --2- 172.21.15.38:0/1943756976 >> v2:172.21.15.44:3300/0 conn(0x7f6344178a70 0x7f6344178e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634958d700 1 -- 172.21.15.38:0/1943756976 >> v1:172.21.15.163:6789/0 conn(0x7f6344064150 legacy=0x7f634417e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634958d700 1 -- 172.21.15.38:0/1943756976 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634417cff0 con 0x7f634417e7a0 2023-11-06T13:35:41.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634958d700 1 --2- 172.21.15.38:0/1943756976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f634417e7a0 0x7f6344064600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f634406ab80 tx=0x7f632c009060).ready entity=mon.2 client_cookie=dfd1c8500c288ed8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f63437fe700 1 -- 172.21.15.38:0/1943756976 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00f510 con 0x7f634417e7a0 2023-11-06T13:35:41.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f63437fe700 1 -- 172.21.15.38:0/1943756976 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00f670 con 0x7f634417e7a0 2023-11-06T13:35:41.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f63437fe700 1 -- 172.21.15.38:0/1943756976 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00f9f0 con 0x7f634417e7a0 2023-11-06T13:35:41.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 -- 172.21.15.38:0/1943756976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f634417e7a0 msgr2=0x7f6344064600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 --2- 172.21.15.38:0/1943756976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f634417e7a0 0x7f6344064600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f634406ab80 tx=0x7f632c009060).stop 2023-11-06T13:35:41.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 -- 172.21.15.38:0/1943756976 shutdown_connections 2023-11-06T13:35:41.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 --2- 172.21.15.38:0/1943756976 >> v2:172.21.15.44:3300/0 conn(0x7f6344178a70 0x7f6344178e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 --2- 172.21.15.38:0/1943756976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f634417e7a0 0x7f6344064600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 -- 172.21.15.38:0/1943756976 >> 172.21.15.38:0/1943756976 conn(0x7f6344069ea0 msgr2=0x7f634406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:41.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 -- 172.21.15.38:0/1943756976 shutdown_connections 2023-11-06T13:35:41.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.376+0000 7f634aff0700 1 -- 172.21.15.38:0/1943756976 wait complete. 2023-11-06T13:35:41.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.378+0000 7f634aff0700 1 Processor -- start 2023-11-06T13:35:41.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.378+0000 7f634aff0700 1 -- start start 2023-11-06T13:35:41.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634aff0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 0x7f6344160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634aff0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6344178a70 0x7f6344180010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634aff0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f634417e7a0 0x7f63441916a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634aff0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344191210 con 0x7f634417e7a0 2023-11-06T13:35:41.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634aff0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344190320 con 0x7f6344064150 2023-11-06T13:35:41.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634aff0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344190600 con 0x7f6344178a70 2023-11-06T13:35:41.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f634417e7a0 0x7f63441916a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f6343fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6344178a70 0x7f6344180010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 0x7f6344160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f6343fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6344178a70 0x7f6344180010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:45248/0 (socket says 172.21.15.38:45248) 2023-11-06T13:35:41.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 0x7f6344160410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:57196/0 (socket says 172.21.15.38:57196) 2023-11-06T13:35:41.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f6343fff700 1 -- 172.21.15.38:0/1030156407 learned_addr learned my addr 172.21.15.38:0/1030156407 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:41.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.379+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f634417e7a0 0x7f63441916a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57978/0 (socket says 172.21.15.38:57978) 2023-11-06T13:35:41.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6348d8c700 1 -- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6344178a70 msgr2=0x7f6344180010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6348d8c700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6344178a70 0x7f6344180010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6348d8c700 1 -- 172.21.15.38:0/1030156407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f634417e7a0 msgr2=0x7f63441916a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6348d8c700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f634417e7a0 0x7f63441916a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6348d8c700 1 -- 172.21.15.38:0/1030156407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0092a0 con 0x7f6344064150 2023-11-06T13:35:41.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6348d8c700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 0x7f6344160410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f633c009ed0 tx=0x7f633c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6340ff9700 1 -- 172.21.15.38:0/1030156407 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00cb70 con 0x7f6344064150 2023-11-06T13:35:41.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6340ff9700 1 -- 172.21.15.38:0/1030156407 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f6344064150 2023-11-06T13:35:41.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63441908e0 con 0x7f6344064150 2023-11-06T13:35:41.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f6340ff9700 1 -- 172.21.15.38:0/1030156407 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c013400 con 0x7f6344064150 2023-11-06T13:35:41.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.380+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344190ea0 con 0x7f6344064150 2023-11-06T13:35:41.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.383+0000 7f6340ff9700 1 -- 172.21.15.38:0/1030156407 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f633c013770 con 0x7f6344064150 2023-11-06T13:35:41.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.383+0000 7f6340ff9700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f632408cb40 0x7f632408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.383+0000 7f6340ff9700 1 -- 172.21.15.38:0/1030156407 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f633c0b2810 con 0x7f6344064150 2023-11-06T13:35:41.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.383+0000 7f6343fff700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f632408cb40 0x7f632408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.384+0000 7f6343fff700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f632408cb40 0x7f632408f000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f634417fdf0 tx=0x7f6334007df0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.384+0000 7f635c988b80 1 Processor -- start 2023-11-06T13:35:41.395 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 -- start start 2023-11-06T13:35:41.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbe5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cbe58f0 0x55f44cba1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 0x55f44cbe2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cb67fd0 con 0x55f44cba2110 2023-11-06T13:35:41.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cadf240 con 0x55f44c95ee90 2023-11-06T13:35:41.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.385+0000 7f635c988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44caf4490 con 0x55f44cbe58f0 2023-11-06T13:35:41.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbe5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 0x55f44cbe2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6343fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cbe58f0 0x55f44cba1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbe5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:57212/0 (socket says 172.21.15.38:57212) 2023-11-06T13:35:41.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 0x55f44cbe2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57980/0 (socket says 172.21.15.38:57980) 2023-11-06T13:35:41.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6343fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cbe58f0 0x55f44cba1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:45260/0 (socket says 172.21.15.38:45260) 2023-11-06T13:35:41.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6348d8c700 1 -- 172.21.15.38:0/1754061922 learned_addr learned my addr 172.21.15.38:0/1754061922 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:41.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 -- 172.21.15.38:0/1754061922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cbe58f0 msgr2=0x55f44cba1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cbe58f0 0x55f44cba1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 -- 172.21.15.38:0/1754061922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 msgr2=0x55f44cbe5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbe5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 -- 172.21.15.38:0/1754061922 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f44caed670 con 0x55f44cba2110 2023-11-06T13:35:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6348d8c700 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbe5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:35:41.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f634958d700 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 0x55f44cbe2c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f6344088e30 tx=0x7f632c017000).ready entity=mon.0 client_cookie=edb8a83a357a567 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6339ffb700 1 -- 172.21.15.38:0/1754061922 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00f7e0 con 0x55f44cba2110 2023-11-06T13:35:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6339ffb700 1 -- 172.21.15.38:0/1754061922 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00f960 con 0x55f44cba2110 2023-11-06T13:35:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.386+0000 7f6339ffb700 1 -- 172.21.15.38:0/1754061922 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c01b620 con 0x55f44cba2110 2023-11-06T13:35:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 -- 172.21.15.38:0/1754061922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 msgr2=0x55f44cbe2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 0x55f44cbe2c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f6344088e30 tx=0x7f632c017000).stop 2023-11-06T13:35:41.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 -- 172.21.15.38:0/1754061922 shutdown_connections 2023-11-06T13:35:41.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cba2110 0x55f44cbe2c00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbe5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.407 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 --2- 172.21.15.38:0/1754061922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cbe58f0 0x55f44cba1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 -- 172.21.15.38:0/1754061922 >> 172.21.15.38:0/1754061922 conn(0x55f44ca0c4f0 msgr2=0x55f44cba2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 -- 172.21.15.38:0/1754061922 shutdown_connections 2023-11-06T13:35:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.387+0000 7f635c988b80 1 -- 172.21.15.38:0/1754061922 wait complete. 2023-11-06T13:35:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.388+0000 7f635c988b80 1 -- start start 2023-11-06T13:35:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.388+0000 7f635c988b80 1 Processor -- start 2023-11-06T13:35:41.408 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbd15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc21e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cbe2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44caf45d0 con 0x55f44cbe58f0 2023-11-06T13:35:41.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44caf4850 con 0x55f44c95ee90 2023-11-06T13:35:41.409 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cabfe60 con 0x55f44cba2110 2023-11-06T13:35:41.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f635c988b80 10 client.0 ll_register_callbacks cb 0x55f44cb623d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:35:41.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cbe2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbd15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cbe2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:57990/0 (socket says 172.21.15.38:57990) 2023-11-06T13:35:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 -- 172.21.15.38:0/3030508955 learned_addr learned my addr 172.21.15.38:0/3030508955 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f6343fff700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc21e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 -- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 msgr2=0x55f44cc21e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc21e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 -- 172.21.15.38:0/3030508955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 msgr2=0x55f44cbd15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbd15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 -- 172.21.15.38:0/3030508955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344190ea0 con 0x55f44cbe58f0 2023-11-06T13:35:41.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f6348d8c700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbd15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:35:41.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f634958d700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cbe2ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f634406a9c0 tx=0x7f632c01e040).ready entity=mon.0 client_cookie=41d1711a336c49a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.389+0000 7f6322ffd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:35:41.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f6322ffd700 1 -- 172.21.15.38:0/3030508955 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c02a070 con 0x55f44cbe58f0 2023-11-06T13:35:41.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f6322ffd700 1 -- 172.21.15.38:0/3030508955 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f632c01b990 con 0x55f44cbe58f0 2023-11-06T13:35:41.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f44cb96690 con 0x55f44cbe58f0 2023-11-06T13:35:41.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f6322ffd700 1 -- 172.21.15.38:0/3030508955 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f632c01bdb0 con 0x55f44cbe58f0 2023-11-06T13:35:41.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 10 client.5484 fetch_fsmap learned FSMap version 34 2023-11-06T13:35:41.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x7f634417cff0 con 0x55f44cbe58f0 2023-11-06T13:35:41.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f6322ffd700 1 -- 172.21.15.38:0/3030508955 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f44cb96690 con 0x55f44cbe58f0 2023-11-06T13:35:41.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f6322ffd700 1 -- 172.21.15.38:0/3030508955 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) v1 ==== 7520+0+0 (secure 0 0 0) 0x7f632c009760 con 0x55f44cbe58f0 2023-11-06T13:35:41.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 10 client.5484 fetch_fsmap finished waiting for FSMap version 34 2023-11-06T13:35:41.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 10 client.5484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:35:41.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 20 client.5484 populate_metadata read hostname 'smithi038' 2023-11-06T13:35:41.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbe36c0 0x55f44cc22360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 4 client.5484 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:35:41.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f44c95acf0 con 0x55f44cbe36c0 2023-11-06T13:35:41.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.390+0000 7f6348d8c700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbe36c0 0x55f44cc22360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.391+0000 7f6322ffd700 10 client.5484 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:41.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.391+0000 7f6348d8c700 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbe36c0 0x55f44cc22360 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9dbebea1b4b26e2e server_cookie=cc2249448d6a9d2e in_seq=0 out_seq=0 2023-11-06T13:35:41.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f6322ffd700 1 -- 172.21.15.38:0/3030508955 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55f44c95acf0 con 0x55f44cbe36c0 2023-11-06T13:35:41.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f6322ffd700 10 client.5484 handle_command_reply: tid=0 2023-11-06T13:35:41.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 client.5484 shutdown 2023-11-06T13:35:41.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 msgr2=0x55f44cbe2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cbe2ce0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f634406a9c0 tx=0x7f632c01e040).stop 2023-11-06T13:35:41.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 shutdown_connections 2023-11-06T13:35:41.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cbe2ce0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44c95ee90 0x55f44cbd15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbe36c0 0x55f44cc22360 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 --2- 172.21.15.38:0/3030508955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc21e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.418 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f6322ffd700 0 client.5484 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:41.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 >> 172.21.15.38:0/3030508955 conn(0x55f44ca0c4f0 msgr2=0x55f44cba9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:41.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 shutdown_connections 2023-11-06T13:35:41.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 1 -- 172.21.15.38:0/3030508955 wait complete. 2023-11-06T13:35:41.419 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.392+0000 7f635c988b80 20 client.5484 trim_cache size 0 max 16384 2023-11-06T13:35:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.408+0000 7f635c988b80 1 Processor -- start 2023-11-06T13:35:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.408+0000 7f635c988b80 1 -- start start 2023-11-06T13:35:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f635c988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44c95ee90 0x55f44cbe5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f635c988b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cba2110 0x55f44cbdea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f635c988b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cc10e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f635c988b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cbe3d70 con 0x55f44cbe58f0 2023-11-06T13:35:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f635c988b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cc22510 con 0x55f44cba2110 2023-11-06T13:35:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f635c988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cba8fb0 con 0x55f44c95ee90 2023-11-06T13:35:41.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cc10e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cc10e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58006/0 (socket says 172.21.15.38:58006) 2023-11-06T13:35:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 -- 172.21.15.38:0/1721541507 learned_addr learned my addr 172.21.15.38:0/1721541507 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f6343fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cba2110 0x55f44cbdea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f6348d8c700 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44c95ee90 0x55f44cbe5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 -- 172.21.15.38:0/1721541507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44c95ee90 msgr2=0x55f44cbe5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44c95ee90 0x55f44cbe5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 -- 172.21.15.38:0/1721541507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cba2110 msgr2=0x55f44cbdea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cba2110 0x55f44cbdea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f634958d700 1 -- 172.21.15.38:0/1721541507 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f44cb962b0 con 0x55f44cbe58f0 2023-11-06T13:35:41.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.409+0000 7f6343fff700 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cba2110 0x55f44cbdea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:35:41.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f634958d700 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cc10e50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f632c00f810 tx=0x7f632c02a000).ready entity=mon.0 client_cookie=6d82b39b89b23606 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f633a7fc700 1 -- 172.21.15.38:0/1721541507 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c01bdb0 con 0x55f44cbe58f0 2023-11-06T13:35:41.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f633a7fc700 1 -- 172.21.15.38:0/1721541507 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c01b990 con 0x55f44cbe58f0 2023-11-06T13:35:41.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f633a7fc700 1 -- 172.21.15.38:0/1721541507 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c009760 con 0x55f44cbe58f0 2023-11-06T13:35:41.429 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 -- 172.21.15.38:0/1721541507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 msgr2=0x55f44cc10e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cc10e50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f632c00f810 tx=0x7f632c02a000).stop 2023-11-06T13:35:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 -- 172.21.15.38:0/1721541507 shutdown_connections 2023-11-06T13:35:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44cbe58f0 0x55f44cc10e50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44c95ee90 0x55f44cbe5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.430 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 --2- 172.21.15.38:0/1721541507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cba2110 0x55f44cbdea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 -- 172.21.15.38:0/1721541507 >> 172.21.15.38:0/1721541507 conn(0x55f44ca0c4f0 msgr2=0x55f44cbe51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 -- 172.21.15.38:0/1721541507 shutdown_connections 2023-11-06T13:35:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.410+0000 7f635c988b80 1 -- 172.21.15.38:0/1721541507 wait complete. 2023-11-06T13:35:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.411+0000 7f635c988b80 1 -- start start 2023-11-06T13:35:41.431 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.411+0000 7f635c988b80 1 Processor -- start 2023-11-06T13:35:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 0x55f44cbde250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc76750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cbe58f0 0x55f44cbd07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cc76060 con 0x55f44c95ee90 2023-11-06T13:35:41.432 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cc76300 con 0x55f44cbe58f0 2023-11-06T13:35:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f44cc7a4b0 con 0x55f44cba2110 2023-11-06T13:35:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f635c988b80 10 client.0 ll_register_callbacks cb 0x55f44cb623d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:35:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 0x55f44cbde250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f6348d8c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 0x55f44cbde250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58012/0 (socket says 172.21.15.38:58012) 2023-11-06T13:35:41.433 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f6348d8c700 1 -- 172.21.15.38:0/4110998756 learned_addr learned my addr 172.21.15.38:0/4110998756 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:35:41.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f634958d700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cbe58f0 0x55f44cbd07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.412+0000 7f6343fff700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc76750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6348d8c700 1 -- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 msgr2=0x55f44cc76750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.434 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6348d8c700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc76750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6348d8c700 1 -- 172.21.15.38:0/4110998756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cbe58f0 msgr2=0x55f44cbd07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:35:41.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6348d8c700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cbe58f0 0x55f44cbd07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6348d8c700 1 -- 172.21.15.38:0/4110998756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634417cff0 con 0x55f44c95ee90 2023-11-06T13:35:41.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6348d8c700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 0x55f44cbde250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f633c00c680 tx=0x7f633c055040).ready entity=mon.0 client_cookie=76ab5412f98dc876 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:35:41.435 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6322ffd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:35:41.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6322ffd700 1 -- 172.21.15.38:0/4110998756 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c084e00 con 0x55f44c95ee90 2023-11-06T13:35:41.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6322ffd700 1 -- 172.21.15.38:0/4110998756 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f633c083170 con 0x55f44c95ee90 2023-11-06T13:35:41.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f632c00f960 con 0x55f44c95ee90 2023-11-06T13:35:41.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6322ffd700 1 -- 172.21.15.38:0/4110998756 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f633c086160 con 0x55f44c95ee90 2023-11-06T13:35:41.436 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 10 client.5490 fetch_fsmap learned FSMap version 34 2023-11-06T13:35:41.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55f44cae8a10 con 0x55f44c95ee90 2023-11-06T13:35:41.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6322ffd700 1 -- 172.21.15.38:0/4110998756 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00f960 con 0x55f44c95ee90 2023-11-06T13:35:41.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f6322ffd700 1 -- 172.21.15.38:0/4110998756 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 34) v1 ==== 7520+0+0 (secure 0 0 0) 0x7f633c08beb0 con 0x55f44c95ee90 2023-11-06T13:35:41.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 10 client.5490 fetch_fsmap finished waiting for FSMap version 34 2023-11-06T13:35:41.437 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 10 client.5490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:35:41.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 20 client.5490 populate_metadata read hostname 'smithi038' 2023-11-06T13:35:41.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbdd850 0x55f44cbddc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:35:41.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 4 client.5490 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:35:41.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.413+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f44c991cf0 con 0x55f44cbdd850 2023-11-06T13:35:41.438 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f6343fff700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbdd850 0x55f44cbddc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:35:41.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f6322ffd700 10 client.5490 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:41.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f6343fff700 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbdd850 0x55f44cbddc60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e90b3b689ca966e3 server_cookie=e016a4ebdcf3e691 in_seq=0 out_seq=0 2023-11-06T13:35:41.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f6322ffd700 1 -- 172.21.15.38:0/4110998756 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f44c991cf0 con 0x55f44cbdd850 2023-11-06T13:35:41.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f6322ffd700 10 client.5490 handle_command_reply: tid=0 2023-11-06T13:35:41.439 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 client.5490 shutdown 2023-11-06T13:35:41.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 msgr2=0x55f44cbde250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 0x55f44cbde250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f633c00c680 tx=0x7f633c055040).stop 2023-11-06T13:35:41.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 shutdown_connections 2023-11-06T13:35:41.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f44cbe58f0 0x55f44cbd07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.440 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f44c95ee90 0x55f44cbde250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f44cbdd850 0x55f44cbddc60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 --2- 172.21.15.38:0/4110998756 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f44cba2110 0x55f44cc76750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 >> 172.21.15.38:0/4110998756 conn(0x55f44ca0c4f0 msgr2=0x55f44cbe1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:41.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.414+0000 7f6322ffd700 0 client.5490 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:35:41.441 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 shutdown_connections 2023-11-06T13:35:41.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f635c988b80 1 -- 172.21.15.38:0/4110998756 wait complete. 2023-11-06T13:35:41.442 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f635c988b80 20 client.5490 trim_cache size 0 max 16384 2023-11-06T13:35:41.442 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:35:41.443 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:35:41.443 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:35:41.443 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:35:41.443 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:35:41.443 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:35:41.444 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:35:41.444 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:35:41.444 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:35:41.444 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:35:41.445 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f632408cb40 msgr2=0x7f632408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f632408cb40 0x7f632408f000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f634417fdf0 tx=0x7f6334007df0).stop 2023-11-06T13:35:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 msgr2=0x7f6344160410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:35:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 0x7f6344160410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f633c009ed0 tx=0x7f633c00b040).stop 2023-11-06T13:35:41.446 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 shutdown_connections 2023-11-06T13:35:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f634417e7a0 0x7f63441916a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f632408cb40 0x7f632408f000 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6344064150 0x7f6344160410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 --2- 172.21.15.38:0/1030156407 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6344178a70 0x7f6344180010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:35:41.447 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 >> 172.21.15.38:0/1030156407 conn(0x7f6344069ea0 msgr2=0x7f6344164240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:35:41.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 shutdown_connections 2023-11-06T13:35:41.448 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:35:41.415+0000 7f634aff0700 1 -- 172.21.15.38:0/1030156407 wait complete. 2023-11-06T13:35:41.448 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:36:11.449 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:36:11.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.576+0000 7f89d209b700 1 Processor -- start 2023-11-06T13:36:11.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.576+0000 7f89d209b700 1 -- start start 2023-11-06T13:36:11.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.577+0000 7f89d209b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f89cc182d70 0x7f89cc17c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.577+0000 7f89d209b700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc17e040 con 0x7f89cc175540 2023-11-06T13:36:11.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.577+0000 7f89d209b700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc17d150 con 0x7f89cc175920 2023-11-06T13:36:11.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.577+0000 7f89d209b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc17d430 con 0x7f89cc182d70 2023-11-06T13:36:11.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cb7fe700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f89cc175540 0x7f89cc0cb980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:49008/0 (socket says 172.21.15.38:49008) 2023-11-06T13:36:11.587 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cb7fe700 1 -- 172.21.15.38:0/120875761 learned_addr learned my addr 172.21.15.38:0/120875761 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:36:11.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cbfff700 1 --2- 172.21.15.38:0/120875761 >> v2:172.21.15.38:3300/0 conn(0x7f89cc182d70 0x7f89cc17c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89ca7fc700 1 -- 172.21.15.38:0/120875761 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105002375 0 0) 0x7f89cc17e040 con 0x7f89cc175540 2023-11-06T13:36:11.588 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89ca7fc700 1 -- 172.21.15.38:0/120875761 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b40033f0 con 0x7f89cc175540 2023-11-06T13:36:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cbfff700 1 -- 172.21.15.38:0/120875761 >> v1:172.21.15.163:6789/0 conn(0x7f89cc175920 legacy=0x7f89cc17e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cbfff700 1 -- 172.21.15.38:0/120875761 >> v1:172.21.15.38:6789/0 conn(0x7f89cc175540 legacy=0x7f89cc0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cbfff700 1 -- 172.21.15.38:0/120875761 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc17d710 con 0x7f89cc182d70 2023-11-06T13:36:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89cbfff700 1 --2- 172.21.15.38:0/120875761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc182d70 0x7f89cc17c810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f89c4009e60 tx=0x7f89c4009780).ready entity=mon.0 client_cookie=ae568dab2f863472 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89ca7fc700 1 -- 172.21.15.38:0/120875761 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400e070 con 0x7f89cc182d70 2023-11-06T13:36:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89ca7fc700 1 -- 172.21.15.38:0/120875761 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400bb60 con 0x7f89cc182d70 2023-11-06T13:36:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.578+0000 7f89ca7fc700 1 -- 172.21.15.38:0/120875761 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c4012410 con 0x7f89cc182d70 2023-11-06T13:36:11.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 -- 172.21.15.38:0/120875761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc182d70 msgr2=0x7f89cc17c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 --2- 172.21.15.38:0/120875761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc182d70 0x7f89cc17c810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f89c4009e60 tx=0x7f89c4009780).stop 2023-11-06T13:36:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 -- 172.21.15.38:0/120875761 shutdown_connections 2023-11-06T13:36:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 --2- 172.21.15.38:0/120875761 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc182d70 0x7f89cc17c810 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 -- 172.21.15.38:0/120875761 >> 172.21.15.38:0/120875761 conn(0x7f89cc0f53b0 msgr2=0x7f89cc0f57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 -- 172.21.15.38:0/120875761 shutdown_connections 2023-11-06T13:36:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.579+0000 7f89d209b700 1 -- 172.21.15.38:0/120875761 wait complete. 2023-11-06T13:36:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.580+0000 7f89d209b700 1 Processor -- start 2023-11-06T13:36:11.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 -- start start 2023-11-06T13:36:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 0x7f89cc1901b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89cc175920 0x7f89cc16e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89cc182d70 0x7f89cc0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc1768f0 con 0x7f89cc175540 2023-11-06T13:36:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c8510 con 0x7f89cc182d70 2023-11-06T13:36:11.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.581+0000 7f89d209b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c7920 con 0x7f89cc175920 2023-11-06T13:36:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 0x7f89cc1901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 0x7f89cc1901b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38856/0 (socket says 172.21.15.38:38856) 2023-11-06T13:36:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 -- 172.21.15.38:0/3822352565 learned_addr learned my addr 172.21.15.38:0/3822352565 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cbfff700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89cc182d70 0x7f89cc0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89caffd700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89cc175920 0x7f89cc16e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 -- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89cc175920 msgr2=0x7f89cc16e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89cc175920 0x7f89cc16e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 -- 172.21.15.38:0/3822352565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89cc182d70 msgr2=0x7f89cc0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89cc182d70 0x7f89cc0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 -- 172.21.15.38:0/3822352565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c4009a20 con 0x7f89cc175540 2023-11-06T13:36:11.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 0x7f89cc1901b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f89bc00c590 tx=0x7f89bc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89b37fe700 1 -- 172.21.15.38:0/3822352565 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00ce80 con 0x7f89cc175540 2023-11-06T13:36:11.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89b37fe700 1 -- 172.21.15.38:0/3822352565 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc0072e0 con 0x7f89cc175540 2023-11-06T13:36:11.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc178c70 con 0x7f89cc175540 2023-11-06T13:36:11.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89b37fe700 1 -- 172.21.15.38:0/3822352565 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc007660 con 0x7f89cc175540 2023-11-06T13:36:11.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.582+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc0c7ec0 con 0x7f89cc175540 2023-11-06T13:36:11.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.585+0000 7f89b37fe700 1 -- 172.21.15.38:0/3822352565 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f89bc0059b0 con 0x7f89cc175540 2023-11-06T13:36:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.585+0000 7f89b37fe700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f89b808cb40 0x7f89b808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.585+0000 7f89b37fe700 1 -- 172.21.15.38:0/3822352565 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f89bc0b1390 con 0x7f89cc175540 2023-11-06T13:36:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.585+0000 7f89caffd700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f89b808cb40 0x7f89b808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.586+0000 7f89caffd700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f89b808cb40 0x7f89b808f000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f89cc192210 tx=0x7f89c0000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.587+0000 7f89e3a33b80 1 Processor -- start 2023-11-06T13:36:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.587+0000 7f89e3a33b80 1 -- start start 2023-11-06T13:36:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02aeb0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae6cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeadc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ae32fd0 con 0x55c02ae6d110 2023-11-06T13:36:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02adaa240 con 0x55c02aeb08f0 2023-11-06T13:36:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02adbf490 con 0x55c02ac29e90 2023-11-06T13:36:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02aeb0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeadc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89caffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae6cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02aeb0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:60472/0 (socket says 172.21.15.38:60472) 2023-11-06T13:36:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cb7fe700 1 -- 172.21.15.38:0/3482598362 learned_addr learned my addr 172.21.15.38:0/3482598362 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89caffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae6cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:40990/0 (socket says 172.21.15.38:40990) 2023-11-06T13:36:11.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 -- 172.21.15.38:0/3482598362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 msgr2=0x55c02aeb0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02aeb0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 -- 172.21.15.38:0/3482598362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 msgr2=0x55c02ae6cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae6cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 -- 172.21.15.38:0/3482598362 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02adb8670 con 0x55c02ae6d110 2023-11-06T13:36:11.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.588+0000 7f89cbfff700 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeadc00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f89c4014000 tx=0x7f89cc17dfb0).ready entity=mon.0 client_cookie=23495af0bcc1580 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89b0ff9700 1 -- 172.21.15.38:0/3482598362 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400bcd0 con 0x55c02ae6d110 2023-11-06T13:36:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89b0ff9700 1 -- 172.21.15.38:0/3482598362 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400be30 con 0x55c02ae6d110 2023-11-06T13:36:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89b0ff9700 1 -- 172.21.15.38:0/3482598362 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40129b0 con 0x55c02ae6d110 2023-11-06T13:36:11.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 -- 172.21.15.38:0/3482598362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 msgr2=0x55c02aeadc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeadc00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f89c4014000 tx=0x7f89cc17dfb0).stop 2023-11-06T13:36:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 -- 172.21.15.38:0/3482598362 shutdown_connections 2023-11-06T13:36:11.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeadc00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02aeb0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/3482598362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae6cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 -- 172.21.15.38:0/3482598362 >> 172.21.15.38:0/3482598362 conn(0x55c02acd74f0 msgr2=0x55c02ae6dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:11.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 -- 172.21.15.38:0/3482598362 shutdown_connections 2023-11-06T13:36:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.589+0000 7f89e3a33b80 1 -- 172.21.15.38:0/3482598362 wait complete. 2023-11-06T13:36:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.590+0000 7f89e3a33b80 1 -- start start 2023-11-06T13:36:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.590+0000 7f89e3a33b80 1 Processor -- start 2023-11-06T13:36:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 0x55c02ae6bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ae6d110 0x55c02aeebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae9f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02adbf5d0 con 0x55c02ac29e90 2023-11-06T13:36:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02adbf850 con 0x55c02aeb08f0 2023-11-06T13:36:11.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ad8ae60 con 0x55c02ae6d110 2023-11-06T13:36:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89e3a33b80 10 client.0 ll_register_callbacks cb 0x55c02ae2d3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:36:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 0x55c02ae6bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 0x55c02ae6bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38880/0 (socket says 172.21.15.38:38880) 2023-11-06T13:36:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89cb7fe700 1 -- 172.21.15.38:0/1849569755 learned_addr learned my addr 172.21.15.38:0/1849569755 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:11.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89caffd700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ae6d110 0x55c02aeebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.591+0000 7f89cbfff700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae9f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89cb7fe700 1 -- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ae6d110 msgr2=0x55c02aeebfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ae6d110 0x55c02aeebfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89cb7fe700 1 -- 172.21.15.38:0/1849569755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 msgr2=0x55c02ae9f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae9f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89cb7fe700 1 -- 172.21.15.38:0/1849569755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc17d710 con 0x55c02ac29e90 2023-11-06T13:36:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 0x55c02ae6bc50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f89bc085360 tx=0x7f89bc088040).ready entity=mon.0 client_cookie=39d6a5d50ee8ad32 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.625 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:36:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89a9ffb700 1 -- 172.21.15.38:0/1849569755 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc005e70 con 0x55c02ac29e90 2023-11-06T13:36:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89a9ffb700 1 -- 172.21.15.38:0/1849569755 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f89bc08c030 con 0x55c02ac29e90 2023-11-06T13:36:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c02ae61690 con 0x55c02ac29e90 2023-11-06T13:36:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89a9ffb700 1 -- 172.21.15.38:0/1849569755 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89bc084d60 con 0x55c02ac29e90 2023-11-06T13:36:11.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89e3a33b80 10 client.5505 fetch_fsmap learned FSMap version 36 2023-11-06T13:36:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55c02adb3a10 con 0x55c02ac29e90 2023-11-06T13:36:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89a9ffb700 1 -- 172.21.15.38:0/1849569755 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c02ae61690 con 0x55c02ac29e90 2023-11-06T13:36:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89a9ffb700 1 -- 172.21.15.38:0/1849569755 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 36) v1 ==== 7532+0+0 (secure 0 0 0) 0x7f89bc08aab0 con 0x55c02ac29e90 2023-11-06T13:36:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.592+0000 7f89e3a33b80 10 client.5505 fetch_fsmap finished waiting for FSMap version 36 2023-11-06T13:36:11.627 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89e3a33b80 10 client.5505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:36:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89e3a33b80 20 client.5505 populate_metadata read hostname 'smithi038' 2023-11-06T13:36:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae691e0 0x55c02aeaf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89e3a33b80 4 client.5505 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:36:11.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c02ac25cf0 con 0x55c02ae691e0 2023-11-06T13:36:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89caffd700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae691e0 0x55c02aeaf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89a9ffb700 10 client.5505 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.593+0000 7f89caffd700 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae691e0 0x55c02aeaf360 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=366bf763face6a07 server_cookie=9b9d46f476c80b57 in_seq=0 out_seq=0 2023-11-06T13:36:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89a9ffb700 1 -- 172.21.15.38:0/1849569755 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55c02ac25cf0 con 0x55c02ae691e0 2023-11-06T13:36:11.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89a9ffb700 10 client.5505 handle_command_reply: tid=0 2023-11-06T13:36:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 client.5505 shutdown 2023-11-06T13:36:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 msgr2=0x55c02ae6bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 0x55c02ae6bc50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f89bc085360 tx=0x7f89bc088040).stop 2023-11-06T13:36:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 shutdown_connections 2023-11-06T13:36:11.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02ae9f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ac29e90 0x55c02ae6bc50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae691e0 0x55c02aeaf360 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1849569755 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ae6d110 0x55c02aeebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89a9ffb700 0 client.5505 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:11.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 >> 172.21.15.38:0/1849569755 conn(0x55c02acd74f0 msgr2=0x55c02aedd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 shutdown_connections 2023-11-06T13:36:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.594+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1849569755 wait complete. 2023-11-06T13:36:11.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.595+0000 7f89e3a33b80 20 client.5505 trim_cache size 0 max 16384 2023-11-06T13:36:11.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.610+0000 7f89e3a33b80 1 Processor -- start 2023-11-06T13:36:11.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.610+0000 7f89e3a33b80 1 -- start start 2023-11-06T13:36:11.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.611+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02ae64d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.611+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeaf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.611+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02aedd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.639 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.611+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02ae9fd10 con 0x55c02ae6d110 2023-11-06T13:36:11.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.611+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02aeb0600 con 0x55c02aeb08f0 2023-11-06T13:36:11.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.611+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02af389d0 con 0x55c02ac29e90 2023-11-06T13:36:11.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeaf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeaf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38894/0 (socket says 172.21.15.38:38894) 2023-11-06T13:36:11.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 -- 172.21.15.38:0/1650137945 learned_addr learned my addr 172.21.15.38:0/1650137945 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:11.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89cbfff700 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02aedd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02ae64d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 -- 172.21.15.38:0/1650137945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 msgr2=0x55c02ae64d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02ae64d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 -- 172.21.15.38:0/1650137945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 msgr2=0x55c02aedd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02aedd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 -- 172.21.15.38:0/1650137945 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02ae612b0 con 0x55c02ae6d110 2023-11-06T13:36:11.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89caffd700 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeaf510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f89cc175d00 tx=0x7f89c000a000).ready entity=mon.0 client_cookie=994dd115a27f1b28 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89b17fa700 1 -- 172.21.15.38:0/1650137945 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c001c070 con 0x55c02ae6d110 2023-11-06T13:36:11.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89b17fa700 1 -- 172.21.15.38:0/1650137945 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c001d040 con 0x55c02ae6d110 2023-11-06T13:36:11.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.612+0000 7f89b17fa700 1 -- 172.21.15.38:0/1650137945 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0003040 con 0x55c02ae6d110 2023-11-06T13:36:11.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1650137945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 msgr2=0x55c02aeaf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeaf510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f89cc175d00 tx=0x7f89c000a000).stop 2023-11-06T13:36:11.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1650137945 shutdown_connections 2023-11-06T13:36:11.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02aeb08f0 0x55c02aedd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02ac29e90 0x55c02ae64d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/1650137945 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aeaf510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1650137945 >> 172.21.15.38:0/1650137945 conn(0x55c02acd74f0 msgr2=0x55c02aede3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:11.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1650137945 shutdown_connections 2023-11-06T13:36:11.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 -- 172.21.15.38:0/1650137945 wait complete. 2023-11-06T13:36:11.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 -- start start 2023-11-06T13:36:11.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.613+0000 7f89e3a33b80 1 Processor -- start 2023-11-06T13:36:11.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.614+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02ac29e90 0x55c02af37af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.614+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aedd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.614+0000 7f89e3a33b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02aeb08f0 0x55c02aed37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.614+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02af38590 con 0x55c02ae6d110 2023-11-06T13:36:11.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.614+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02aedc790 con 0x55c02ac29e90 2023-11-06T13:36:11.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.614+0000 7f89e3a33b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02aee63d0 con 0x55c02aeb08f0 2023-11-06T13:36:11.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89e3a33b80 10 client.0 ll_register_callbacks cb 0x7f89bc085700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:36:11.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aedd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aedd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38908/0 (socket says 172.21.15.38:38908) 2023-11-06T13:36:11.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89cb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02ac29e90 0x55c02af37af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 -- 172.21.15.38:0/2714194249 learned_addr learned my addr 172.21.15.38:0/2714194249 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:11.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89cbfff700 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02aeb08f0 0x55c02aed37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 -- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02aeb08f0 msgr2=0x55c02aed37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02aeb08f0 0x55c02aed37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 -- 172.21.15.38:0/2714194249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02ac29e90 msgr2=0x55c02af37af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:11.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02ac29e90 0x55c02af37af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 -- 172.21.15.38:0/2714194249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc17d150 con 0x55c02ae6d110 2023-11-06T13:36:11.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89caffd700 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aedd1f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f89c001f000 tx=0x7f89c0022000).ready entity=mon.0 client_cookie=5b054e55069f8788 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:11.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:36:11.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89a9ffb700 1 -- 172.21.15.38:0/2714194249 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c001c070 con 0x55c02ae6d110 2023-11-06T13:36:11.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f89c400be30 con 0x55c02ae6d110 2023-11-06T13:36:11.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89a9ffb700 1 -- 172.21.15.38:0/2714194249 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f89c0014670 con 0x55c02ae6d110 2023-11-06T13:36:11.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89a9ffb700 1 -- 172.21.15.38:0/2714194249 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89c00267d0 con 0x55c02ae6d110 2023-11-06T13:36:11.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89e3a33b80 10 client.5511 fetch_fsmap learned FSMap version 36 2023-11-06T13:36:11.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55c02adb3760 con 0x55c02ae6d110 2023-11-06T13:36:11.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.615+0000 7f89a9ffb700 1 -- 172.21.15.38:0/2714194249 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400be30 con 0x55c02ae6d110 2023-11-06T13:36:11.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89a9ffb700 1 -- 172.21.15.38:0/2714194249 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 36) v1 ==== 7532+0+0 (secure 0 0 0) 0x7f89c0026930 con 0x55c02ae6d110 2023-11-06T13:36:11.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 10 client.5511 fetch_fsmap finished waiting for FSMap version 36 2023-11-06T13:36:11.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 10 client.5511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:36:11.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 20 client.5511 populate_metadata read hostname 'smithi038' 2023-11-06T13:36:11.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae6bb40 0x55c02ae64d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:11.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 4 client.5511 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:36:11.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c02ac5ccf0 con 0x55c02ae6bb40 2023-11-06T13:36:11.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae6bb40 0x55c02ae64d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:11.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89a9ffb700 10 client.5511 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:11.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89cb7fe700 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae6bb40 0x55c02ae64d80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=410bcb45d66e9be8 server_cookie=4dd0a71043d1e4e in_seq=0 out_seq=0 2023-11-06T13:36:11.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89a9ffb700 1 -- 172.21.15.38:0/2714194249 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c02ac5ccf0 con 0x55c02ae6bb40 2023-11-06T13:36:11.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89a9ffb700 10 client.5511 handle_command_reply: tid=0 2023-11-06T13:36:11.653 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.616+0000 7f89e3a33b80 1 client.5511 shutdown 2023-11-06T13:36:11.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 msgr2=0x55c02aedd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aedd1f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f89c001f000 tx=0x7f89c0022000).stop 2023-11-06T13:36:11.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 shutdown_connections 2023-11-06T13:36:11.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c02ae6bb40 0x55c02ae64d80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c02aeb08f0 0x55c02aed37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c02ac29e90 0x55c02af37af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89a9ffb700 0 client.5511 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:11.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 --2- 172.21.15.38:0/2714194249 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c02ae6d110 0x55c02aedd1f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 >> 172.21.15.38:0/2714194249 conn(0x55c02acd74f0 msgr2=0x55c02aeb0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:11.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 shutdown_connections 2023-11-06T13:36:11.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 1 -- 172.21.15.38:0/2714194249 wait complete. 2023-11-06T13:36:11.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89e3a33b80 20 client.5511 trim_cache size 0 max 16384 2023-11-06T13:36:11.656 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:36:11.657 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:36:11.657 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:36:11.657 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:36:11.657 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:36:11.657 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:36:11.658 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:36:11.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:36:11.658 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:36:11.658 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:36:11.661 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f89b808cb40 msgr2=0x7f89b808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f89b808cb40 0x7f89b808f000 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f89cc192210 tx=0x7f89c0000bc0).stop 2023-11-06T13:36:11.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 msgr2=0x7f89cc1901b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:11.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 0x7f89cc1901b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f89bc00c590 tx=0x7f89bc007c80).stop 2023-11-06T13:36:11.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 shutdown_connections 2023-11-06T13:36:11.662 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f89b808cb40 0x7f89b808f000 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89cc182d70 0x7f89cc0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f89cc175540 0x7f89cc1901b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 --2- 172.21.15.38:0/3822352565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f89cc175920 0x7f89cc16e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:11.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 >> 172.21.15.38:0/3822352565 conn(0x7f89cc0f53b0 msgr2=0x7f89cc0c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:11.663 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 shutdown_connections 2023-11-06T13:36:11.664 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:11.617+0000 7f89d209b700 1 -- 172.21.15.38:0/3822352565 wait complete. 2023-11-06T13:36:11.664 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:36:41.666 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:36:41.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.810+0000 7fc40a535700 1 Processor -- start 2023-11-06T13:36:41.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.810+0000 7fc40a535700 1 -- start start 2023-11-06T13:36:41.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc40a535700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc404178a70 0x7fc404178e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc40a535700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fc404064150 0x7fc404064600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc40a535700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40417dc00 con 0x7fc40417e090 2023-11-06T13:36:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc40a535700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc404064af0 con 0x7fc404178a70 2023-11-06T13:36:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc40a535700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40417cd10 con 0x7fc404064150 2023-11-06T13:36:41.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc404178a70 0x7fc404178e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc404178a70 0x7fc404178e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42886/0 (socket says 172.21.15.38:42886) 2023-11-06T13:36:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 -- 172.21.15.38:0/2260601850 learned_addr learned my addr 172.21.15.38:0/2260601850 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc4037fe700 1 --2- 172.21.15.38:0/2260601850 >> v2:172.21.15.163:3300/0 conn(0x7fc404064150 0x7fc404064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 -- 172.21.15.38:0/2260601850 >> v2:172.21.15.163:3300/0 conn(0x7fc404064150 msgr2=0x7fc404064600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 --2- 172.21.15.38:0/2260601850 >> v2:172.21.15.163:3300/0 conn(0x7fc404064150 0x7fc404064600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 -- 172.21.15.38:0/2260601850 >> v1:172.21.15.163:6789/0 conn(0x7fc40417e090 legacy=0x7fc40417e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 -- 172.21.15.38:0/2260601850 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40417cff0 con 0x7fc404178a70 2023-11-06T13:36:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.811+0000 7fc403fff700 1 --2- 172.21.15.38:0/2260601850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc404178a70 0x7fc404178e50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fc404088e30 tx=0x7fc3f40090f0).ready entity=mon.0 client_cookie=4f73430f72a3a913 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc402ffd700 1 -- 172.21.15.38:0/2260601850 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400b600 con 0x7fc404178a70 2023-11-06T13:36:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc402ffd700 1 -- 172.21.15.38:0/2260601850 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400b760 con 0x7fc404178a70 2023-11-06T13:36:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc402ffd700 1 -- 172.21.15.38:0/2260601850 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400bae0 con 0x7fc404178a70 2023-11-06T13:36:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 -- 172.21.15.38:0/2260601850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc404178a70 msgr2=0x7fc404178e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 --2- 172.21.15.38:0/2260601850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc404178a70 0x7fc404178e50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fc404088e30 tx=0x7fc3f40090f0).stop 2023-11-06T13:36:41.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 -- 172.21.15.38:0/2260601850 shutdown_connections 2023-11-06T13:36:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 --2- 172.21.15.38:0/2260601850 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc404178a70 0x7fc404178e50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 --2- 172.21.15.38:0/2260601850 >> v2:172.21.15.163:3300/0 conn(0x7fc404064150 0x7fc404064600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 -- 172.21.15.38:0/2260601850 >> 172.21.15.38:0/2260601850 conn(0x7fc404069ea0 msgr2=0x7fc40406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 -- 172.21.15.38:0/2260601850 shutdown_connections 2023-11-06T13:36:41.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.812+0000 7fc40a535700 1 -- 172.21.15.38:0/2260601850 wait complete. 2023-11-06T13:36:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.814+0000 7fc40a535700 1 Processor -- start 2023-11-06T13:36:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.814+0000 7fc40a535700 1 -- start start 2023-11-06T13:36:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc40a535700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc404064150 0x7fc4040c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc40a535700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc404178a70 0x7fc40417ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc40a535700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 0x7fc4040f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc40a535700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040f4900 con 0x7fc40417e090 2023-11-06T13:36:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc40a535700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040f3a10 con 0x7fc404064150 2023-11-06T13:36:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc40a535700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040f3cf0 con 0x7fc404178a70 2023-11-06T13:36:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 0x7fc4040f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 0x7fc4040f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42902/0 (socket says 172.21.15.38:42902) 2023-11-06T13:36:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 -- 172.21.15.38:0/4202887951 learned_addr learned my addr 172.21.15.38:0/4202887951 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc403fff700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc404064150 0x7fc4040c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc4037fe700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc404178a70 0x7fc40417ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 -- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc404178a70 msgr2=0x7fc40417ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc404178a70 0x7fc40417ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 -- 172.21.15.38:0/4202887951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc404064150 msgr2=0x7fc4040c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc404064150 0x7fc4040c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 -- 172.21.15.38:0/4202887951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4009370 con 0x7fc40417e090 2023-11-06T13:36:41.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc4037fe700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc404178a70 0x7fc40417ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:36:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc408ad2700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 0x7fc4040f4d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fc3fc00c7c0 tx=0x7fc3fc001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.815+0000 7fc3ebfff700 1 -- 172.21.15.38:0/4202887951 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00e4a0 con 0x7fc40417e090 2023-11-06T13:36:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.816+0000 7fc3ebfff700 1 -- 172.21.15.38:0/4202887951 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc00e600 con 0x7fc40417e090 2023-11-06T13:36:41.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.816+0000 7fc3ebfff700 1 -- 172.21.15.38:0/4202887951 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00e9a0 con 0x7fc40417e090 2023-11-06T13:36:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.816+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4040f3fd0 con 0x7fc40417e090 2023-11-06T13:36:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.816+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4040f4590 con 0x7fc40417e090 2023-11-06T13:36:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.817+0000 7fc3ebfff700 1 -- 172.21.15.38:0/4202887951 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fc3fc01b3b0 con 0x7fc40417e090 2023-11-06T13:36:41.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.818+0000 7fc3ebfff700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc3f008cb40 0x7fc3f008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.818+0000 7fc3ebfff700 1 -- 172.21.15.38:0/4202887951 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc3fc0b1520 con 0x7fc40417e090 2023-11-06T13:36:41.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.818+0000 7fc403fff700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc3f008cb40 0x7fc3f008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.819+0000 7fc403fff700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc3f008cb40 0x7fc3f008f000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc3f4009130 tx=0x7fc3f4017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.820+0000 7fc41becdb80 1 Processor -- start 2023-11-06T13:36:41.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.820+0000 7fc41becdb80 1 -- start start 2023-11-06T13:36:41.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb6ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb66ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb6abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc41becdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb630fd0 con 0x5588bb6ae8f0 2023-11-06T13:36:41.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc41becdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb5a8240 con 0x5588bb427e90 2023-11-06T13:36:41.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc41becdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb5bd490 con 0x5588bb66b110 2023-11-06T13:36:41.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb66ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb66ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42908/0 (socket says 172.21.15.38:42908) 2023-11-06T13:36:41.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb6ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc4037fe700 1 -- 172.21.15.38:0/3172931088 learned_addr learned my addr 172.21.15.38:0/3172931088 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:41.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc408ad2700 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb6abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 -- 172.21.15.38:0/3172931088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 msgr2=0x5588bb6abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb6abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 -- 172.21.15.38:0/3172931088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 msgr2=0x5588bb66ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb66ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 -- 172.21.15.38:0/3172931088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588bb5b6670 con 0x5588bb427e90 2023-11-06T13:36:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc408ad2700 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb6abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:36:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.821+0000 7fc403fff700 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb6ae400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fc40406ab80 tx=0x7fc3f401f040).ready entity=mon.1 client_cookie=57bb5c94bc8a62a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc3e97fa700 1 -- 172.21.15.38:0/3172931088 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400ba50 con 0x5588bb427e90 2023-11-06T13:36:41.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc3e97fa700 1 -- 172.21.15.38:0/3172931088 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f401d810 con 0x5588bb427e90 2023-11-06T13:36:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc3e97fa700 1 -- 172.21.15.38:0/3172931088 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f401dbb0 con 0x5588bb427e90 2023-11-06T13:36:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 -- 172.21.15.38:0/3172931088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 msgr2=0x5588bb6ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb6ae400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fc40406ab80 tx=0x7fc3f401f040).stop 2023-11-06T13:36:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 -- 172.21.15.38:0/3172931088 shutdown_connections 2023-11-06T13:36:41.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb6abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb6ae400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 --2- 172.21.15.38:0/3172931088 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb66ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 -- 172.21.15.38:0/3172931088 >> 172.21.15.38:0/3172931088 conn(0x5588bb4d54f0 msgr2=0x5588bb66bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:41.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 -- 172.21.15.38:0/3172931088 shutdown_connections 2023-11-06T13:36:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.822+0000 7fc41becdb80 1 -- 172.21.15.38:0/3172931088 wait complete. 2023-11-06T13:36:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.823+0000 7fc41becdb80 1 -- start start 2023-11-06T13:36:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.823+0000 7fc41becdb80 1 Processor -- start 2023-11-06T13:36:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb669430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb669c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb5bd5d0 con 0x5588bb6ae8f0 2023-11-06T13:36:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb5bd850 con 0x5588bb427e90 2023-11-06T13:36:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb588e60 con 0x5588bb66b110 2023-11-06T13:36:41.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc41becdb80 10 client.0 ll_register_callbacks cb 0x5588bb62b3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:36:41.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc403fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb669430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc408ad2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc403fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb669430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:36586/0 (socket says 172.21.15.38:36586) 2023-11-06T13:36:41.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc403fff700 1 -- 172.21.15.38:0/2409217766 learned_addr learned my addr 172.21.15.38:0/2409217766 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:41.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.824+0000 7fc4037fe700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb669c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc408ad2700 1 -- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 msgr2=0x5588bb669c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc408ad2700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb669c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc408ad2700 1 -- 172.21.15.38:0/2409217766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 msgr2=0x5588bb669430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc408ad2700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb669430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc408ad2700 1 -- 172.21.15.38:0/2409217766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40417cff0 con 0x5588bb6ae8f0 2023-11-06T13:36:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc403fff700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb669430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:36:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc408ad2700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69c190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc3fc00c790 tx=0x7fc3fc01e040).ready entity=mon.0 client_cookie=3290914698220ac server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc3e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:36:41.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc3e27fc700 1 -- 172.21.15.38:0/2409217766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0b13c0 con 0x5588bb6ae8f0 2023-11-06T13:36:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc3e27fc700 1 -- 172.21.15.38:0/2409217766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc3fc083b90 con 0x5588bb6ae8f0 2023-11-06T13:36:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588bb65f690 con 0x5588bb6ae8f0 2023-11-06T13:36:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc3e27fc700 1 -- 172.21.15.38:0/2409217766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3fc085330 con 0x5588bb6ae8f0 2023-11-06T13:36:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc41becdb80 10 client.5523 fetch_fsmap learned FSMap version 36 2023-11-06T13:36:41.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5588bb5b1a10 con 0x5588bb6ae8f0 2023-11-06T13:36:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.825+0000 7fc3e27fc700 1 -- 172.21.15.38:0/2409217766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc097020 con 0x5588bb6ae8f0 2023-11-06T13:36:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc3e27fc700 1 -- 172.21.15.38:0/2409217766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 36) v1 ==== 7532+0+0 (secure 0 0 0) 0x7fc3fc08ac40 con 0x5588bb6ae8f0 2023-11-06T13:36:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc41becdb80 10 client.5523 fetch_fsmap finished waiting for FSMap version 36 2023-11-06T13:36:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc41becdb80 10 client.5523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:36:41.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc41becdb80 20 client.5523 populate_metadata read hostname 'smithi038' 2023-11-06T13:36:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc41becdb80 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6ea2a0 0x5588bb6da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc41becdb80 4 client.5523 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:36:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588bb423cf0 con 0x5588bb6ea2a0 2023-11-06T13:36:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.826+0000 7fc403fff700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6ea2a0 0x5588bb6da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.827+0000 7fc3e27fc700 10 client.5523 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.827+0000 7fc403fff700 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6ea2a0 0x5588bb6da0a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6ac90b11bec8dd56 server_cookie=23074145567fd42c in_seq=0 out_seq=0 2023-11-06T13:36:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.828+0000 7fc3e27fc700 1 -- 172.21.15.38:0/2409217766 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5588bb423cf0 con 0x5588bb6ea2a0 2023-11-06T13:36:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.828+0000 7fc3e27fc700 10 client.5523 handle_command_reply: tid=0 2023-11-06T13:36:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.828+0000 7fc41becdb80 1 client.5523 shutdown 2023-11-06T13:36:41.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 msgr2=0x5588bb69c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69c190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fc3fc00c790 tx=0x7fc3fc01e040).stop 2023-11-06T13:36:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 shutdown_connections 2023-11-06T13:36:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69c190 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb427e90 0x5588bb669430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6ea2a0 0x5588bb6da0a0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 --2- 172.21.15.38:0/2409217766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb669c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc3e27fc700 0 client.5523 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:41.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 >> 172.21.15.38:0/2409217766 conn(0x5588bb4d54f0 msgr2=0x5588bb6ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:41.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 shutdown_connections 2023-11-06T13:36:41.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 1 -- 172.21.15.38:0/2409217766 wait complete. 2023-11-06T13:36:41.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.829+0000 7fc41becdb80 20 client.5523 trim_cache size 0 max 16384 2023-11-06T13:36:41.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.845+0000 7fc41becdb80 1 Processor -- start 2023-11-06T13:36:41.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.845+0000 7fc41becdb80 1 -- start start 2023-11-06T13:36:41.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb427e90 0x5588bb667910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb66b110 0x5588bb6dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc41becdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb6af880 con 0x5588bb6ae8f0 2023-11-06T13:36:41.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc41becdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb6afa30 con 0x5588bb66b110 2023-11-06T13:36:41.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc41becdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb69eff0 con 0x5588bb427e90 2023-11-06T13:36:41.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42920/0 (socket says 172.21.15.38:42920) 2023-11-06T13:36:41.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb66b110 0x5588bb6dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 -- 172.21.15.38:0/4257060635 learned_addr learned my addr 172.21.15.38:0/4257060635 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:41.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc403fff700 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb427e90 0x5588bb667910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 -- 172.21.15.38:0/4257060635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb427e90 msgr2=0x5588bb667910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb427e90 0x5588bb667910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 -- 172.21.15.38:0/4257060635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb66b110 msgr2=0x5588bb6dcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb66b110 0x5588bb6dcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 -- 172.21.15.38:0/4257060635 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588bb65f2b0 con 0x5588bb6ae8f0 2023-11-06T13:36:41.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc403fff700 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb427e90 0x5588bb667910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:36:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc4037fe700 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb66b110 0x5588bb6dcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:36:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.846+0000 7fc408ad2700 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69f480 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc3fc0854f0 tx=0x7fc3fc08d000).ready entity=mon.0 client_cookie=9ef6b24eb0906670 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc3e9ffb700 1 -- 172.21.15.38:0/4257060635 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc085330 con 0x5588bb6ae8f0 2023-11-06T13:36:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc3e9ffb700 1 -- 172.21.15.38:0/4257060635 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc097070 con 0x5588bb6ae8f0 2023-11-06T13:36:41.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc3e9ffb700 1 -- 172.21.15.38:0/4257060635 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0b1370 con 0x5588bb6ae8f0 2023-11-06T13:36:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 -- 172.21.15.38:0/4257060635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 msgr2=0x5588bb69f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69f480 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fc3fc0854f0 tx=0x7fc3fc08d000).stop 2023-11-06T13:36:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 -- 172.21.15.38:0/4257060635 shutdown_connections 2023-11-06T13:36:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb6ae8f0 0x5588bb69f480 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb427e90 0x5588bb667910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 --2- 172.21.15.38:0/4257060635 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb66b110 0x5588bb6dcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 -- 172.21.15.38:0/4257060635 >> 172.21.15.38:0/4257060635 conn(0x5588bb4d54f0 msgr2=0x5588bb6ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 -- 172.21.15.38:0/4257060635 shutdown_connections 2023-11-06T13:36:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.847+0000 7fc41becdb80 1 -- 172.21.15.38:0/4257060635 wait complete. 2023-11-06T13:36:41.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.848+0000 7fc41becdb80 1 -- start start 2023-11-06T13:36:41.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.848+0000 7fc41becdb80 1 Processor -- start 2023-11-06T13:36:41.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 0x5588bb6abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb671cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb6ae8f0 0x5588bb6725d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb6a6bc0 con 0x5588bb427e90 2023-11-06T13:36:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb7436d0 con 0x5588bb6ae8f0 2023-11-06T13:36:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bb740290 con 0x5588bb66b110 2023-11-06T13:36:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc41becdb80 10 client.0 ll_register_callbacks cb 0x5588bb62b3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:36:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 0x5588bb6abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 0x5588bb6abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:42932/0 (socket says 172.21.15.38:42932) 2023-11-06T13:36:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 -- 172.21.15.38:0/958103656 learned_addr learned my addr 172.21.15.38:0/958103656 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:36:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc408ad2700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb6ae8f0 0x5588bb6725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc4037fe700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb671cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 -- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 msgr2=0x5588bb671cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb671cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 -- 172.21.15.38:0/958103656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb6ae8f0 msgr2=0x5588bb6725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:36:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb6ae8f0 0x5588bb6725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc403fff700 1 -- 172.21.15.38:0/958103656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f800e040 con 0x5588bb427e90 2023-11-06T13:36:41.874 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.849+0000 7fc4037fe700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb671cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:36:41.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc403fff700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 0x5588bb6abc00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc3f4011000 tx=0x7fc3f4039280).ready entity=mon.0 client_cookie=6a5961fafafb78e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:36:41.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc3e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:36:41.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc3e27fc700 1 -- 172.21.15.38:0/958103656 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4039070 con 0x5588bb427e90 2023-11-06T13:36:41.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3f401d810 con 0x5588bb427e90 2023-11-06T13:36:41.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc3e27fc700 1 -- 172.21.15.38:0/958103656 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc3f4028620 con 0x5588bb427e90 2023-11-06T13:36:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc3e27fc700 1 -- 172.21.15.38:0/958103656 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3f40289f0 con 0x5588bb427e90 2023-11-06T13:36:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 10 client.5529 fetch_fsmap learned FSMap version 36 2023-11-06T13:36:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5588bb5b1a10 con 0x5588bb427e90 2023-11-06T13:36:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc3e27fc700 1 -- 172.21.15.38:0/958103656 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f401d810 con 0x5588bb427e90 2023-11-06T13:36:41.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc3e27fc700 1 -- 172.21.15.38:0/958103656 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 36) v1 ==== 7532+0+0 (secure 0 0 0) 0x7fc3f4028b50 con 0x5588bb427e90 2023-11-06T13:36:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 10 client.5529 fetch_fsmap finished waiting for FSMap version 36 2023-11-06T13:36:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 10 client.5529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:36:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 20 client.5529 populate_metadata read hostname 'smithi038' 2023-11-06T13:36:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6dd400 0x5588bb740740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:36:41.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 4 client.5529 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:36:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.850+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5588bb45acf0 con 0x5588bb6dd400 2023-11-06T13:36:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.851+0000 7fc4037fe700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6dd400 0x5588bb740740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:36:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.851+0000 7fc3e27fc700 10 client.5529 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.851+0000 7fc4037fe700 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6dd400 0x5588bb740740 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=435499f3c13d668c server_cookie=548310f47f916176 in_seq=0 out_seq=0 2023-11-06T13:36:41.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc3e27fc700 1 -- 172.21.15.38:0/958103656 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5588bb45acf0 con 0x5588bb6dd400 2023-11-06T13:36:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc3e27fc700 10 client.5529 handle_command_reply: tid=0 2023-11-06T13:36:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 client.5529 shutdown 2023-11-06T13:36:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 msgr2=0x5588bb6abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 0x5588bb6abc00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc3f4011000 tx=0x7fc3f4039280).stop 2023-11-06T13:36:41.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 shutdown_connections 2023-11-06T13:36:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5588bb6ae8f0 0x5588bb6725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5588bb427e90 0x5588bb6abc00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5588bb6dd400 0x5588bb740740 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 --2- 172.21.15.38:0/958103656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5588bb66b110 0x5588bb671cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc3e27fc700 0 client.5529 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:36:41.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 >> 172.21.15.38:0/958103656 conn(0x5588bb4d54f0 msgr2=0x5588bb6d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:41.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 shutdown_connections 2023-11-06T13:36:41.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 1 -- 172.21.15.38:0/958103656 wait complete. 2023-11-06T13:36:41.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc41becdb80 20 client.5529 trim_cache size 0 max 16384 2023-11-06T13:36:41.882 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:36:41.882 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:36:41.882 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:36:41.882 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:36:41.883 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:36:41.883 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:36:41.883 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:36:41.883 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:36:41.883 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:36:41.884 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:36:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc3f008cb40 msgr2=0x7fc3f008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc3f008cb40 0x7fc3f008f000 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fc3f4009130 tx=0x7fc3f4017000).stop 2023-11-06T13:36:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 msgr2=0x7fc4040f4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:36:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 0x7fc4040f4d90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fc3fc00c7c0 tx=0x7fc3fc001510).stop 2023-11-06T13:36:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 shutdown_connections 2023-11-06T13:36:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc40417e090 0x7fc4040f4d90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc3f008cb40 0x7fc3f008f000 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc404064150 0x7fc4040c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 --2- 172.21.15.38:0/4202887951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc404178a70 0x7fc40417ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:36:41.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.853+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 >> 172.21.15.38:0/4202887951 conn(0x7fc404069ea0 msgr2=0x7fc404172300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:36:41.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.854+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 shutdown_connections 2023-11-06T13:36:41.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:36:41.854+0000 7fc40a535700 1 -- 172.21.15.38:0/4202887951 wait complete. 2023-11-06T13:36:41.888 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:36:57.526 INFO:tasks.workunit.client.0.smithi038.stdout: 2023-11-06T13:36:57.526 INFO:tasks.workunit.client.0.smithi038.stdout:Final score for writes: 520 2023-11-06T13:36:57.526 INFO:tasks.workunit.client.0.smithi038.stdout:Final score for reads : 576761 2023-11-06T13:36:57.526 INFO:tasks.workunit.client.0.smithi038.stdout: 2023-11-06T13:36:57.527 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-11-06T13:36:57.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-06T13:37:11.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:37:12.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.013+0000 7fe2e35ec700 1 Processor -- start 2023-11-06T13:37:12.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.014+0000 7fe2e35ec700 1 -- start start 2023-11-06T13:37:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e35ec700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fe2dc1573e0 0x7fe2dc085400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e35ec700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0ee2f0 con 0x7fe2dc180100 2023-11-06T13:37:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e35ec700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0ed400 con 0x7fe2dc180560 2023-11-06T13:37:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e35ec700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0858f0 con 0x7fe2dc1573e0 2023-11-06T13:37:12.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e0b87700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fe2dc180100 0x7fe2dc062770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:32914/0 (socket says 172.21.15.38:32914) 2023-11-06T13:37:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e0b87700 1 -- 172.21.15.38:0/3720859352 learned_addr learned my addr 172.21.15.38:0/3720859352 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:37:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2e1388700 1 --2- 172.21.15.38:0/3720859352 >> v2:172.21.15.163:3300/0 conn(0x7fe2dc1573e0 0x7fe2dc085400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605709243 0 0) 0x7fe2dc0ee2f0 con 0x7fe2dc180100 2023-11-06T13:37:12.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c80033f0 con 0x7fe2dc180100 2023-11-06T13:37:12.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046283543 0 0) 0x7fe2dc0ed400 con 0x7fe2dc180560 2023-11-06T13:37:12.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2dc0ee2f0 con 0x7fe2dc180560 2023-11-06T13:37:12.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.015+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4231518482 0 0) 0x7fe2c80033f0 con 0x7fe2dc180100 2023-11-06T13:37:12.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 >> v2:172.21.15.163:3300/0 conn(0x7fe2dc1573e0 msgr2=0x7fe2dc085400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 --2- 172.21.15.38:0/3720859352 >> v2:172.21.15.163:3300/0 conn(0x7fe2dc1573e0 0x7fe2dc085400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 >> v1:172.21.15.44:6789/0 conn(0x7fe2dc180560 legacy=0x7fe2dc062e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0ed6e0 con 0x7fe2dc180100 2023-11-06T13:37:12.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7fe2cc001470 con 0x7fe2dc180100 2023-11-06T13:37:12.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 >> v1:172.21.15.38:6789/0 conn(0x7fe2dc180100 legacy=0x7fe2dc062770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8003ac0 0x7fe2c8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2c8004690 0x7fe2c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0858f0 con 0x7fe2c8005070 2023-11-06T13:37:12.043 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c800c010 con 0x7fe2c8004690 2023-11-06T13:37:12.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c800c1d0 con 0x7fe2c8003ac0 2023-11-06T13:37:12.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2c8004690 0x7fe2c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.044 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1388700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8003ac0 0x7fe2c8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 -- 172.21.15.38:0/3720859352 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8003ac0 msgr2=0x7fe2c8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8003ac0 0x7fe2c8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 -- 172.21.15.38:0/3720859352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2c8004690 msgr2=0x7fe2c8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2c8004690 0x7fe2c8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 -- 172.21.15.38:0/3720859352 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80033f0 con 0x7fe2c8005070 2023-11-06T13:37:12.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2c8004690 0x7fe2c8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:37:12.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1388700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2c8003ac0 0x7fe2c8003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:37:12.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 -- 172.21.15.38:0/3720859352 reap_dead start 2023-11-06T13:37:12.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2c800b8e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fe2d4001890 tx=0x7fe2d4007bb0).ready entity=mon.0 client_cookie=3b4cbb3fe800a0a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4007020 con 0x7fe2c8005070 2023-11-06T13:37:12.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d4007180 con 0x7fe2c8005070 2023-11-06T13:37:12.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.016+0000 7fe2d3fff700 1 -- 172.21.15.38:0/3720859352 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4007500 con 0x7fe2c8005070 2023-11-06T13:37:12.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3720859352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 msgr2=0x7fe2c800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2c800b8e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fe2d4001890 tx=0x7fe2d4007bb0).stop 2023-11-06T13:37:12.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3720859352 shutdown_connections 2023-11-06T13:37:12.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3720859352 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2c800b8e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3720859352 >> 172.21.15.38:0/3720859352 conn(0x7fe2dc0ef5b0 msgr2=0x7fe2dc05e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:12.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3720859352 shutdown_connections 2023-11-06T13:37:12.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.017+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3720859352 wait complete. 2023-11-06T13:37:12.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.019+0000 7fe2e35ec700 1 Processor -- start 2023-11-06T13:37:12.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.019+0000 7fe2e35ec700 1 -- start start 2023-11-06T13:37:12.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e35ec700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2dc175bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e35ec700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc1760b0 0x7fe2dc17ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e35ec700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2dc17b290 0x7fe2dc190420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e35ec700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc17a510 con 0x7fe2c8005070 2023-11-06T13:37:12.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e35ec700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc17a9a0 con 0x7fe2dc1760b0 2023-11-06T13:37:12.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e35ec700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc179620 con 0x7fe2dc17b290 2023-11-06T13:37:12.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2dc175bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2dc175bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36978/0 (socket says 172.21.15.38:36978) 2023-11-06T13:37:12.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 -- 172.21.15.38:0/3195329543 learned_addr learned my addr 172.21.15.38:0/3195329543 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:12.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc1760b0 0x7fe2dc17ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2dc17b290 0x7fe2dc190420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 -- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2dc17b290 msgr2=0x7fe2dc190420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2dc17b290 0x7fe2dc190420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 -- 172.21.15.38:0/3195329543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc1760b0 msgr2=0x7fe2dc17ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc1760b0 0x7fe2dc17ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 -- 172.21.15.38:0/3195329543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc179900 con 0x7fe2c8005070 2023-11-06T13:37:12.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2e1388700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2dc175bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fe2d800f150 tx=0x7fe2d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2d17fa700 1 -- 172.21.15.38:0/3195329543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800fd40 con 0x7fe2c8005070 2023-11-06T13:37:12.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.020+0000 7fe2d17fa700 1 -- 172.21.15.38:0/3195329543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d800fea0 con 0x7fe2c8005070 2023-11-06T13:37:12.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.021+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc179be0 con 0x7fe2c8005070 2023-11-06T13:37:12.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.021+0000 7fe2d17fa700 1 -- 172.21.15.38:0/3195329543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8014620 con 0x7fe2c8005070 2023-11-06T13:37:12.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.021+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc17a1a0 con 0x7fe2c8005070 2023-11-06T13:37:12.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.022+0000 7fe2d17fa700 1 -- 172.21.15.38:0/3195329543 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fe2d8014a10 con 0x7fe2c8005070 2023-11-06T13:37:12.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.023+0000 7fe2d17fa700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe2c008cb40 0x7fe2c008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.023+0000 7fe2d17fa700 1 -- 172.21.15.38:0/3195329543 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe2d80b2a00 con 0x7fe2c8005070 2023-11-06T13:37:12.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.023+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe2c008cb40 0x7fe2c008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.024+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe2c008cb40 0x7fe2c008f000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fe2cc001050 tx=0x7fe2dc17ec30).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.024+0000 7fe2f4f84b80 1 Processor -- start 2023-11-06T13:37:12.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.024+0000 7fe2f4f84b80 1 -- start start 2023-11-06T13:37:12.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ed6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63ed68f0 0x557b63e92c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 0x557b63ed3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63e58fd0 con 0x557b63e93110 2023-11-06T13:37:12.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63dd0240 con 0x557b63c4fe90 2023-11-06T13:37:12.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63de5490 con 0x557b63ed68f0 2023-11-06T13:37:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.025+0000 7fe2e1b89700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 0x557b63ed3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ed6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e0b87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63ed68f0 0x557b63e92c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1b89700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 0x557b63ed3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36986/0 (socket says 172.21.15.38:36986) 2023-11-06T13:37:12.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1b89700 1 -- 172.21.15.38:0/1806570532 learned_addr learned my addr 172.21.15.38:0/1806570532 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 -- 172.21.15.38:0/1806570532 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63ed68f0 msgr2=0x557b63e92c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63ed68f0 0x557b63e92c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 -- 172.21.15.38:0/1806570532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 msgr2=0x557b63ed3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 0x557b63ed3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 -- 172.21.15.38:0/1806570532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b63dde670 con 0x557b63c4fe90 2023-11-06T13:37:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 0x557b63ed3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:37:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2e1388700 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ed6400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe2d800f7f0 tx=0x7fe2d80b2040).ready entity=mon.1 client_cookie=1dfebee287517564 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2c67fc700 1 -- 172.21.15.38:0/1806570532 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d808c5b0 con 0x557b63c4fe90 2023-11-06T13:37:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2c67fc700 1 -- 172.21.15.38:0/1806570532 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d808a070 con 0x557b63c4fe90 2023-11-06T13:37:12.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.026+0000 7fe2c67fc700 1 -- 172.21.15.38:0/1806570532 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80833e0 con 0x557b63c4fe90 2023-11-06T13:37:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1806570532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 msgr2=0x557b63ed6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ed6400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe2d800f7f0 tx=0x7fe2d80b2040).stop 2023-11-06T13:37:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1806570532 shutdown_connections 2023-11-06T13:37:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63e93110 0x557b63ed3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ed6400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1806570532 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63ed68f0 0x557b63e92c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1806570532 >> 172.21.15.38:0/1806570532 conn(0x557b63cfd4f0 msgr2=0x557b63e93d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1806570532 shutdown_connections 2023-11-06T13:37:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.027+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1806570532 wait complete. 2023-11-06T13:37:12.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.028+0000 7fe2f4f84b80 1 -- start start 2023-11-06T13:37:12.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.028+0000 7fe2f4f84b80 1 Processor -- start 2023-11-06T13:37:12.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 0x557b63f15c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e91c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63ed68f0 0x557b63ec9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.067 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63de55d0 con 0x557b63c4fe90 2023-11-06T13:37:12.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63de5850 con 0x557b63ed68f0 2023-11-06T13:37:12.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63db0e60 con 0x557b63e93110 2023-11-06T13:37:12.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2f4f84b80 10 client.0 ll_register_callbacks cb 0x557b63e533d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:37:12.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 0x557b63f15c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.068 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 0x557b63f15c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36988/0 (socket says 172.21.15.38:36988) 2023-11-06T13:37:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 -- 172.21.15.38:0/1424712041 learned_addr learned my addr 172.21.15.38:0/1424712041 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63ed68f0 0x557b63ec9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e91c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 -- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 msgr2=0x557b63e91c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e91c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 -- 172.21.15.38:0/1424712041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63ed68f0 msgr2=0x557b63ec9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63ed68f0 0x557b63ec9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 -- 172.21.15.38:0/1424712041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c80033f0 con 0x557b63c4fe90 2023-11-06T13:37:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2e1388700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 0x557b63f15c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fe2d800f7f0 tx=0x7fe2d808a000).ready entity=mon.0 client_cookie=cee3348d1194bc76 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:37:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.029+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/1424712041 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80861c0 con 0x557b63c4fe90 2023-11-06T13:37:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/1424712041 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe2d8086320 con 0x557b63c4fe90 2023-11-06T13:37:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b63e87690 con 0x557b63c4fe90 2023-11-06T13:37:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/1424712041 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2d808c330 con 0x557b63c4fe90 2023-11-06T13:37:12.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 10 client.5541 fetch_fsmap learned FSMap version 38 2023-11-06T13:37:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x7fe2dc17a1a0 con 0x557b63c4fe90 2023-11-06T13:37:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/1424712041 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b63e87690 con 0x557b63c4fe90 2023-11-06T13:37:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/1424712041 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 38) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fe2d8053bb0 con 0x557b63c4fe90 2023-11-06T13:37:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 10 client.5541 fetch_fsmap finished waiting for FSMap version 38 2023-11-06T13:37:12.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 10 client.5541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:37:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 20 client.5541 populate_metadata read hostname 'smithi038' 2023-11-06T13:37:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63ec30a0 0x557b63f15310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 4 client.5541 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:37:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b63c4bcf0 con 0x557b63ec30a0 2023-11-06T13:37:12.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.030+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63ec30a0 0x557b63f15310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.031+0000 7fe2bb7fe700 10 client.5541 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:12.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.031+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63ec30a0 0x557b63f15310 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a2cdd9c965f58349 server_cookie=82901128f66f4252 in_seq=0 out_seq=0 2023-11-06T13:37:12.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.033+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/1424712041 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x557b63c4bcf0 con 0x557b63ec30a0 2023-11-06T13:37:12.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.033+0000 7fe2bb7fe700 10 client.5541 handle_command_reply: tid=0 2023-11-06T13:37:12.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.033+0000 7fe2f4f84b80 1 client.5541 shutdown 2023-11-06T13:37:12.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.033+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 msgr2=0x557b63f15c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.033+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 0x557b63f15c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fe2d800f7f0 tx=0x7fe2d808a000).stop 2023-11-06T13:37:12.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 shutdown_connections 2023-11-06T13:37:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63ed68f0 0x557b63ec9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63c4fe90 0x557b63f15c80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63ec30a0 0x557b63f15310 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/1424712041 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e91c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 >> 172.21.15.38:0/1424712041 conn(0x557b63cfd4f0 msgr2=0x557b63e91430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2bb7fe700 0 client.5541 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 shutdown_connections 2023-11-06T13:37:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/1424712041 wait complete. 2023-11-06T13:37:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.034+0000 7fe2f4f84b80 20 client.5541 trim_cache size 0 max 16384 2023-11-06T13:37:12.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.050+0000 7fe2f4f84b80 1 Processor -- start 2023-11-06T13:37:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.050+0000 7fe2f4f84b80 1 -- start start 2023-11-06T13:37:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63f05e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e92a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ec3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63f02a40 con 0x557b63ed68f0 2023-11-06T13:37:12.088 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63e8d9f0 con 0x557b63c4fe90 2023-11-06T13:37:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63ed40a0 con 0x557b63e93110 2023-11-06T13:37:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2e1b89700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ec3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2e1b89700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ec3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37004/0 (socket says 172.21.15.38:37004) 2023-11-06T13:37:12.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2136359139 learned_addr learned my addr 172.21.15.38:0/2136359139 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:12.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2e1388700 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63f05e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.051+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e92a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2136359139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 msgr2=0x557b63e92a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e92a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2136359139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 msgr2=0x557b63f05e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63f05e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2136359139 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b63dd9a10 con 0x557b63ed68f0 2023-11-06T13:37:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ec3480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fe2dc086bb0 tx=0x7fe2d4016000).ready entity=mon.0 client_cookie=80a68767676f2847 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2c6ffd700 1 -- 172.21.15.38:0/2136359139 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4024070 con 0x557b63ed68f0 2023-11-06T13:37:12.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2c6ffd700 1 -- 172.21.15.38:0/2136359139 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d40072f0 con 0x557b63ed68f0 2023-11-06T13:37:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2c6ffd700 1 -- 172.21.15.38:0/2136359139 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40068b0 con 0x557b63ed68f0 2023-11-06T13:37:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2136359139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 msgr2=0x557b63ec3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ec3480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fe2dc086bb0 tx=0x7fe2d4016000).stop 2023-11-06T13:37:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2136359139 shutdown_connections 2023-11-06T13:37:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ec3480 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63f05e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2136359139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63e92a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2136359139 >> 172.21.15.38:0/2136359139 conn(0x557b63cfd4f0 msgr2=0x557b63ec9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2136359139 shutdown_connections 2023-11-06T13:37:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.052+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2136359139 wait complete. 2023-11-06T13:37:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.053+0000 7fe2f4f84b80 1 -- start start 2023-11-06T13:37:12.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.053+0000 7fe2f4f84b80 1 Processor -- start 2023-11-06T13:37:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ec85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63ed7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ecf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63ed3660 con 0x557b63ed68f0 2023-11-06T13:37:12.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63ef9810 con 0x557b63c4fe90 2023-11-06T13:37:12.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b63ec6b70 con 0x557b63e93110 2023-11-06T13:37:12.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.054+0000 7fe2f4f84b80 10 client.0 ll_register_callbacks cb 0x7fe2d8009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:37:12.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ecf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1388700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ec85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ecf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37016/0 (socket says 172.21.15.38:37016) 2023-11-06T13:37:12.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2704028780 learned_addr learned my addr 172.21.15.38:0/2704028780 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:12.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e0b87700 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63ed7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 msgr2=0x557b63ed7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63ed7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2704028780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 msgr2=0x557b63ec85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:12.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ec85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 -- 172.21.15.38:0/2704028780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc0ee2f0 con 0x557b63ed68f0 2023-11-06T13:37:12.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2e1b89700 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ecf920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fe2d4001e80 tx=0x7fe2d4024000).ready entity=mon.0 client_cookie=4014cd842b2f3c7c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:12.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:37:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/2704028780 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d402b450 con 0x557b63ed68f0 2023-11-06T13:37:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/2704028780 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe2d402b5b0 con 0x557b63ed68f0 2023-11-06T13:37:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe2d808a070 con 0x557b63ed68f0 2023-11-06T13:37:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/2704028780 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2d402b980 con 0x557b63ed68f0 2023-11-06T13:37:12.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2f4f84b80 10 client.5547 fetch_fsmap learned FSMap version 38 2023-11-06T13:37:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x557b63dd9760 con 0x557b63ed68f0 2023-11-06T13:37:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.055+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/2704028780 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d808a070 con 0x557b63ed68f0 2023-11-06T13:37:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/2704028780 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 38) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fe2d402bae0 con 0x557b63ed68f0 2023-11-06T13:37:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2f4f84b80 10 client.5547 fetch_fsmap finished waiting for FSMap version 38 2023-11-06T13:37:12.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2f4f84b80 10 client.5547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:37:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2f4f84b80 20 client.5547 populate_metadata read hostname 'smithi038' 2023-11-06T13:37:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63f6b9f0 0x557b63ed1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2f4f84b80 4 client.5547 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:37:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557b63c82cf0 con 0x557b63f6b9f0 2023-11-06T13:37:12.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2e1388700 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63f6b9f0 0x557b63ed1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2bb7fe700 10 client.5547 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.056+0000 7fe2e1388700 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63f6b9f0 0x557b63ed1ed0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9b3d473dbb2dbcb4 server_cookie=111f5be17f1546e6 in_seq=0 out_seq=0 2023-11-06T13:37:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2bb7fe700 1 -- 172.21.15.38:0/2704028780 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557b63c82cf0 con 0x557b63f6b9f0 2023-11-06T13:37:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2bb7fe700 10 client.5547 handle_command_reply: tid=0 2023-11-06T13:37:12.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 client.5547 shutdown 2023-11-06T13:37:12.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 msgr2=0x557b63ecf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ecf920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fe2d4001e80 tx=0x7fe2d4024000).stop 2023-11-06T13:37:12.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 shutdown_connections 2023-11-06T13:37:12.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x557b63ed68f0 0x557b63ecf920 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b63c4fe90 0x557b63ec85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x557b63f6b9f0 0x557b63ed1ed0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 --2- 172.21.15.38:0/2704028780 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557b63e93110 0x557b63ed7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2bb7fe700 0 client.5547 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 >> 172.21.15.38:0/2704028780 conn(0x557b63cfd4f0 msgr2=0x557b63ec3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 shutdown_connections 2023-11-06T13:37:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.059+0000 7fe2f4f84b80 1 -- 172.21.15.38:0/2704028780 wait complete. 2023-11-06T13:37:12.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2f4f84b80 20 client.5547 trim_cache size 0 max 16384 2023-11-06T13:37:12.108 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:37:12.108 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:37:12.109 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:37:12.109 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:37:12.109 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:37:12.110 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:37:12.110 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:37:12.110 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:37:12.111 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:37:12.111 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:37:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe2c008cb40 msgr2=0x7fe2c008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe2c008cb40 0x7fe2c008f000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fe2cc001050 tx=0x7fe2dc17ec30).stop 2023-11-06T13:37:12.114 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 msgr2=0x7fe2dc175bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:12.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2dc175bc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fe2d800f150 tx=0x7fe2d800b040).stop 2023-11-06T13:37:12.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 shutdown_connections 2023-11-06T13:37:12.115 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe2dc17b290 0x7fe2dc190420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe2c8005070 0x7fe2dc175bc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe2c008cb40 0x7fe2c008f000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 --2- 172.21.15.38:0/3195329543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2dc1760b0 0x7fe2dc17ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 >> 172.21.15.38:0/3195329543 conn(0x7fe2dc0ef5b0 msgr2=0x7fe2dc085070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:12.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 shutdown_connections 2023-11-06T13:37:12.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:12.060+0000 7fe2e35ec700 1 -- 172.21.15.38:0/3195329543 wait complete. 2023-11-06T13:37:12.118 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:37:42.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:37:42.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.300+0000 7fb14b857700 1 Processor -- start 2023-11-06T13:37:42.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.300+0000 7fb14b857700 1 -- start start 2023-11-06T13:37:42.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb14b857700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb1440c6990 0x7fb14417a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb14b857700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14417bb50 con 0x7fb144173540 2023-11-06T13:37:42.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb14b857700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14417ac60 con 0x7fb144173160 2023-11-06T13:37:42.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb14b857700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1441739a0 con 0x7fb1440c6990 2023-11-06T13:37:42.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb148df2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fb1440c6990 0x7fb14417a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb149df4700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fb144173540 0x7fb14417bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:39586/0 (socket says 172.21.15.38:39586) 2023-11-06T13:37:42.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb149df4700 1 -- 172.21.15.38:0/840757948 learned_addr learned my addr 172.21.15.38:0/840757948 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:37:42.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb148df2700 1 -- 172.21.15.38:0/840757948 >> v1:172.21.15.44:6789/0 conn(0x7fb144173160 legacy=0x7fb1441808d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb148df2700 1 -- 172.21.15.38:0/840757948 >> v1:172.21.15.38:6789/0 conn(0x7fb144173540 legacy=0x7fb14417bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb143fff700 1 -- 172.21.15.38:0/840757948 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229065678 0 0) 0x7fb14417bb50 con 0x7fb144173540 2023-11-06T13:37:42.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb148df2700 1 -- 172.21.15.38:0/840757948 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14417af40 con 0x7fb1440c6990 2023-11-06T13:37:42.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.302+0000 7fb148df2700 1 --2- 172.21.15.38:0/840757948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1440c6990 0x7fb14417a600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fb138009760 tx=0x7fb138009060).ready entity=mon.0 client_cookie=5e1f24a1a4c0e3f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.303+0000 7fb143fff700 1 -- 172.21.15.38:0/840757948 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138009120 con 0x7fb1440c6990 2023-11-06T13:37:42.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.303+0000 7fb143fff700 1 -- 172.21.15.38:0/840757948 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800b580 con 0x7fb1440c6990 2023-11-06T13:37:42.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.303+0000 7fb143fff700 1 -- 172.21.15.38:0/840757948 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800b900 con 0x7fb1440c6990 2023-11-06T13:37:42.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.303+0000 7fb14b857700 1 -- 172.21.15.38:0/840757948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1440c6990 msgr2=0x7fb14417a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.303+0000 7fb14b857700 1 --2- 172.21.15.38:0/840757948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1440c6990 0x7fb14417a600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fb138009760 tx=0x7fb138009060).stop 2023-11-06T13:37:42.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.304+0000 7fb14b857700 1 -- 172.21.15.38:0/840757948 shutdown_connections 2023-11-06T13:37:42.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.304+0000 7fb14b857700 1 --2- 172.21.15.38:0/840757948 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb1440c6990 0x7fb14417a600 secure :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0x7fb138009760 tx=0x7fb138009060).stop 2023-11-06T13:37:42.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.304+0000 7fb14b857700 1 -- 172.21.15.38:0/840757948 >> 172.21.15.38:0/840757948 conn(0x7fb1440f19d0 msgr2=0x7fb1440eda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.305+0000 7fb14b857700 1 -- 172.21.15.38:0/840757948 shutdown_connections 2023-11-06T13:37:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.305+0000 7fb14b857700 1 -- 172.21.15.38:0/840757948 wait complete. 2023-11-06T13:37:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.307+0000 7fb14b857700 1 Processor -- start 2023-11-06T13:37:42.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.307+0000 7fb14b857700 1 -- start start 2023-11-06T13:37:42.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.308+0000 7fb14b857700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb144173160 0x7fb14416f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.308+0000 7fb14b857700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 0x7fb14418b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.308+0000 7fb14b857700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb144190c30 0x7fb14418bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.308+0000 7fb14b857700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14418b240 con 0x7fb144190c30 2023-11-06T13:37:42.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.308+0000 7fb14b857700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14418f8d0 con 0x7fb144173160 2023-11-06T13:37:42.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.308+0000 7fb14b857700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14418fbb0 con 0x7fb144173540 2023-11-06T13:37:42.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb148df2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 0x7fb14418b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb148df2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 0x7fb14418b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:38764/0 (socket says 172.21.15.38:38764) 2023-11-06T13:37:42.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb148df2700 1 -- 172.21.15.38:0/778055099 learned_addr learned my addr 172.21.15.38:0/778055099 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:42.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb144173160 0x7fb14416f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 -- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 msgr2=0x7fb14418b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 0x7fb14418b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 -- 172.21.15.38:0/778055099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb144190c30 msgr2=0x7fb14418bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb144190c30 0x7fb14418bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:37:42.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 -- 172.21.15.38:0/778055099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380092a0 con 0x7fb144173160 2023-11-06T13:37:42.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb148df2700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 0x7fb14418b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:37:42.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.309+0000 7fb1495f3700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb144173160 0x7fb14416f1e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb13400c7c0 tx=0x7fb1340014c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.310+0000 7fb1417fa700 1 -- 172.21.15.38:0/778055099 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400e4a0 con 0x7fb144173160 2023-11-06T13:37:42.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.310+0000 7fb1417fa700 1 -- 172.21.15.38:0/778055099 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400e600 con 0x7fb144173160 2023-11-06T13:37:42.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.310+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14418abf0 con 0x7fb144173160 2023-11-06T13:37:42.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.310+0000 7fb1417fa700 1 -- 172.21.15.38:0/778055099 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400e9a0 con 0x7fb144173160 2023-11-06T13:37:42.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.310+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14418c0b0 con 0x7fb144173160 2023-11-06T13:37:42.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.313+0000 7fb1417fa700 1 -- 172.21.15.38:0/778055099 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fb13400ed50 con 0x7fb144173160 2023-11-06T13:37:42.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.314+0000 7fb1417fa700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb13008cb40 0x7fb13008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.314+0000 7fb1417fa700 1 -- 172.21.15.38:0/778055099 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb1340b17b0 con 0x7fb144173160 2023-11-06T13:37:42.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.314+0000 7fb148df2700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb13008cb40 0x7fb13008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.315+0000 7fb148df2700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb13008cb40 0x7fb13008f000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb1440ee510 tx=0x7fb138017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.315+0000 7fb15d1efb80 1 Processor -- start 2023-11-06T13:37:42.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.316+0000 7fb15d1efb80 1 -- start start 2023-11-06T13:37:42.321 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf2d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf29f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdf30550 0x55c8fdf309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdea5fd0 con 0x55c8fdc9ce90 2023-11-06T13:37:42.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fde1d240 con 0x55c8fdf29ac0 2023-11-06T13:37:42.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fde32490 con 0x55c8fdf30550 2023-11-06T13:37:42.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf2d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf2d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48154/0 (socket says 172.21.15.38:48154) 2023-11-06T13:37:42.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 -- 172.21.15.38:0/305590320 learned_addr learned my addr 172.21.15.38:0/305590320 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:42.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb148df2700 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf29f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb149df4700 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdf30550 0x55c8fdf309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 -- 172.21.15.38:0/305590320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdf30550 msgr2=0x55c8fdf309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdf30550 0x55c8fdf309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 -- 172.21.15.38:0/305590320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 msgr2=0x55c8fdf29f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf29f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.317+0000 7fb1495f3700 1 -- 172.21.15.38:0/305590320 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8fde2b670 con 0x55c8fdc9ce90 2023-11-06T13:37:42.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.318+0000 7fb1495f3700 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf2d650 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb1340856a0 tx=0x7fb134001690).ready entity=mon.0 client_cookie=7444b263c3267c6a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb12a7fc700 1 -- 172.21.15.38:0/305590320 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13408b2e0 con 0x55c8fdc9ce90 2023-11-06T13:37:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb12a7fc700 1 -- 172.21.15.38:0/305590320 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134083da0 con 0x55c8fdc9ce90 2023-11-06T13:37:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb12a7fc700 1 -- 172.21.15.38:0/305590320 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134084ef0 con 0x55c8fdc9ce90 2023-11-06T13:37:42.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 -- 172.21.15.38:0/305590320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 msgr2=0x55c8fdf2d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf2d650 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb1340856a0 tx=0x7fb134001690).stop 2023-11-06T13:37:42.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 -- 172.21.15.38:0/305590320 shutdown_connections 2023-11-06T13:37:42.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdf30550 0x55c8fdf309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.334 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf2d650 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/305590320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf29f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 -- 172.21.15.38:0/305590320 >> 172.21.15.38:0/305590320 conn(0x55c8fdd4a4f0 msgr2=0x55c8fdee1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.319+0000 7fb15d1efb80 1 -- 172.21.15.38:0/305590320 shutdown_connections 2023-11-06T13:37:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.320+0000 7fb15d1efb80 1 -- 172.21.15.38:0/305590320 wait complete. 2023-11-06T13:37:42.335 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.320+0000 7fb15d1efb80 1 -- start start 2023-11-06T13:37:42.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.321+0000 7fb15d1efb80 1 Processor -- start 2023-11-06T13:37:42.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdede750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf52d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf30550 0x55c8fdf22e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.336 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fde325d0 con 0x55c8fdf29ac0 2023-11-06T13:37:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fde32850 con 0x55c8fdf30550 2023-11-06T13:37:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fddfde60 con 0x55c8fdc9ce90 2023-11-06T13:37:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 10 client.0 ll_register_callbacks cb 0x55c8fdea03d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:37:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf52d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.337 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf52d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48170/0 (socket says 172.21.15.38:48170) 2023-11-06T13:37:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 -- 172.21.15.38:0/3633698375 learned_addr learned my addr 172.21.15.38:0/3633698375 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb1495f3700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdede750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb149df4700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf30550 0x55c8fdf22e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 -- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 msgr2=0x55c8fdede750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.338 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdede750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 -- 172.21.15.38:0/3633698375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf30550 msgr2=0x55c8fdf22e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf30550 0x55c8fdf22e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 -- 172.21.15.38:0/3633698375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14418c0b0 con 0x55c8fdf29ac0 2023-11-06T13:37:42.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb148df2700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf52d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fb138009eb0 tx=0x7fb13801e040).ready entity=mon.0 client_cookie=454103df49c78918 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb1237fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:37:42.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb1237fe700 1 -- 172.21.15.38:0/3633698375 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13802b070 con 0x55c8fdf29ac0 2023-11-06T13:37:42.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb1237fe700 1 -- 172.21.15.38:0/3633698375 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb13801c780 con 0x55c8fdf29ac0 2023-11-06T13:37:42.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.322+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8fded4690 con 0x55c8fdf29ac0 2023-11-06T13:37:42.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb1237fe700 1 -- 172.21.15.38:0/3633698375 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb13801cba0 con 0x55c8fdf29ac0 2023-11-06T13:37:42.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 10 client.5559 fetch_fsmap learned FSMap version 39 2023-11-06T13:37:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55c8fde26a10 con 0x55c8fdf29ac0 2023-11-06T13:37:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb1237fe700 1 -- 172.21.15.38:0/3633698375 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13803a020 con 0x55c8fdf29ac0 2023-11-06T13:37:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb1237fe700 1 -- 172.21.15.38:0/3633698375 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 39) v1 ==== 7536+0+0 (secure 0 0 0) 0x7fb13801cd00 con 0x55c8fdf29ac0 2023-11-06T13:37:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 10 client.5559 fetch_fsmap finished waiting for FSMap version 39 2023-11-06T13:37:42.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 10 client.5559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:37:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 20 client.5559 populate_metadata read hostname 'smithi038' 2023-11-06T13:37:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdee08e0 0x55c8fdee0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 4 client.5559 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:37:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8fdc98cf0 con 0x55c8fdee08e0 2023-11-06T13:37:42.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.323+0000 7fb1495f3700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdee08e0 0x55c8fdee0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.324+0000 7fb1495f3700 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdee08e0 0x55c8fdee0cf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1372ea0cecfca45c server_cookie=d0ced169b0f4ebab in_seq=0 out_seq=0 2023-11-06T13:37:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.324+0000 7fb1237fe700 10 client.5559 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.324+0000 7fb1237fe700 1 -- 172.21.15.38:0/3633698375 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55c8fdc98cf0 con 0x55c8fdee08e0 2023-11-06T13:37:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb1237fe700 10 client.5559 handle_command_reply: tid=0 2023-11-06T13:37:42.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 client.5559 shutdown 2023-11-06T13:37:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 msgr2=0x55c8fdf52d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf52d90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fb138009eb0 tx=0x7fb13801e040).stop 2023-11-06T13:37:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 shutdown_connections 2023-11-06T13:37:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf30550 0x55c8fdf22e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdee08e0 0x55c8fdee0cf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdede750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3633698375 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdf52d90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb1237fe700 0 client.5559 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:42.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 >> 172.21.15.38:0/3633698375 conn(0x55c8fdd4a4f0 msgr2=0x55c8fdf25810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:42.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 shutdown_connections 2023-11-06T13:37:42.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3633698375 wait complete. 2023-11-06T13:37:42.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.325+0000 7fb15d1efb80 20 client.5559 trim_cache size 0 max 16384 2023-11-06T13:37:42.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.341+0000 7fb15d1efb80 1 Processor -- start 2023-11-06T13:37:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.342+0000 7fb15d1efb80 1 -- start start 2023-11-06T13:37:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf5b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdee08e0 0x55c8fdeda5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdeef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdf2e000 con 0x55c8fdf29ac0 2023-11-06T13:37:42.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdf2f4b0 con 0x55c8fdc9ce90 2023-11-06T13:37:42.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdf5bb50 con 0x55c8fdee08e0 2023-11-06T13:37:42.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb149df4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdeef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf5b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf5b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:48556/0 (socket says 172.21.15.38:48556) 2023-11-06T13:37:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb149df4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdeef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48176/0 (socket says 172.21.15.38:48176) 2023-11-06T13:37:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 -- 172.21.15.38:0/2961428030 learned_addr learned my addr 172.21.15.38:0/2961428030 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb148df2700 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdee08e0 0x55c8fdeda5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 -- 172.21.15.38:0/2961428030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdee08e0 msgr2=0x55c8fdeda5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdee08e0 0x55c8fdeda5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 -- 172.21.15.38:0/2961428030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 msgr2=0x55c8fdeef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdeef220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 -- 172.21.15.38:0/2961428030 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8fde26760 con 0x55c8fdc9ce90 2023-11-06T13:37:42.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb1495f3700 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf5b660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb13400ce60 tx=0x7fb13400c040).ready entity=mon.1 client_cookie=c7a98759774749aa server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb12affd700 1 -- 172.21.15.38:0/2961428030 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134091040 con 0x55c8fdc9ce90 2023-11-06T13:37:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb12affd700 1 -- 172.21.15.38:0/2961428030 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134084ef0 con 0x55c8fdc9ce90 2023-11-06T13:37:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.343+0000 7fb12affd700 1 -- 172.21.15.38:0/2961428030 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134095280 con 0x55c8fdc9ce90 2023-11-06T13:37:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 -- 172.21.15.38:0/2961428030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 msgr2=0x55c8fdf5b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf5b660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb13400ce60 tx=0x7fb13400c040).stop 2023-11-06T13:37:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 -- 172.21.15.38:0/2961428030 shutdown_connections 2023-11-06T13:37:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdf29ac0 0x55c8fdeef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdc9ce90 0x55c8fdf5b660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/2961428030 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdee08e0 0x55c8fdeda5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 -- 172.21.15.38:0/2961428030 >> 172.21.15.38:0/2961428030 conn(0x55c8fdd4a4f0 msgr2=0x55c8fdf2e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 -- 172.21.15.38:0/2961428030 shutdown_connections 2023-11-06T13:37:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.344+0000 7fb15d1efb80 1 -- 172.21.15.38:0/2961428030 wait complete. 2023-11-06T13:37:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.345+0000 7fb15d1efb80 1 -- start start 2023-11-06T13:37:42.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.345+0000 7fb15d1efb80 1 Processor -- start 2023-11-06T13:37:42.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdfaf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 0x55c8fdf1f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdfc0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdfaf5f0 con 0x55c8fdee08e0 2023-11-06T13:37:42.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdf2cd50 con 0x55c8fdf29ac0 2023-11-06T13:37:42.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8fdfbd910 con 0x55c8fdc9ce90 2023-11-06T13:37:42.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb15d1efb80 10 client.0 ll_register_callbacks cb 0x55c8fdea03d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:37:42.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 0x55c8fdf1f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 0x55c8fdf1f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48178/0 (socket says 172.21.15.38:48178) 2023-11-06T13:37:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb1495f3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdfaf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 -- 172.21.15.38:0/3598897787 learned_addr learned my addr 172.21.15.38:0/3598897787 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:37:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb149df4700 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdfc0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 -- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 msgr2=0x55c8fdfaf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdfaf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 -- 172.21.15.38:0/3598897787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 msgr2=0x55c8fdfc0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:37:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdfc0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 -- 172.21.15.38:0/3598897787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8fde2b670 con 0x55c8fdee08e0 2023-11-06T13:37:42.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb148df2700 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 0x55c8fdf1f5e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fb13800b010 tx=0x7fb13802b000).ready entity=mon.0 client_cookie=f9cd02c89db37b79 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:37:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.346+0000 7fb1237fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:37:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb1237fe700 1 -- 172.21.15.38:0/3598897787 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13801cba0 con 0x55c8fdee08e0 2023-11-06T13:37:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb1237fe700 1 -- 172.21.15.38:0/3598897787 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fb13803b080 con 0x55c8fdee08e0 2023-11-06T13:37:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb134083da0 con 0x55c8fdee08e0 2023-11-06T13:37:42.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb1237fe700 1 -- 172.21.15.38:0/3598897787 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb13801cd00 con 0x55c8fdee08e0 2023-11-06T13:37:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 10 client.5565 fetch_fsmap learned FSMap version 39 2023-11-06T13:37:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55c8fdc9dfd0 con 0x55c8fdee08e0 2023-11-06T13:37:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb1237fe700 1 -- 172.21.15.38:0/3598897787 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134083da0 con 0x55c8fdee08e0 2023-11-06T13:37:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb1237fe700 1 -- 172.21.15.38:0/3598897787 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 39) v1 ==== 7536+0+0 (secure 0 0 0) 0x7fb138005880 con 0x55c8fdee08e0 2023-11-06T13:37:42.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 10 client.5565 fetch_fsmap finished waiting for FSMap version 39 2023-11-06T13:37:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 10 client.5565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:37:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 20 client.5565 populate_metadata read hostname 'smithi038' 2023-11-06T13:37:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdf30550 0x55c8fdf535a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:37:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 4 client.5565 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:37:42.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c8fdccfcf0 con 0x55c8fdf30550 2023-11-06T13:37:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.347+0000 7fb1495f3700 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdf30550 0x55c8fdf535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:37:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb1237fe700 10 client.5565 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb1495f3700 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdf30550 0x55c8fdf535a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7a701a7ac1f7a6b server_cookie=37ca036480222513 in_seq=0 out_seq=0 2023-11-06T13:37:42.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb1237fe700 1 -- 172.21.15.38:0/3598897787 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c8fdccfcf0 con 0x55c8fdf30550 2023-11-06T13:37:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb1237fe700 10 client.5565 handle_command_reply: tid=0 2023-11-06T13:37:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 client.5565 shutdown 2023-11-06T13:37:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 msgr2=0x55c8fdf1f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 0x55c8fdf1f5e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fb13800b010 tx=0x7fb13802b000).stop 2023-11-06T13:37:42.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 shutdown_connections 2023-11-06T13:37:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c8fdf29ac0 0x55c8fdfc0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55c8fdf30550 0x55c8fdf535a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c8fdc9ce90 0x55c8fdfaf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 --2- 172.21.15.38:0/3598897787 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55c8fdee08e0 0x55c8fdf1f5e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb1237fe700 0 client.5565 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:37:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 >> 172.21.15.38:0/3598897787 conn(0x55c8fdd4a4f0 msgr2=0x55c8fdf157c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 shutdown_connections 2023-11-06T13:37:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 1 -- 172.21.15.38:0/3598897787 wait complete. 2023-11-06T13:37:42.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.348+0000 7fb15d1efb80 20 client.5565 trim_cache size 0 max 16384 2023-11-06T13:37:42.370 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:37:42.370 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:37:42.370 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:37:42.370 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:37:42.371 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:37:42.371 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:37:42.371 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:37:42.371 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:37:42.371 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:37:42.372 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:37:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb13008cb40 msgr2=0x7fb13008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb13008cb40 0x7fb13008f000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb1440ee510 tx=0x7fb138017000).stop 2023-11-06T13:37:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb144173160 msgr2=0x7fb14416f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:37:42.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb144173160 0x7fb14416f1e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb13400c7c0 tx=0x7fb1340014c0).stop 2023-11-06T13:37:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 shutdown_connections 2023-11-06T13:37:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fb144190c30 0x7fb14418bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:37:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fb13008cb40 0x7fb13008f000 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb144173160 0x7fb14416f1e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 --2- 172.21.15.38:0/778055099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb144173540 0x7fb14418b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:37:42.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 >> 172.21.15.38:0/778055099 conn(0x7fb1440f19d0 msgr2=0x7fb1440ece70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:37:42.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 shutdown_connections 2023-11-06T13:37:42.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:37:42.349+0000 7fb14b857700 1 -- 172.21.15.38:0/778055099 wait complete. 2023-11-06T13:37:42.376 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:38:12.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:38:12.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.536+0000 7fe3748f5700 1 Processor -- start 2023-11-06T13:38:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.536+0000 7fe3748f5700 1 -- start start 2023-11-06T13:38:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.537+0000 7fe3748f5700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe370179880 0x7fe370179c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.542 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.537+0000 7fe3748f5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe370181b60 0x7fe370181fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.537+0000 7fe3748f5700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe370186470 con 0x7fe3701824d0 2023-11-06T13:38:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.537+0000 7fe3748f5700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe370186190 con 0x7fe370181b60 2023-11-06T13:38:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.537+0000 7fe3748f5700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe370180da0 con 0x7fe370179880 2023-11-06T13:38:12.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36dd9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fe370181b60 0x7fe370181fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36e59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe370179880 0x7fe370179c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36e59c700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe370179880 0x7fe370179c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56960/0 (socket says 172.21.15.38:56960) 2023-11-06T13:38:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36e59c700 1 -- 172.21.15.38:0/622738419 learned_addr learned my addr 172.21.15.38:0/622738419 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:12.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36ed9d700 1 --1- 172.21.15.38:0/622738419 >> v1:172.21.15.163:6789/0 conn(0x7fe3701824d0 0x7fe3700f1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:39318/0 (socket says 172.21.15.38:39318) 2023-11-06T13:38:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36dd9b700 1 -- 172.21.15.38:0/622738419 >> v2:172.21.15.44:3300/0 conn(0x7fe370179880 msgr2=0x7fe370179c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/622738419 >> v2:172.21.15.44:3300/0 conn(0x7fe370179880 0x7fe370179c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36dd9b700 1 -- 172.21.15.38:0/622738419 >> v1:172.21.15.163:6789/0 conn(0x7fe3701824d0 legacy=0x7fe3700f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36dd9b700 1 -- 172.21.15.38:0/622738419 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe370181080 con 0x7fe370181b60 2023-11-06T13:38:12.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.538+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/622738419 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe370181b60 0x7fe370181fe0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fe37006a9f0 tx=0x7fe364009060).ready entity=mon.0 client_cookie=21aa799b77821da2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe36d59a700 1 -- 172.21.15.38:0/622738419 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400f510 con 0x7fe370181b60 2023-11-06T13:38:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe36d59a700 1 -- 172.21.15.38:0/622738419 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400f670 con 0x7fe370181b60 2023-11-06T13:38:12.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe36d59a700 1 -- 172.21.15.38:0/622738419 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400f9f0 con 0x7fe370181b60 2023-11-06T13:38:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 -- 172.21.15.38:0/622738419 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe370181b60 msgr2=0x7fe370181fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 --2- 172.21.15.38:0/622738419 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe370181b60 0x7fe370181fe0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fe37006a9f0 tx=0x7fe364009060).stop 2023-11-06T13:38:12.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 -- 172.21.15.38:0/622738419 shutdown_connections 2023-11-06T13:38:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 --2- 172.21.15.38:0/622738419 >> v2:172.21.15.44:3300/0 conn(0x7fe370179880 0x7fe370179c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 --2- 172.21.15.38:0/622738419 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe370181b60 0x7fe370181fe0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 -- 172.21.15.38:0/622738419 >> 172.21.15.38:0/622738419 conn(0x7fe370069ea0 msgr2=0x7fe37006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.539+0000 7fe3748f5700 1 -- 172.21.15.38:0/622738419 shutdown_connections 2023-11-06T13:38:12.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.540+0000 7fe3748f5700 1 -- 172.21.15.38:0/622738419 wait complete. 2023-11-06T13:38:12.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.541+0000 7fe3748f5700 1 Processor -- start 2023-11-06T13:38:12.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.541+0000 7fe3748f5700 1 -- start start 2023-11-06T13:38:12.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe3748f5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe370179880 0x7fe3701806d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe3748f5700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe370181b60 0x7fe3700cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe3748f5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701824d0 0x7fe3700cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe3748f5700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370180bc0 con 0x7fe3701824d0 2023-11-06T13:38:12.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe3748f5700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700f0d80 con 0x7fe370181b60 2023-11-06T13:38:12.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe3748f5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700f1060 con 0x7fe370179880 2023-11-06T13:38:12.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36ed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701824d0 0x7fe3700cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36ed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701824d0 0x7fe3700cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58892/0 (socket says 172.21.15.38:58892) 2023-11-06T13:38:12.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36ed9d700 1 -- 172.21.15.38:0/1985238019 learned_addr learned my addr 172.21.15.38:0/1985238019 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:12.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe370181b60 0x7fe3700cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36dd9b700 1 -- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe370179880 msgr2=0x7fe3701806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe370179880 0x7fe3701806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36dd9b700 1 -- 172.21.15.38:0/1985238019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701824d0 msgr2=0x7fe3700cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.543+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701824d0 0x7fe3700cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe36dd9b700 1 -- 172.21.15.38:0/1985238019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3640092a0 con 0x7fe370181b60 2023-11-06T13:38:12.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe370181b60 0x7fe3700cb1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe364014000 tx=0x7fe364017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe35e7fc700 1 -- 172.21.15.38:0/1985238019 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36400f7e0 con 0x7fe370181b60 2023-11-06T13:38:12.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe35e7fc700 1 -- 172.21.15.38:0/1985238019 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36400f940 con 0x7fe370181b60 2023-11-06T13:38:12.555 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe35e7fc700 1 -- 172.21.15.38:0/1985238019 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36401b690 con 0x7fe370181b60 2023-11-06T13:38:12.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3700f1340 con 0x7fe370181b60 2023-11-06T13:38:12.556 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.544+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3700f1900 con 0x7fe370181b60 2023-11-06T13:38:12.561 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.546+0000 7fe35e7fc700 1 -- 172.21.15.38:0/1985238019 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fe36401ba40 con 0x7fe370181b60 2023-11-06T13:38:12.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.547+0000 7fe35e7fc700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe35008cb40 0x7fe35008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.547+0000 7fe35e7fc700 1 -- 172.21.15.38:0/1985238019 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe3640b34c0 con 0x7fe370181b60 2023-11-06T13:38:12.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.549+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe35008cb40 0x7fe35008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.549+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe35008cb40 0x7fe35008f000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fe36800e260 tx=0x7fe36800b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.562 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.549+0000 7fe38628db80 1 Processor -- start 2023-11-06T13:38:12.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.549+0000 7fe38628db80 1 -- start start 2023-11-06T13:38:12.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe38628db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600636a6e90 0x56006392d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe38628db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe38628db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006392ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe38628db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600638affd0 con 0x56006392d8f0 2023-11-06T13:38:12.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe38628db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x560063827240 con 0x5600638ea110 2023-11-06T13:38:12.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe38628db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006383c490 con 0x5600636a6e90 2023-11-06T13:38:12.564 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58906/0 (socket says 172.21.15.38:58906) 2023-11-06T13:38:12.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36ed9d700 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006392ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 -- 172.21.15.38:0/592972428 learned_addr learned my addr 172.21.15.38:0/592972428 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:12.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36e59c700 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600636a6e90 0x56006392d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 -- 172.21.15.38:0/592972428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600636a6e90 msgr2=0x56006392d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600636a6e90 0x56006392d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 -- 172.21.15.38:0/592972428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 msgr2=0x56006392ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006392ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 -- 172.21.15.38:0/592972428 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560063835670 con 0x56006392d8f0 2023-11-06T13:38:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.551+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e9c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe364083bd0 tx=0x7fe3640b0ff0).ready entity=mon.0 client_cookie=51be089a5f56e69b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe34f7fe700 1 -- 172.21.15.38:0/592972428 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640b3340 con 0x56006392d8f0 2023-11-06T13:38:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe34f7fe700 1 -- 172.21.15.38:0/592972428 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364087790 con 0x56006392d8f0 2023-11-06T13:38:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe34f7fe700 1 -- 172.21.15.38:0/592972428 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36408d070 con 0x56006392d8f0 2023-11-06T13:38:12.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 -- 172.21.15.38:0/592972428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 msgr2=0x5600638e9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e9c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe364083bd0 tx=0x7fe3640b0ff0).stop 2023-11-06T13:38:12.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 -- 172.21.15.38:0/592972428 shutdown_connections 2023-11-06T13:38:12.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006392ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600636a6e90 0x56006392d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 --2- 172.21.15.38:0/592972428 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e9c20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 -- 172.21.15.38:0/592972428 >> 172.21.15.38:0/592972428 conn(0x5600637544f0 msgr2=0x5600638ead50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:12.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 -- 172.21.15.38:0/592972428 shutdown_connections 2023-11-06T13:38:12.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.552+0000 7fe38628db80 1 -- 172.21.15.38:0/592972428 wait complete. 2023-11-06T13:38:12.569 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.553+0000 7fe38628db80 1 -- start start 2023-11-06T13:38:12.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.553+0000 7fe38628db80 1 Processor -- start 2023-11-06T13:38:12.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.554+0000 7fe38628db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600636a6e90 0x56006392f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe38628db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600638ea110 0x56006392ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe38628db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe38628db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006383c5d0 con 0x56006392d8f0 2023-11-06T13:38:12.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe38628db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006383c850 con 0x5600636a6e90 2023-11-06T13:38:12.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe38628db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560063807e60 con 0x5600638ea110 2023-11-06T13:38:12.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe38628db80 10 client.0 ll_register_callbacks cb 0x5600638aa3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:38:12.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36e59c700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600636a6e90 0x56006392f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58908/0 (socket says 172.21.15.38:58908) 2023-11-06T13:38:12.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 -- 172.21.15.38:0/1479276845 learned_addr learned my addr 172.21.15.38:0/1479276845 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:12.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600638ea110 0x56006392ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 -- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600638ea110 msgr2=0x56006392ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600638ea110 0x56006392ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 -- 172.21.15.38:0/1479276845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600636a6e90 msgr2=0x56006392f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600636a6e90 0x56006392f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 -- 172.21.15.38:0/1479276845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3700f1900 con 0x56006392d8f0 2023-11-06T13:38:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600636a6e90 0x56006392f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:38:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe36ed9d700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e87f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe360012650 tx=0x7fe360009040).ready entity=mon.0 client_cookie=569c657b1124a5fe server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.555+0000 7fe34cff9700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:38:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe34cff9700 1 -- 172.21.15.38:0/1479276845 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36001a070 con 0x56006392d8f0 2023-11-06T13:38:12.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe34cff9700 1 -- 172.21.15.38:0/1479276845 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe360004e30 con 0x56006392d8f0 2023-11-06T13:38:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600638de690 con 0x56006392d8f0 2023-11-06T13:38:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe34cff9700 1 -- 172.21.15.38:0/1479276845 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe360015650 con 0x56006392d8f0 2023-11-06T13:38:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe38628db80 10 client.5577 fetch_fsmap learned FSMap version 40 2023-11-06T13:38:12.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x560063830a10 con 0x56006392d8f0 2023-11-06T13:38:12.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe34cff9700 1 -- 172.21.15.38:0/1479276845 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600638de690 con 0x56006392d8f0 2023-11-06T13:38:12.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.556+0000 7fe34cff9700 1 -- 172.21.15.38:0/1479276845 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 40) v1 ==== 7532+0+0 (secure 0 0 0) 0x7fe36001d020 con 0x56006392d8f0 2023-11-06T13:38:12.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe38628db80 10 client.5577 fetch_fsmap finished waiting for FSMap version 40 2023-11-06T13:38:12.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe38628db80 10 client.5577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:38:12.576 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe38628db80 20 client.5577 populate_metadata read hostname 'smithi038' 2023-11-06T13:38:12.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe38628db80 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5600638e9650 0x560063969e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe38628db80 4 client.5577 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:38:12.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600636a2cf0 con 0x5600638e9650 2023-11-06T13:38:12.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5600638e9650 0x560063969e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe34cff9700 10 client.5577 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:12.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.557+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5600638e9650 0x560063969e00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ceff8f479c3465fc server_cookie=2c3b23bb8c61f75e in_seq=0 out_seq=0 2023-11-06T13:38:12.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe34cff9700 1 -- 172.21.15.38:0/1479276845 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5600636a2cf0 con 0x5600638e9650 2023-11-06T13:38:12.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe34cff9700 10 client.5577 handle_command_reply: tid=0 2023-11-06T13:38:12.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 client.5577 shutdown 2023-11-06T13:38:12.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 msgr2=0x5600638e87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e87f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fe360012650 tx=0x7fe360009040).stop 2023-11-06T13:38:12.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 shutdown_connections 2023-11-06T13:38:12.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x56006392d8f0 0x5600638e87f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600636a6e90 0x56006392f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5600638e9650 0x560063969e00 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 --2- 172.21.15.38:0/1479276845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5600638ea110 0x56006392ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe34cff9700 0 client.5577 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:12.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 >> 172.21.15.38:0/1479276845 conn(0x5600637544f0 msgr2=0x56006392ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:12.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 shutdown_connections 2023-11-06T13:38:12.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.560+0000 7fe38628db80 1 -- 172.21.15.38:0/1479276845 wait complete. 2023-11-06T13:38:12.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.561+0000 7fe38628db80 20 client.5577 trim_cache size 0 max 16384 2023-11-06T13:38:12.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.584+0000 7fe38628db80 1 Processor -- start 2023-11-06T13:38:12.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.586+0000 7fe38628db80 1 -- start start 2023-11-06T13:38:12.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.587+0000 7fe38628db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006395c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.587+0000 7fe38628db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x5600638ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.587+0000 7fe38628db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 0x56006395dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.592 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.587+0000 7fe38628db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x560063918820 con 0x5600636a6e90 2023-11-06T13:38:12.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.587+0000 7fe38628db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006395e1a0 con 0x5600638ea110 2023-11-06T13:38:12.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.587+0000 7fe38628db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006392d170 con 0x56006392d8f0 2023-11-06T13:38:12.593 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006395c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006395c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:58914/0 (socket says 172.21.15.38:58914) 2023-11-06T13:38:12.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 -- 172.21.15.38:0/1081049115 learned_addr learned my addr 172.21.15.38:0/1081049115 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:12.594 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x5600638ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 -- 172.21.15.38:0/1081049115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 msgr2=0x56006395dcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:38:12.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 0x56006395dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 -- 172.21.15.38:0/1081049115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 msgr2=0x5600638ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.597 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x5600638ea4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 -- 172.21.15.38:0/1081049115 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560063959120 con 0x5600636a6e90 2023-11-06T13:38:12.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe36e59c700 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006395c440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x5600638e95b0 tx=0x7fe368014000).ready entity=mon.0 client_cookie=c8e780e089e2c94 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.588+0000 7fe34ffff700 1 -- 172.21.15.38:0/1081049115 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368026070 con 0x5600636a6e90 2023-11-06T13:38:12.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe34ffff700 1 -- 172.21.15.38:0/1081049115 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36801a040 con 0x5600636a6e90 2023-11-06T13:38:12.598 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe34ffff700 1 -- 172.21.15.38:0/1081049115 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368021970 con 0x5600636a6e90 2023-11-06T13:38:12.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 -- 172.21.15.38:0/1081049115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 msgr2=0x56006395c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006395c440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x5600638e95b0 tx=0x7fe368014000).stop 2023-11-06T13:38:12.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 -- 172.21.15.38:0/1081049115 shutdown_connections 2023-11-06T13:38:12.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 0x56006395dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.599 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006395c440 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 --2- 172.21.15.38:0/1081049115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x5600638ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 -- 172.21.15.38:0/1081049115 >> 172.21.15.38:0/1081049115 conn(0x5600637544f0 msgr2=0x56006392e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:12.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 -- 172.21.15.38:0/1081049115 shutdown_connections 2023-11-06T13:38:12.600 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.589+0000 7fe38628db80 1 -- 172.21.15.38:0/1081049115 wait complete. 2023-11-06T13:38:12.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.590+0000 7fe38628db80 1 -- start start 2023-11-06T13:38:12.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.590+0000 7fe38628db80 1 Processor -- start 2023-11-06T13:38:12.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006396b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006391ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.601 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 0x560063929d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600639ac8c0 con 0x5600636a6e90 2023-11-06T13:38:12.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600638f0390 con 0x5600638ea110 2023-11-06T13:38:12.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56006396ad10 con 0x56006392d8f0 2023-11-06T13:38:12.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe38628db80 10 client.0 ll_register_callbacks cb 0x5600638aa3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:38:12.602 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006391ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006391ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:57002/0 (socket says 172.21.15.38:57002) 2023-11-06T13:38:12.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 -- 172.21.15.38:0/2726780286 learned_addr learned my addr 172.21.15.38:0/2726780286 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:12.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 -- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 msgr2=0x560063929d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 0x560063929d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.603 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 -- 172.21.15.38:0/2726780286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 msgr2=0x56006396b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:12.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006396b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.592+0000 7fe36dd9b700 1 -- 172.21.15.38:0/2726780286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe368014a90 con 0x5600638ea110 2023-11-06T13:38:12.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.593+0000 7fe36dd9b700 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006391ad50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fe36400ffd0 tx=0x7fe364089000).ready entity=mon.1 client_cookie=71cfdcd8c41a9eb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:12.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.593+0000 7fe34cff9700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:38:12.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.593+0000 7fe34cff9700 1 -- 172.21.15.38:0/2726780286 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364095070 con 0x5600638ea110 2023-11-06T13:38:12.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.593+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe364087790 con 0x5600638ea110 2023-11-06T13:38:12.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.593+0000 7fe34cff9700 1 -- 172.21.15.38:0/2726780286 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fe36408d070 con 0x5600638ea110 2023-11-06T13:38:12.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.600+0000 7fe34cff9700 1 -- 172.21.15.38:0/2726780286 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3640b3340 con 0x5600638ea110 2023-11-06T13:38:12.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.600+0000 7fe38628db80 10 client.5410 fetch_fsmap learned FSMap version 40 2023-11-06T13:38:12.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.600+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x560063830760 con 0x5600638ea110 2023-11-06T13:38:12.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe34cff9700 1 -- 172.21.15.38:0/2726780286 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364087790 con 0x5600638ea110 2023-11-06T13:38:12.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe34cff9700 1 -- 172.21.15.38:0/2726780286 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 40) v1 ==== 7532+0+0 (secure 0 0 0) 0x7fe364086c80 con 0x5600638ea110 2023-11-06T13:38:12.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe38628db80 10 client.5410 fetch_fsmap finished waiting for FSMap version 40 2023-11-06T13:38:12.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe38628db80 10 client.5410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:38:12.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe38628db80 20 client.5410 populate_metadata read hostname 'smithi038' 2023-11-06T13:38:12.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe38628db80 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x560063959860 0x5600639abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:12.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe38628db80 4 client.5410 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:38:12.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.604+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600636d9cf0 con 0x560063959860 2023-11-06T13:38:12.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.609+0000 7fe36e59c700 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x560063959860 0x5600639abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:12.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.609+0000 7fe34cff9700 10 client.5410 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:12.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.609+0000 7fe36e59c700 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x560063959860 0x5600639abbf0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a947e0f4b6e6df01 server_cookie=7d38fe3edc9583e7 in_seq=0 out_seq=0 2023-11-06T13:38:12.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe34cff9700 1 -- 172.21.15.38:0/2726780286 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5600636d9cf0 con 0x560063959860 2023-11-06T13:38:12.614 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe34cff9700 10 client.5410 handle_command_reply: tid=0 2023-11-06T13:38:12.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 client.5410 shutdown 2023-11-06T13:38:12.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 msgr2=0x56006391ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006391ad50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fe36400ffd0 tx=0x7fe364089000).stop 2023-11-06T13:38:12.615 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 shutdown_connections 2023-11-06T13:38:12.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x560063959860 0x5600639abbf0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56006392d8f0 0x560063929d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5600636a6e90 0x56006396b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 --2- 172.21.15.38:0/2726780286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5600638ea110 0x56006391ad50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 >> 172.21.15.38:0/2726780286 conn(0x5600637544f0 msgr2=0x5600638e45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:12.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe34cff9700 0 client.5410 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:12.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 shutdown_connections 2023-11-06T13:38:12.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.610+0000 7fe38628db80 1 -- 172.21.15.38:0/2726780286 wait complete. 2023-11-06T13:38:12.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.611+0000 7fe38628db80 20 client.5410 trim_cache size 0 max 16384 2023-11-06T13:38:12.618 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:38:12.618 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:38:12.618 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:38:12.619 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:38:12.619 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:38:12.619 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:38:12.619 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:38:12.619 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:38:12.620 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:38:12.620 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:38:12.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.615+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe35008cb40 msgr2=0x7fe35008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.615+0000 7fe3748f5700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe35008cb40 0x7fe35008f000 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fe36800e260 tx=0x7fe36800b040).stop 2023-11-06T13:38:12.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.615+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe370181b60 msgr2=0x7fe3700cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:12.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.615+0000 7fe3748f5700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe370181b60 0x7fe3700cb1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe364014000 tx=0x7fe364017000).stop 2023-11-06T13:38:12.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.616+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 shutdown_connections 2023-11-06T13:38:12.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.616+0000 7fe3748f5700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fe3701824d0 0x7fe3700cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:12.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.616+0000 7fe3748f5700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe370179880 0x7fe3701806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:12.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.616+0000 7fe3748f5700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fe35008cb40 0x7fe35008f000 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0x7fe36800e260 tx=0x7fe36800b040).stop 2023-11-06T13:38:12.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.616+0000 7fe3748f5700 1 --2- 172.21.15.38:0/1985238019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe370181b60 0x7fe3700cb1c0 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0x7fe364014000 tx=0x7fe364017000).stop 2023-11-06T13:38:12.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.616+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 >> 172.21.15.38:0/1985238019 conn(0x7fe370069ea0 msgr2=0x7fe3700c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:12.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.617+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 shutdown_connections 2023-11-06T13:38:12.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:12.617+0000 7fe3748f5700 1 -- 172.21.15.38:0/1985238019 wait complete. 2023-11-06T13:38:12.639 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:38:42.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:38:42.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.786+0000 7f7536499700 1 Processor -- start 2023-11-06T13:38:42.790 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.786+0000 7f7536499700 1 -- start start 2023-11-06T13:38:42.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.787+0000 7f7536499700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f7530175890 0x7f75300f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f7536499700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753017e250 con 0x7f753017cac0 2023-11-06T13:38:42.794 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f7536499700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753017d360 con 0x7f75300cb960 2023-11-06T13:38:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f7536499700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753017d640 con 0x7f7530175890 2023-11-06T13:38:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f7535c98700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f753017cac0 0x7f75301857a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:59526/0 (socket says 172.21.15.38:59526) 2023-11-06T13:38:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f7535c98700 1 -- 172.21.15.38:0/1824473022 learned_addr learned my addr 172.21.15.38:0/1824473022 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:38:42.795 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854319633 0 0) 0x7f753017e250 con 0x7f753017cac0 2023-11-06T13:38:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75180033f0 con 0x7f753017cac0 2023-11-06T13:38:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068987120 0 0) 0x7f753017d360 con 0x7f75300cb960 2023-11-06T13:38:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f753017e250 con 0x7f75300cb960 2023-11-06T13:38:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338640682 0 0) 0x7f75180033f0 con 0x7f753017cac0 2023-11-06T13:38:42.796 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 >> v2:172.21.15.163:3300/0 conn(0x7f7530175890 msgr2=0x7f75300f10d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:38:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 --2- 172.21.15.38:0/1824473022 >> v2:172.21.15.163:3300/0 conn(0x7f7530175890 0x7f75300f10d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 >> v1:172.21.15.163:6789/0 conn(0x7f75300cb960 legacy=0x7f753017e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753017d920 con 0x7f753017cac0 2023-11-06T13:38:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f75200017f0 con 0x7f753017cac0 2023-11-06T13:38:42.797 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 >> v1:172.21.15.38:6789/0 conn(0x7f753017cac0 legacy=0x7f75301857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7518003ac0 0x7f7518003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f7518004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518005200 0x7f751800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753017d640 con 0x7f7518004690 2023-11-06T13:38:42.798 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751800c100 con 0x7f7518005200 2023-11-06T13:38:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751800c2c0 con 0x7f7518003ac0 2023-11-06T13:38:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.788+0000 7f7534c96700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f7518004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7535c98700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518005200 0x7f751800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7534c96700 1 -- 172.21.15.38:0/1824473022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7518003ac0 msgr2=0x7f7518003ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-06T13:38:42.799 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7534c96700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7518003ac0 0x7f7518003ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:42.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7534c96700 1 -- 172.21.15.38:0/1824473022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518005200 msgr2=0x7f751800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7534c96700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7518005200 0x7f751800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7535c98700 1 -- 172.21.15.38:0/1824473022 reap_dead start 2023-11-06T13:38:42.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7534c96700 1 -- 172.21.15.38:0/1824473022 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180033f0 con 0x7f7518004690 2023-11-06T13:38:42.800 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f7534c96700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f7518004b10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7524001890 tx=0x7f7524007b90).ready entity=mon.0 client_cookie=215991c1797a8a4b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524007ea0 con 0x7f7518004690 2023-11-06T13:38:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524013410 con 0x7f7518004690 2023-11-06T13:38:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.789+0000 7f752ffff700 1 -- 172.21.15.38:0/1824473022 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240137b0 con 0x7f7518004690 2023-11-06T13:38:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 -- 172.21.15.38:0/1824473022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 msgr2=0x7f7518004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.801 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f7518004b10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7524001890 tx=0x7f7524007b90).stop 2023-11-06T13:38:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 -- 172.21.15.38:0/1824473022 shutdown_connections 2023-11-06T13:38:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 --2- 172.21.15.38:0/1824473022 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f7518004b10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 -- 172.21.15.38:0/1824473022 >> 172.21.15.38:0/1824473022 conn(0x7f75300f5d20 msgr2=0x7f75300f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:42.802 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 -- 172.21.15.38:0/1824473022 shutdown_connections 2023-11-06T13:38:42.803 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.790+0000 7f7536499700 1 -- 172.21.15.38:0/1824473022 wait complete. 2023-11-06T13:38:42.812 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.791+0000 7f7536499700 1 Processor -- start 2023-11-06T13:38:42.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.791+0000 7f7536499700 1 -- start start 2023-11-06T13:38:42.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.792+0000 7f7536499700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f75300ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.792+0000 7f7536499700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 0x7f7530062770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7536499700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f753016eed0 0x7f753016f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.813 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7536499700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300ed9c0 con 0x7f7518004690 2023-11-06T13:38:42.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7536499700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300ee340 con 0x7f75300ec5a0 2023-11-06T13:38:42.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7536499700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300ecad0 con 0x7f753016eed0 2023-11-06T13:38:42.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7535497700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f75300ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 0x7f7530062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7535497700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f75300ede50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35884/0 (socket says 172.21.15.38:35884) 2023-11-06T13:38:42.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7535c98700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f753016eed0 0x7f753016f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7535497700 1 -- 172.21.15.38:0/2771061614 learned_addr learned my addr 172.21.15.38:0/2771061614 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:42.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 0x7f7530062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:56304/0 (socket says 172.21.15.38:56304) 2023-11-06T13:38:42.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 -- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f753016eed0 msgr2=0x7f753016f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f753016eed0 0x7f753016f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 -- 172.21.15.38:0/2771061614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 msgr2=0x7f75300ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f75300ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 -- 172.21.15.38:0/2771061614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75300ecdb0 con 0x7f75300ec5a0 2023-11-06T13:38:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7535497700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f75300ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:38:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7534c96700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 0x7f7530062770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7524013000 tx=0x7f7524016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.817 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f752d7fa700 1 -- 172.21.15.38:0/2771061614 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240125c0 con 0x7f75300ec5a0 2023-11-06T13:38:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f752d7fa700 1 -- 172.21.15.38:0/2771061614 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524012720 con 0x7f75300ec5a0 2023-11-06T13:38:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75300ed090 con 0x7f75300ec5a0 2023-11-06T13:38:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.793+0000 7f752d7fa700 1 -- 172.21.15.38:0/2771061614 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524012ac0 con 0x7f75300ec5a0 2023-11-06T13:38:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.794+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75300ed650 con 0x7f75300ec5a0 2023-11-06T13:38:42.818 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.796+0000 7f752d7fa700 1 -- 172.21.15.38:0/2771061614 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f7524026440 con 0x7f75300ec5a0 2023-11-06T13:38:42.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.796+0000 7f752d7fa700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f751c08cb40 0x7f751c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.796+0000 7f752d7fa700 1 -- 172.21.15.38:0/2771061614 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f75240b2b20 con 0x7f75300ec5a0 2023-11-06T13:38:42.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.796+0000 7f7535497700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f751c08cb40 0x7f751c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.797+0000 7f7535497700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f751c08cb40 0x7f751c08f000 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7528006fd0 tx=0x7f7528006f20).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.819 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.798+0000 7f7549093b80 1 Processor -- start 2023-11-06T13:38:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.799+0000 7f7549093b80 1 -- start start 2023-11-06T13:38:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7549093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f7074b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7549093b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f70f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7549093b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f70fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.820 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7549093b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f68bfd0 con 0x55f24f70f7f0 2023-11-06T13:38:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7549093b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f603240 con 0x55f24f7079a0 2023-11-06T13:38:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7549093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f618490 con 0x55f24f482e90 2023-11-06T13:38:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f70fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.821 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535497700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f7074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f70fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35890/0 (socket says 172.21.15.38:35890) 2023-11-06T13:38:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7534c96700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f70f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 -- 172.21.15.38:0/2256787414 learned_addr learned my addr 172.21.15.38:0/2256787414 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 -- 172.21.15.38:0/2256787414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 msgr2=0x55f24f7074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.822 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f7074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 -- 172.21.15.38:0/2256787414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 msgr2=0x55f24f70f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f70f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 -- 172.21.15.38:0/2256787414 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f24f611670 con 0x55f24f70f7f0 2023-11-06T13:38:42.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7534c96700 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f70f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:38:42.823 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f7535c98700 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f70fc70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7520007fd0 tx=0x7f7520007f20).ready entity=mon.0 client_cookie=ebaf55415952ed53 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f75167fc700 1 -- 172.21.15.38:0/2256787414 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520004fd0 con 0x55f24f70f7f0 2023-11-06T13:38:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f75167fc700 1 -- 172.21.15.38:0/2256787414 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520005130 con 0x55f24f70f7f0 2023-11-06T13:38:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.800+0000 7f75167fc700 1 -- 172.21.15.38:0/2256787414 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200054b0 con 0x55f24f70f7f0 2023-11-06T13:38:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 -- 172.21.15.38:0/2256787414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 msgr2=0x55f24f70fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.824 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f70fc70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7520007fd0 tx=0x7f7520007f20).stop 2023-11-06T13:38:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 -- 172.21.15.38:0/2256787414 shutdown_connections 2023-11-06T13:38:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f70fc70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f7074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 --2- 172.21.15.38:0/2256787414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f70f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.825 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 -- 172.21.15.38:0/2256787414 >> 172.21.15.38:0/2256787414 conn(0x55f24f5304f0 msgr2=0x55f24f6c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 -- 172.21.15.38:0/2256787414 shutdown_connections 2023-11-06T13:38:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.801+0000 7f7549093b80 1 -- 172.21.15.38:0/2256787414 wait complete. 2023-11-06T13:38:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.802+0000 7f7549093b80 1 -- start start 2023-11-06T13:38:42.826 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.802+0000 7f7549093b80 1 Processor -- start 2023-11-06T13:38:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 0x55f24f6c1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f704bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f70f7f0 0x55f24f702430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f6185d0 con 0x55f24f482e90 2023-11-06T13:38:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f618850 con 0x55f24f7079a0 2023-11-06T13:38:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f5e3e60 con 0x55f24f70f7f0 2023-11-06T13:38:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 10 client.0 ll_register_callbacks cb 0x55f24f6865b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:38:42.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 0x55f24f6c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 0x55f24f6c1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35902/0 (socket says 172.21.15.38:35902) 2023-11-06T13:38:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 -- 172.21.15.38:0/3227005061 learned_addr learned my addr 172.21.15.38:0/3227005061 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7534c96700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f704bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535c98700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f70f7f0 0x55f24f702430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 -- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f70f7f0 msgr2=0x55f24f702430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f70f7f0 0x55f24f702430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 -- 172.21.15.38:0/3227005061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 msgr2=0x55f24f704bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f704bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 -- 172.21.15.38:0/3227005061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75300ed650 con 0x55f24f482e90 2023-11-06T13:38:42.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7534c96700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f704bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:38:42.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7535497700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 0x55f24f6c1690 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f7528013b30 tx=0x7f7528012000).ready entity=mon.0 client_cookie=4d967942ed8dac8d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f750f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:38:42.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f750f7fe700 1 -- 172.21.15.38:0/3227005061 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75280116b0 con 0x55f24f482e90 2023-11-06T13:38:42.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f24f6ba690 con 0x55f24f482e90 2023-11-06T13:38:42.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.804+0000 7f750f7fe700 1 -- 172.21.15.38:0/3227005061 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f7528011810 con 0x55f24f482e90 2023-11-06T13:38:42.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f750f7fe700 1 -- 172.21.15.38:0/3227005061 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7528011be0 con 0x55f24f482e90 2023-11-06T13:38:42.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 10 client.5592 fetch_fsmap learned FSMap version 40 2023-11-06T13:38:42.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7f753017d920 con 0x55f24f482e90 2023-11-06T13:38:42.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f750f7fe700 1 -- 172.21.15.38:0/3227005061 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f24f6ba690 con 0x55f24f482e90 2023-11-06T13:38:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f750f7fe700 1 -- 172.21.15.38:0/3227005061 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 40) v1 ==== 7532+0+0 (secure 0 0 0) 0x7f752801e070 con 0x55f24f482e90 2023-11-06T13:38:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 10 client.5592 fetch_fsmap finished waiting for FSMap version 40 2023-11-06T13:38:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 10 client.5592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:38:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 20 client.5592 populate_metadata read hostname 'smithi038' 2023-11-06T13:38:42.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c4630 0x55f24f6c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 4 client.5592 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:38:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f24f47ecf0 con 0x55f24f6c4630 2023-11-06T13:38:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.805+0000 7f7534c96700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c4630 0x55f24f6c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.806+0000 7f750f7fe700 10 client.5592 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:42.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.806+0000 7f7534c96700 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c4630 0x55f24f6c4a40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=302ea92b4e0eddcc server_cookie=27f25a2d1033c448 in_seq=0 out_seq=0 2023-11-06T13:38:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.806+0000 7f750f7fe700 1 -- 172.21.15.38:0/3227005061 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55f24f47ecf0 con 0x55f24f6c4630 2023-11-06T13:38:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.806+0000 7f750f7fe700 10 client.5592 handle_command_reply: tid=0 2023-11-06T13:38:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.806+0000 7f7549093b80 1 client.5592 shutdown 2023-11-06T13:38:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 msgr2=0x55f24f6c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 0x55f24f6c1690 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f7528013b30 tx=0x7f7528012000).stop 2023-11-06T13:38:42.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 shutdown_connections 2023-11-06T13:38:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c4630 0x55f24f6c4a40 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f70f7f0 0x55f24f702430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f482e90 0x55f24f6c1690 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 --2- 172.21.15.38:0/3227005061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f704bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f750f7fe700 0 client.5592 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:42.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 >> 172.21.15.38:0/3227005061 conn(0x55f24f5304f0 msgr2=0x55f24f6c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:42.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 shutdown_connections 2023-11-06T13:38:42.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 1 -- 172.21.15.38:0/3227005061 wait complete. 2023-11-06T13:38:42.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.807+0000 7f7549093b80 20 client.5592 trim_cache size 0 max 16384 2023-11-06T13:38:42.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.824+0000 7f7549093b80 1 Processor -- start 2023-11-06T13:38:42.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.824+0000 7f7549093b80 1 -- start start 2023-11-06T13:38:42.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7549093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f70f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7549093b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f6c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7549093b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f6c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7549093b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f6c6c60 con 0x55f24f70f7f0 2023-11-06T13:38:42.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7549093b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f72d360 con 0x55f24f7079a0 2023-11-06T13:38:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7549093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f7029f0 con 0x55f24f482e90 2023-11-06T13:38:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7535c98700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f6c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7535c98700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f6c0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35916/0 (socket says 172.21.15.38:35916) 2023-11-06T13:38:42.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7535c98700 1 -- 172.21.15.38:0/1759834007 learned_addr learned my addr 172.21.15.38:0/1759834007 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7535497700 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f70f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.825+0000 7f7534c96700 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f6c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7535c98700 1 -- 172.21.15.38:0/1759834007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 msgr2=0x55f24f70f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7535c98700 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f70f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7535c98700 1 -- 172.21.15.38:0/1759834007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 msgr2=0x55f24f6c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7535c98700 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f6c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7535c98700 1 -- 172.21.15.38:0/1759834007 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f24f60ca10 con 0x55f24f70f7f0 2023-11-06T13:38:42.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7535c98700 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f6c0760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f7520000f80 tx=0x7f7520018000).ready entity=mon.0 client_cookie=e6de0f27ddf556dd server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7516ffd700 1 -- 172.21.15.38:0/1759834007 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520027030 con 0x55f24f70f7f0 2023-11-06T13:38:42.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7516ffd700 1 -- 172.21.15.38:0/1759834007 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520001420 con 0x55f24f70f7f0 2023-11-06T13:38:42.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.826+0000 7f7516ffd700 1 -- 172.21.15.38:0/1759834007 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520001b10 con 0x55f24f70f7f0 2023-11-06T13:38:42.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 -- 172.21.15.38:0/1759834007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 msgr2=0x55f24f6c0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f6c0760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f7520000f80 tx=0x7f7520018000).stop 2023-11-06T13:38:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 -- 172.21.15.38:0/1759834007 shutdown_connections 2023-11-06T13:38:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f70f7f0 0x55f24f6c0760 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f70f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 --2- 172.21.15.38:0/1759834007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f7079a0 0x55f24f6c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 -- 172.21.15.38:0/1759834007 >> 172.21.15.38:0/1759834007 conn(0x55f24f5304f0 msgr2=0x55f24f6bdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 -- 172.21.15.38:0/1759834007 shutdown_connections 2023-11-06T13:38:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 -- 172.21.15.38:0/1759834007 wait complete. 2023-11-06T13:38:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.827+0000 7f7549093b80 1 -- start start 2023-11-06T13:38:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.828+0000 7f7549093b80 1 Processor -- start 2023-11-06T13:38:42.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f6c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 0x55f24f79e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f70f7f0 0x55f24f7360e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f70d660 con 0x55f24f7079a0 2023-11-06T13:38:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f70dac0 con 0x55f24f70f7f0 2023-11-06T13:38:42.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24f79e450 con 0x55f24f482e90 2023-11-06T13:38:42.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7549093b80 10 client.0 ll_register_callbacks cb 0x55f24f6865b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:38:42.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7534c96700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 0x55f24f79e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7534c96700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 0x55f24f79e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:35928/0 (socket says 172.21.15.38:35928) 2023-11-06T13:38:42.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.829+0000 7f7534c96700 1 -- 172.21.15.38:0/1196906064 learned_addr learned my addr 172.21.15.38:0/1196906064 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:38:42.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7535c98700 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f70f7f0 0x55f24f7360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7534c96700 1 -- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 msgr2=0x55f24f6c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7534c96700 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f6c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:42.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7534c96700 1 -- 172.21.15.38:0/1196906064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f70f7f0 msgr2=0x55f24f7360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:38:42.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7534c96700 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f70f7f0 0x55f24f7360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7534c96700 1 -- 172.21.15.38:0/1196906064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f24f611670 con 0x55f24f7079a0 2023-11-06T13:38:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7534c96700 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 0x55f24f79e8e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f7524086aa0 tx=0x7f7524003040).ready entity=mon.0 client_cookie=963dd62a927a0d70 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:38:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f750f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:38:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f750f7fe700 1 -- 172.21.15.38:0/1196906064 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524091040 con 0x55f24f7079a0 2023-11-06T13:38:42.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f750f7fe700 1 -- 172.21.15.38:0/1196906064 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f7524058040 con 0x55f24f7079a0 2023-11-06T13:38:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.830+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f24f70edf0 con 0x55f24f7079a0 2023-11-06T13:38:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f750f7fe700 1 -- 172.21.15.38:0/1196906064 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75240862e0 con 0x55f24f7079a0 2023-11-06T13:38:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 10 client.5598 fetch_fsmap learned FSMap version 40 2023-11-06T13:38:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55f24f60c760 con 0x55f24f7079a0 2023-11-06T13:38:42.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f750f7fe700 1 -- 172.21.15.38:0/1196906064 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f24f70edf0 con 0x55f24f7079a0 2023-11-06T13:38:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f750f7fe700 1 -- 172.21.15.38:0/1196906064 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 40) v1 ==== 7532+0+0 (secure 0 0 0) 0x7f752408c240 con 0x55f24f7079a0 2023-11-06T13:38:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 10 client.5598 fetch_fsmap finished waiting for FSMap version 40 2023-11-06T13:38:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 10 client.5598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:38:42.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 20 client.5598 populate_metadata read hostname 'smithi038' 2023-11-06T13:38:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c35a0 0x55f24f739680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:38:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 4 client.5598 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:38:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7520005130 con 0x55f24f6c35a0 2023-11-06T13:38:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.831+0000 7f7535497700 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c35a0 0x55f24f739680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:38:42.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f7535497700 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c35a0 0x55f24f739680 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f56e921306b9c061 server_cookie=6166f0ebd50cd96 in_seq=0 out_seq=0 2023-11-06T13:38:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f750f7fe700 10 client.5598 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f750f7fe700 1 -- 172.21.15.38:0/1196906064 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f7520005130 con 0x55f24f6c35a0 2023-11-06T13:38:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f750f7fe700 10 client.5598 handle_command_reply: tid=0 2023-11-06T13:38:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f7549093b80 1 client.5598 shutdown 2023-11-06T13:38:42.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 msgr2=0x55f24f79e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.832+0000 7f7549093b80 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 0x55f24f79e8e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f7524086aa0 tx=0x7f7524003040).stop 2023-11-06T13:38:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.833+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 shutdown_connections 2023-11-06T13:38:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.833+0000 7f7549093b80 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f24f70f7f0 0x55f24f7360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.833+0000 7f7549093b80 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55f24f6c35a0 0x55f24f739680 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.833+0000 7f7549093b80 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55f24f482e90 0x55f24f6c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:38:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.833+0000 7f7549093b80 1 --2- 172.21.15.38:0/1196906064 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55f24f7079a0 0x55f24f79e8e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.833+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 >> 172.21.15.38:0/1196906064 conn(0x55f24f5304f0 msgr2=0x55f24f70f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.834+0000 7f750f7fe700 0 client.5598 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:38:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.834+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 shutdown_connections 2023-11-06T13:38:42.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.835+0000 7f7549093b80 1 -- 172.21.15.38:0/1196906064 wait complete. 2023-11-06T13:38:42.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.835+0000 7f7549093b80 20 client.5598 trim_cache size 0 max 16384 2023-11-06T13:38:42.867 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:38:42.867 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:38:42.868 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:38:42.868 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:38:42.868 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:38:42.868 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:38:42.868 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:38:42.869 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:38:42.869 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:38:42.869 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:38:42.870 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f751c08cb40 msgr2=0x7f751c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f751c08cb40 0x7f751c08f000 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f7528006fd0 tx=0x7f7528006f20).stop 2023-11-06T13:38:42.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 msgr2=0x7f7530062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:38:42.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 0x7f7530062770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7524013000 tx=0x7f7524016000).stop 2023-11-06T13:38:42.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 shutdown_connections 2023-11-06T13:38:42.871 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f753016eed0 0x7f753016f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7518004690 0x7f75300ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f751c08cb40 0x7f751c08f000 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 --2- 172.21.15.38:0/2771061614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75300ec5a0 0x7f7530062770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:38:42.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 >> 172.21.15.38:0/2771061614 conn(0x7f75300f5d20 msgr2=0x7f753016f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:38:42.872 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 shutdown_connections 2023-11-06T13:38:42.873 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:38:42.836+0000 7f7536499700 1 -- 172.21.15.38:0/2771061614 wait complete. 2023-11-06T13:38:42.873 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:39:04.043 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:39:04.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:39:04.049 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:39:04.103 INFO:tasks.ceph.mds.b.smithi044.stderr:2023-11-06T13:39:04.099+0000 7f78e606e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126082) UID: 0 2023-11-06T13:39:04.104 INFO:tasks.ceph.mds.e.smithi044.stderr:2023-11-06T13:39:04.099+0000 7f40d0fc0700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126082) UID: 0 2023-11-06T13:39:04.105 INFO:tasks.ceph.mds.k.smithi044.stderr:2023-11-06T13:39:04.099+0000 7f59d53bd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126082) UID: 0 2023-11-06T13:39:04.105 INFO:tasks.ceph.mds.h.smithi044.stderr:2023-11-06T13:39:04.099+0000 7f4afec67700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126082) UID: 0 2023-11-06T13:39:04.733 INFO:tasks.ceph.mds.c.smithi163.stderr:2023-11-06T13:39:04.729+0000 7f44a0d8d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95893) UID: 0 2023-11-06T13:39:04.734 INFO:tasks.ceph.mds.f.smithi163.stderr:2023-11-06T13:39:04.729+0000 7ffabe90f700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95893) UID: 0 2023-11-06T13:39:04.734 INFO:tasks.ceph.mds.l.smithi163.stderr:2023-11-06T13:39:04.730+0000 7f2dabb63700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95893) UID: 0 2023-11-06T13:39:04.735 INFO:tasks.ceph.mds.i.smithi163.stderr:2023-11-06T13:39:04.732+0000 7f68ea7a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 95893) UID: 0 2023-11-06T13:39:12.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:39:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.994+0000 7f9b14f78700 1 Processor -- start 2023-11-06T13:39:12.998 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.994+0000 7f9b14f78700 1 -- start start 2023-11-06T13:39:13.000 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b14f78700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b1017dfd0 0x7f9b1017e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b14f78700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1017b340 con 0x7f9b10173620 2023-11-06T13:39:13.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b14f78700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1017a770 con 0x7f9b10173240 2023-11-06T13:39:13.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b14f78700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b10173a80 con 0x7f9b1017dfd0 2023-11-06T13:39:13.001 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b0ffff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b1017dfd0 0x7f9b1017e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b0effd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9b10173620 0x7f9b1017bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:59820/0 (socket says 172.21.15.38:59820) 2023-11-06T13:39:13.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b0effd700 1 -- 172.21.15.38:0/3920669170 learned_addr learned my addr 172.21.15.38:0/3920669170 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:39:13.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.995+0000 7f9b0f7fe700 1 --1- 172.21.15.38:0/3920669170 >> v1:172.21.15.163:6789/0 conn(0x7f9b10173240 0x7f9b1017b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:39458/0 (socket says 172.21.15.38:39458) 2023-11-06T13:39:13.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0e7fc700 1 -- 172.21.15.38:0/3920669170 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722417443 0 0) 0x7f9b1017a770 con 0x7f9b10173240 2023-11-06T13:39:13.002 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0e7fc700 1 -- 172.21.15.38:0/3920669170 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af80033f0 con 0x7f9b10173240 2023-11-06T13:39:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0ffff700 1 -- 172.21.15.38:0/3920669170 >> v1:172.21.15.163:6789/0 conn(0x7f9b10173240 legacy=0x7f9b1017b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0e7fc700 1 -- 172.21.15.38:0/3920669170 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758425063 0 0) 0x7f9b1017b340 con 0x7f9b10173620 2023-11-06T13:39:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0ffff700 1 -- 172.21.15.38:0/3920669170 >> v1:172.21.15.44:6789/0 conn(0x7f9b10173620 legacy=0x7f9b1017bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0ffff700 1 -- 172.21.15.38:0/3920669170 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1017aa10 con 0x7f9b1017dfd0 2023-11-06T13:39:13.003 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0ffff700 1 --2- 172.21.15.38:0/3920669170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b1017e460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9b08009e60 tx=0x7f9b08009780).ready entity=mon.1 client_cookie=6b165cabe5e483cf server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0e7fc700 1 -- 172.21.15.38:0/3920669170 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800e070 con 0x7f9b1017dfd0 2023-11-06T13:39:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0e7fc700 1 -- 172.21.15.38:0/3920669170 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800bb60 con 0x7f9b1017dfd0 2023-11-06T13:39:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b0e7fc700 1 -- 172.21.15.38:0/3920669170 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800bee0 con 0x7f9b1017dfd0 2023-11-06T13:39:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b14f78700 1 -- 172.21.15.38:0/3920669170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 msgr2=0x7f9b1017e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.004 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.996+0000 7f9b14f78700 1 --2- 172.21.15.38:0/3920669170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b1017e460 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9b08009e60 tx=0x7f9b08009780).stop 2023-11-06T13:39:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.997+0000 7f9b14f78700 1 -- 172.21.15.38:0/3920669170 shutdown_connections 2023-11-06T13:39:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.997+0000 7f9b14f78700 1 --2- 172.21.15.38:0/3920669170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b1017e460 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.005 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.997+0000 7f9b14f78700 1 -- 172.21.15.38:0/3920669170 >> 172.21.15.38:0/3920669170 conn(0x7f9b100efab0 msgr2=0x7f9b100efec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:13.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.997+0000 7f9b14f78700 1 -- 172.21.15.38:0/3920669170 shutdown_connections 2023-11-06T13:39:13.006 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.997+0000 7f9b14f78700 1 -- 172.21.15.38:0/3920669170 wait complete. 2023-11-06T13:39:13.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.998+0000 7f9b14f78700 1 Processor -- start 2023-11-06T13:39:13.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.998+0000 7f9b14f78700 1 -- start start 2023-11-06T13:39:13.011 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b14f78700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 0x7f9b10069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b14f78700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b10173620 0x7f9b100c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b14f78700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b101726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b14f78700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10181d90 con 0x7f9b10173240 2023-11-06T13:39:13.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b14f78700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10183320 con 0x7f9b1017dfd0 2023-11-06T13:39:13.012 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b14f78700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b10182e90 con 0x7f9b10173620 2023-11-06T13:39:13.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 0x7f9b10069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 0x7f9b10069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55044/0 (socket says 172.21.15.38:55044) 2023-11-06T13:39:13.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/753164694 learned_addr learned my addr 172.21.15.38:0/753164694 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:13.013 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b0ffff700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b101726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:12.999+0000 7f9b0effd700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b10173620 0x7f9b100c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b10173620 msgr2=0x7f9b100c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b10173620 0x7f9b100c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/753164694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 msgr2=0x7f9b101726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.014 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b101726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/753164694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009a20 con 0x7f9b10173240 2023-11-06T13:39:13.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 0x7f9b10069be0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f9b0400c420 tx=0x7f9b04007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.015 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9af77fe700 1 -- 172.21.15.38:0/753164694 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b040070d0 con 0x7f9b10173240 2023-11-06T13:39:13.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9af77fe700 1 -- 172.21.15.38:0/753164694 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04007230 con 0x7f9b10173240 2023-11-06T13:39:13.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b10181fa0 con 0x7f9b10173240 2023-11-06T13:39:13.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9af77fe700 1 -- 172.21.15.38:0/753164694 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b040056e0 con 0x7f9b10173240 2023-11-06T13:39:13.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.000+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b10182560 con 0x7f9b10173240 2023-11-06T13:39:13.016 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.002+0000 7f9af77fe700 1 -- 172.21.15.38:0/753164694 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f9b04005b10 con 0x7f9b10173240 2023-11-06T13:39:13.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.002+0000 7f9af77fe700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9afc08cb40 0x7f9afc08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.003+0000 7f9af77fe700 1 -- 172.21.15.38:0/753164694 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b040b1590 con 0x7f9b10173240 2023-11-06T13:39:13.017 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.003+0000 7f9b0effd700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9afc08cb40 0x7f9afc08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.003+0000 7f9b0effd700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9afc08cb40 0x7f9afc08f000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9b100e9cc0 tx=0x7f9b00007bb0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.004+0000 7f9b27b72b80 1 Processor -- start 2023-11-06T13:39:13.018 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.004+0000 7f9b27b72b80 1 -- start start 2023-11-06T13:39:13.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea01e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebea01ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9f9afd0 con 0x55ebe9d91e90 2023-11-06T13:39:13.019 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9f12240 con 0x55ebea0169a0 2023-11-06T13:39:13.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9f27490 con 0x55ebea01e7f0 2023-11-06T13:39:13.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0164b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55050/0 (socket says 172.21.15.38:55050) 2023-11-06T13:39:13.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/360511453 learned_addr learned my addr 172.21.15.38:0/360511453 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:13.020 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b0effd700 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea01e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b0ffff700 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebea01ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.005+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/360511453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 msgr2=0x55ebea01ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebea01ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.021 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/360511453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 msgr2=0x55ebea01e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea01e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/360511453 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebe9f20670 con 0x55ebe9d91e90 2023-11-06T13:39:13.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0164b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f9b040853a0 tx=0x7f9b040079f0).ready entity=mon.0 client_cookie=8b2f542673c060f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9af4ff9700 1 -- 172.21.15.38:0/360511453 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b040b1360 con 0x55ebe9d91e90 2023-11-06T13:39:13.022 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9af4ff9700 1 -- 172.21.15.38:0/360511453 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0408b0c0 con 0x55ebe9d91e90 2023-11-06T13:39:13.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9af4ff9700 1 -- 172.21.15.38:0/360511453 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04007d10 con 0x55ebe9d91e90 2023-11-06T13:39:13.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 -- 172.21.15.38:0/360511453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 msgr2=0x55ebea0164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0164b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f9b040853a0 tx=0x7f9b040079f0).stop 2023-11-06T13:39:13.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 -- 172.21.15.38:0/360511453 shutdown_connections 2023-11-06T13:39:13.023 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebea01ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0164b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/360511453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea01e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.006+0000 7f9b27b72b80 1 -- 172.21.15.38:0/360511453 >> 172.21.15.38:0/360511453 conn(0x55ebe9e3f4f0 msgr2=0x55ebe9fd56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:13.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.007+0000 7f9b27b72b80 1 -- 172.21.15.38:0/360511453 shutdown_connections 2023-11-06T13:39:13.024 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.007+0000 7f9b27b72b80 1 -- 172.21.15.38:0/360511453 wait complete. 2023-11-06T13:39:13.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.007+0000 7f9b27b72b80 1 -- start start 2023-11-06T13:39:13.025 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.007+0000 7f9b27b72b80 1 Processor -- start 2023-11-06T13:39:13.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.008+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebe9d91e90 0x55ebea040150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.008+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.029 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.008+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.008+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9f275d0 con 0x55ebea01e7f0 2023-11-06T13:39:13.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.008+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9f27850 con 0x55ebea0169a0 2023-11-06T13:39:13.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.008+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9ef2e60 con 0x55ebe9d91e90 2023-11-06T13:39:13.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b27b72b80 10 client.0 ll_register_callbacks cb 0x55ebe9f955b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:39:13.030 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebe9d91e90 0x55ebea040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0effd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55052/0 (socket says 172.21.15.38:55052) 2023-11-06T13:39:13.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0ffff700 1 -- 172.21.15.38:0/2239849842 learned_addr learned my addr 172.21.15.38:0/2239849842 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:13.031 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2239849842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 msgr2=0x55ebea00f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2239849842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 msgr2=0x55ebe9fd0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.032 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2239849842 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b10182560 con 0x55ebe9d91e90 2023-11-06T13:39:13.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0ffff700 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:39:13.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebe9d91e90 0x55ebea040150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f9b04081c90 tx=0x7f9b0408c000).ready entity=mon.2 client_cookie=7a1b5353c78bd7c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9aedffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:39:13.033 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9aedffb700 1 -- 172.21.15.38:0/2239849842 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04094070 con 0x55ebe9d91e90 2023-11-06T13:39:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebe9fc9690 con 0x55ebe9d91e90 2023-11-06T13:39:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9aedffb700 1 -- 172.21.15.38:0/2239849842 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b040857e0 con 0x55ebe9d91e90 2023-11-06T13:39:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9aedffb700 1 -- 172.21.15.38:0/2239849842 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b04010300 con 0x55ebe9d91e90 2023-11-06T13:39:13.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b27b72b80 10 client.5474 fetch_fsmap learned FSMap version 41 2023-11-06T13:39:13.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.009+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55ebe9f1ba10 con 0x55ebe9d91e90 2023-11-06T13:39:13.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9aedffb700 1 -- 172.21.15.38:0/2239849842 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ebe9fc9690 con 0x55ebe9d91e90 2023-11-06T13:39:13.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9aedffb700 1 -- 172.21.15.38:0/2239849842 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 41) v1 ==== 7536+0+0 (secure 0 0 0) 0x7f9b04097030 con 0x55ebe9d91e90 2023-11-06T13:39:13.035 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b27b72b80 10 client.5474 fetch_fsmap finished waiting for FSMap version 41 2023-11-06T13:39:13.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b27b72b80 10 client.5474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:39:13.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b27b72b80 20 client.5474 populate_metadata read hostname 'smithi038' 2023-11-06T13:39:13.036 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebea0408a0 0x55ebea010e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b27b72b80 4 client.5474 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:39:13.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebe9d8dcf0 con 0x55ebea0408a0 2023-11-06T13:39:13.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b0effd700 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebea0408a0 0x55ebea010e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9aedffb700 10 client.5474 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:13.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.010+0000 7f9b0effd700 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebea0408a0 0x55ebea010e90 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8eaf864d1078559 server_cookie=43f4c74b66be48fb in_seq=0 out_seq=0 2023-11-06T13:39:13.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9aedffb700 1 -- 172.21.15.38:0/2239849842 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55ebe9d8dcf0 con 0x55ebea0408a0 2023-11-06T13:39:13.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9aedffb700 10 client.5474 handle_command_reply: tid=0 2023-11-06T13:39:13.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 client.5474 shutdown 2023-11-06T13:39:13.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebe9d91e90 msgr2=0x55ebea040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebe9d91e90 0x55ebea040150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f9b04081c90 tx=0x7f9b0408c000).stop 2023-11-06T13:39:13.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 shutdown_connections 2023-11-06T13:39:13.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebea0408a0 0x55ebea010e90 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebe9d91e90 0x55ebea040150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2239849842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9aedffb700 0 client.5474 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:13.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 >> 172.21.15.38:0/2239849842 conn(0x55ebe9e3f4f0 msgr2=0x55ebea012290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:13.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 shutdown_connections 2023-11-06T13:39:13.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2239849842 wait complete. 2023-11-06T13:39:13.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.011+0000 7f9b27b72b80 20 client.5474 trim_cache size 0 max 16384 2023-11-06T13:39:13.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.028+0000 7f9b27b72b80 1 Processor -- start 2023-11-06T13:39:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.028+0000 7f9b27b72b80 1 -- start start 2023-11-06T13:39:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebea09b2e0 con 0x55ebe9d91e90 2023-11-06T13:39:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebea040410 con 0x55ebea0169a0 2023-11-06T13:39:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebea040130 con 0x55ebea01e7f0 2023-11-06T13:39:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55058/0 (socket says 172.21.15.38:55058) 2023-11-06T13:39:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2622605235 learned_addr learned my addr 172.21.15.38:0/2622605235 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0effd700 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0ffff700 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2622605235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 msgr2=0x55ebe9fd5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2622605235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 msgr2=0x55ebea00eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/2622605235 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebe9f1b760 con 0x55ebe9d91e90 2023-11-06T13:39:13.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.029+0000 7f9b0effd700 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:39:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0411f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f9b04082200 tx=0x7f9b04094000).ready entity=mon.0 client_cookie=8b5014b8bfc2c146 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9af57fa700 1 -- 172.21.15.38:0/2622605235 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b040b1360 con 0x55ebe9d91e90 2023-11-06T13:39:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9af57fa700 1 -- 172.21.15.38:0/2622605235 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b040857e0 con 0x55ebe9d91e90 2023-11-06T13:39:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9af57fa700 1 -- 172.21.15.38:0/2622605235 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04005dc0 con 0x55ebe9d91e90 2023-11-06T13:39:13.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2622605235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 msgr2=0x55ebea0411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0411f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f9b04082200 tx=0x7f9b04094000).stop 2023-11-06T13:39:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2622605235 shutdown_connections 2023-11-06T13:39:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea01e7f0 0x55ebe9fd5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea0411f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/2622605235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea0169a0 0x55ebea00eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2622605235 >> 172.21.15.38:0/2622605235 conn(0x55ebe9e3f4f0 msgr2=0x55ebe9fd15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2622605235 shutdown_connections 2023-11-06T13:39:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.030+0000 7f9b27b72b80 1 -- 172.21.15.38:0/2622605235 wait complete. 2023-11-06T13:39:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.031+0000 7f9b27b72b80 1 -- start start 2023-11-06T13:39:13.053 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.031+0000 7f9b27b72b80 1 Processor -- start 2023-11-06T13:39:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea015430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea0169a0 0x55ebe9fd46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea01e7f0 0x55ebea0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.054 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebea0accb0 con 0x55ebe9d91e90 2023-11-06T13:39:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9fd4bb0 con 0x55ebea01e7f0 2023-11-06T13:39:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebe9fd3430 con 0x55ebea0169a0 2023-11-06T13:39:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b27b72b80 10 client.0 ll_register_callbacks cb 0x55ebe9f955b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:39:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.032+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea015430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.055 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea015430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55060/0 (socket says 172.21.15.38:55060) 2023-11-06T13:39:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea0169a0 0x55ebe9fd46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/3205915381 learned_addr learned my addr 172.21.15.38:0/3205915381 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0ffff700 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea01e7f0 0x55ebea0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea0169a0 msgr2=0x55ebe9fd46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.056 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea0169a0 0x55ebe9fd46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/3205915381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea01e7f0 msgr2=0x55ebea0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea01e7f0 0x55ebea0999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 -- 172.21.15.38:0/3205915381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00001820 con 0x55ebe9d91e90 2023-11-06T13:39:13.057 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b0f7fe700 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea015430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f9b0400ca10 tx=0x7f9b0409e000).ready entity=mon.0 client_cookie=f3214540ce121351 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9aedffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:39:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9aedffb700 1 -- 172.21.15.38:0/3205915381 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04094040 con 0x55ebe9d91e90 2023-11-06T13:39:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9aedffb700 1 -- 172.21.15.38:0/3205915381 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b04010510 con 0x55ebe9d91e90 2023-11-06T13:39:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b0408b0c0 con 0x55ebe9d91e90 2023-11-06T13:39:13.058 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9aedffb700 1 -- 172.21.15.38:0/3205915381 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b04084cd0 con 0x55ebe9d91e90 2023-11-06T13:39:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b27b72b80 10 client.5613 fetch_fsmap learned FSMap version 41 2023-11-06T13:39:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x55ebe9f1ba10 con 0x55ebe9d91e90 2023-11-06T13:39:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.033+0000 7f9aedffb700 1 -- 172.21.15.38:0/3205915381 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0405b020 con 0x55ebe9d91e90 2023-11-06T13:39:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9aedffb700 1 -- 172.21.15.38:0/3205915381 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 41) v1 ==== 7536+0+0 (secure 0 0 0) 0x7f9b04097070 con 0x55ebe9d91e90 2023-11-06T13:39:13.059 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 10 client.5613 fetch_fsmap finished waiting for FSMap version 41 2023-11-06T13:39:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 10 client.5613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:39:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 20 client.5613 populate_metadata read hostname 'smithi038' 2023-11-06T13:39:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebe9fd2070 0x55ebea03de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 4 client.5613 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:39:13.060 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ebe9dc4cf0 con 0x55ebe9fd2070 2023-11-06T13:39:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b0effd700 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebe9fd2070 0x55ebea03de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9aedffb700 10 client.5613 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b0effd700 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebe9fd2070 0x55ebea03de40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=35075db01912de91 server_cookie=9bc8c5734515993a in_seq=0 out_seq=0 2023-11-06T13:39:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9aedffb700 1 -- 172.21.15.38:0/3205915381 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ebe9dc4cf0 con 0x55ebe9fd2070 2023-11-06T13:39:13.061 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9aedffb700 10 client.5613 handle_command_reply: tid=0 2023-11-06T13:39:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 1 client.5613 shutdown 2023-11-06T13:39:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.034+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 msgr2=0x55ebea015430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea015430 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f9b0400ca10 tx=0x7f9b0409e000).stop 2023-11-06T13:39:13.062 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 shutdown_connections 2023-11-06T13:39:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ebea01e7f0 0x55ebea0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ebe9d91e90 0x55ebea015430 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ebe9fd2070 0x55ebea03de40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 --2- 172.21.15.38:0/3205915381 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ebea0169a0 0x55ebe9fd46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.063 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9aedffb700 0 client.5613 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 >> 172.21.15.38:0/3205915381 conn(0x55ebe9e3f4f0 msgr2=0x55ebea0194d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 shutdown_connections 2023-11-06T13:39:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 1 -- 172.21.15.38:0/3205915381 wait complete. 2023-11-06T13:39:13.064 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b27b72b80 20 client.5613 trim_cache size 0 max 16384 2023-11-06T13:39:13.065 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:39:13.065 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:39:13.065 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:39:13.065 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:39:13.066 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:39:13.066 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:39:13.066 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:39:13.066 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:39:13.067 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:39:13.067 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:39:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9afc08cb40 msgr2=0x7f9afc08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9afc08cb40 0x7f9afc08f000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9b100e9cc0 tx=0x7f9b00007bb0).stop 2023-11-06T13:39:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 msgr2=0x7f9b10069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:13.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 0x7f9b10069be0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f9b0400c420 tx=0x7f9b04007c80).stop 2023-11-06T13:39:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 shutdown_connections 2023-11-06T13:39:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9afc08cb40 0x7f9afc08f000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b1017dfd0 0x7f9b101726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b10173240 0x7f9b10069be0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 --2- 172.21.15.38:0/753164694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b10173620 0x7f9b100c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 >> 172.21.15.38:0/753164694 conn(0x7f9b100efab0 msgr2=0x7f9b1006a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 shutdown_connections 2023-11-06T13:39:13.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:13.035+0000 7f9b14f78700 1 -- 172.21.15.38:0/753164694 wait complete. 2023-11-06T13:39:13.071 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:39:43.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:39:43.231 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.228+0000 7f5b5e5d3700 1 Processor -- start 2023-11-06T13:39:43.232 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.228+0000 7f5b5e5d3700 1 -- start start 2023-11-06T13:39:43.233 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5e5d3700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f5b580ed110 0x7f5b58182af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5e5d3700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f5b58180730 0x7f5b5817eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5e5d3700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b580ee5c0 con 0x7f5b58178b60 2023-11-06T13:39:43.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5e5d3700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b58182fe0 con 0x7f5b58180730 2023-11-06T13:39:43.234 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5e5d3700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b580ed6d0 con 0x7f5b580ed110 2023-11-06T13:39:43.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5d5d1700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f5b58178b60 0x7f5b58180020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:51248/0 (socket says 172.21.15.38:51248) 2023-11-06T13:39:43.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/2676458447 learned_addr learned my addr 172.21.15.38:0/2676458447 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:39:43.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.229+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/2676458447 >> v2:172.21.15.163:3300/0 conn(0x7f5b580ed110 0x7f5b58182af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.235 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b4ffff700 1 -- 172.21.15.38:0/2676458447 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295680379 0 0) 0x7f5b580ee5c0 con 0x7f5b58178b60 2023-11-06T13:39:43.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b4ffff700 1 -- 172.21.15.38:0/2676458447 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b440033f0 con 0x7f5b58178b60 2023-11-06T13:39:43.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b5cdd0700 1 -- 172.21.15.38:0/2676458447 >> v2:172.21.15.38:3300/0 conn(0x7f5b58180730 msgr2=0x7f5b5817eae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:39:43.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/2676458447 >> v2:172.21.15.38:3300/0 conn(0x7f5b58180730 0x7f5b5817eae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b5cdd0700 1 -- 172.21.15.38:0/2676458447 >> v1:172.21.15.38:6789/0 conn(0x7f5b58178b60 legacy=0x7f5b58180020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.236 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b5cdd0700 1 -- 172.21.15.38:0/2676458447 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580ed9b0 con 0x7f5b580ed110 2023-11-06T13:39:43.237 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/2676458447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b580ed110 0x7f5b58182af0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5b580f1e50 tx=0x7f5b54009060).ready entity=mon.2 client_cookie=6282c9bbe70aeffd server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.230+0000 7f5b4ffff700 1 -- 172.21.15.38:0/2676458447 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400f510 con 0x7f5b580ed110 2023-11-06T13:39:43.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b4ffff700 1 -- 172.21.15.38:0/2676458447 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5400f670 con 0x7f5b580ed110 2023-11-06T13:39:43.238 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b4ffff700 1 -- 172.21.15.38:0/2676458447 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400f9f0 con 0x7f5b580ed110 2023-11-06T13:39:43.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/2676458447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b580ed110 msgr2=0x7f5b58182af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/2676458447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b580ed110 0x7f5b58182af0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5b580f1e50 tx=0x7f5b54009060).stop 2023-11-06T13:39:43.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/2676458447 shutdown_connections 2023-11-06T13:39:43.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/2676458447 >> v2:172.21.15.38:3300/0 conn(0x7f5b58180730 0x7f5b5817eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.239 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/2676458447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b580ed110 0x7f5b58182af0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.233+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/2676458447 >> 172.21.15.38:0/2676458447 conn(0x7f5b580ee9e0 msgr2=0x7f5b580eedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:43.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.234+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/2676458447 shutdown_connections 2023-11-06T13:39:43.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.234+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/2676458447 wait complete. 2023-11-06T13:39:43.240 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.236+0000 7f5b5e5d3700 1 Processor -- start 2023-11-06T13:39:43.243 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.238+0000 7f5b5e5d3700 1 -- start start 2023-11-06T13:39:43.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5e5d3700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 0x7f5b5815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5e5d3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58178b60 0x7f5b581935c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5e5d3700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b58180730 0x7f5b58193ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.248 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5e5d3700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b58196140 con 0x7f5b58180730 2023-11-06T13:39:43.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5e5d3700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581951e0 con 0x7f5b580ed110 2023-11-06T13:39:43.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5e5d3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b581954c0 con 0x7f5b58178b60 2023-11-06T13:39:43.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 0x7f5b5815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 0x7f5b5815a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:55794/0 (socket says 172.21.15.38:55794) 2023-11-06T13:39:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.240+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1976194547 learned_addr learned my addr 172.21.15.38:0/1976194547 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58178b60 msgr2=0x7f5b581935c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:39:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58178b60 0x7f5b581935c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1976194547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b58180730 msgr2=0x7f5b58193ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:39:43.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b58180730 0x7f5b58193ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1976194547 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b540092a0 con 0x7f5b580ed110 2023-11-06T13:39:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 0x7f5b5815a060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f5b50002220 tx=0x7f5b50001650).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b4d7fa700 1 -- 172.21.15.38:0/1976194547 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000ce80 con 0x7f5b580ed110 2023-11-06T13:39:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b4d7fa700 1 -- 172.21.15.38:0/1976194547 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50005d30 con 0x7f5b580ed110 2023-11-06T13:39:43.251 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b581957a0 con 0x7f5b580ed110 2023-11-06T13:39:43.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b4d7fa700 1 -- 172.21.15.38:0/1976194547 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50005ea0 con 0x7f5b580ed110 2023-11-06T13:39:43.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.241+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b58195d60 con 0x7f5b580ed110 2023-11-06T13:39:43.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.246+0000 7f5b4d7fa700 1 -- 172.21.15.38:0/1976194547 <== mon.1 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f5b50007530 con 0x7f5b580ed110 2023-11-06T13:39:43.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.247+0000 7f5b711cdb80 1 Processor -- start 2023-11-06T13:39:43.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.247+0000 7f5b711cdb80 1 -- start start 2023-11-06T13:39:43.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.247+0000 7f5b4d7fa700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5b3c08cb40 0x7f5b3c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.247+0000 7f5b4d7fa700 1 -- 172.21.15.38:0/1976194547 <== mon.1 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5b500c3120 con 0x7f5b580ed110 2023-11-06T13:39:43.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.247+0000 7f5b5ddd2700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5b3c08cb40 0x7f5b3c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b5ddd2700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5b3c08cb40 0x7f5b3c08f000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5b58192f50 tx=0x7f5b48006a50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d88542b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d88542bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8853a7fd0 con 0x55d88519ee90 2023-11-06T13:39:43.255 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d88531f240 con 0x55d8854239a0 2023-11-06T13:39:43.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.248+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d885334490 con 0x55d88542b7f0 2023-11-06T13:39:43.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50700/0 (socket says 172.21.15.38:50700) 2023-11-06T13:39:43.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1624750957 learned_addr learned my addr 172.21.15.38:0/1624750957 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:43.256 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5ddd2700 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d88542bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1624750957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 msgr2=0x55d88542bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:43.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d88542bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1624750957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 msgr2=0x55d88542b300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:39:43.257 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d88542b300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1624750957 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d88532d670 con 0x55d88519ee90 2023-11-06T13:39:43.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5ddd2700 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d88542bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:39:43.258 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.249+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854234b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f5b50096e80 tx=0x7f5b500971c0).ready entity=mon.0 client_cookie=a0038f359352774a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.252+0000 7f5b427fc700 1 -- 172.21.15.38:0/1624750957 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500c0ea0 con 0x55d88519ee90 2023-11-06T13:39:43.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.252+0000 7f5b427fc700 1 -- 172.21.15.38:0/1624750957 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50095790 con 0x55d88519ee90 2023-11-06T13:39:43.259 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.252+0000 7f5b427fc700 1 -- 172.21.15.38:0/1624750957 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500c07b0 con 0x55d88519ee90 2023-11-06T13:39:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1624750957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 msgr2=0x55d8854234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854234b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f5b50096e80 tx=0x7f5b500971c0).stop 2023-11-06T13:39:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1624750957 shutdown_connections 2023-11-06T13:39:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d88542bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.260 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854234b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1624750957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d88542b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.253+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1624750957 >> 172.21.15.38:0/1624750957 conn(0x55d88524c4f0 msgr2=0x55d8853e26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.255+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1624750957 shutdown_connections 2023-11-06T13:39:43.261 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.255+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1624750957 wait complete. 2023-11-06T13:39:43.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.256+0000 7f5b711cdb80 1 -- start start 2023-11-06T13:39:43.262 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.256+0000 7f5b711cdb80 1 Processor -- start 2023-11-06T13:39:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d885460ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d8854620f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8853345d0 con 0x55d88519ee90 2023-11-06T13:39:43.263 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d885334850 con 0x55d8854239a0 2023-11-06T13:39:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8852ffe60 con 0x55d88542b7f0 2023-11-06T13:39:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b711cdb80 10 client.0 ll_register_callbacks cb 0x55d8853a25b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:39:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.264 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50716/0 (socket says 172.21.15.38:50716) 2023-11-06T13:39:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1754583578 learned_addr learned my addr 172.21.15.38:0/1754583578 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d885460ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.265 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5ddd2700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d8854620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 msgr2=0x55d8854620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:43.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d8854620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1754583578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 msgr2=0x55d885460ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:43.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d885460ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.267 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.258+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/1754583578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b48015420 con 0x55d88519ee90 2023-11-06T13:39:43.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854616a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f5b50095740 tx=0x7f5b5009d000).ready entity=mon.0 client_cookie=532134e905ade238 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b377fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:39:43.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b377fe700 1 -- 172.21.15.38:0/1754583578 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5009cd50 con 0x55d88519ee90 2023-11-06T13:39:43.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b377fe700 1 -- 172.21.15.38:0/1754583578 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5b5009b130 con 0x55d88519ee90 2023-11-06T13:39:43.268 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8853d6690 con 0x55d88519ee90 2023-11-06T13:39:43.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b377fe700 1 -- 172.21.15.38:0/1754583578 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b50022370 con 0x55d88519ee90 2023-11-06T13:39:43.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b711cdb80 10 client.5622 fetch_fsmap learned FSMap version 43 2023-11-06T13:39:43.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x7f5b58195d60 con 0x55d88519ee90 2023-11-06T13:39:43.269 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.259+0000 7f5b377fe700 1 -- 172.21.15.38:0/1754583578 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8853d6690 con 0x55d88519ee90 2023-11-06T13:39:43.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b377fe700 1 -- 172.21.15.38:0/1754583578 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 43) v1 ==== 7532+0+0 (secure 0 0 0) 0x7f5b500968e0 con 0x55d88519ee90 2023-11-06T13:39:43.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b711cdb80 10 client.5622 fetch_fsmap finished waiting for FSMap version 43 2023-11-06T13:39:43.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b711cdb80 10 client.5622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:39:43.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b711cdb80 20 client.5622 populate_metadata read hostname 'smithi038' 2023-11-06T13:39:43.270 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885451620 0x55d88541cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b711cdb80 4 client.5622 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:39:43.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d88519acf0 con 0x55d885451620 2023-11-06T13:39:43.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885451620 0x55d88541cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b377fe700 10 client.5622 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:43.271 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.260+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885451620 0x55d88541cf80 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6dff4b106f36dd58 server_cookie=5be28285f845b195 in_seq=0 out_seq=0 2023-11-06T13:39:43.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b377fe700 1 -- 172.21.15.38:0/1754583578 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d88519acf0 con 0x55d885451620 2023-11-06T13:39:43.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b377fe700 10 client.5622 handle_command_reply: tid=0 2023-11-06T13:39:43.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 client.5622 shutdown 2023-11-06T13:39:43.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 msgr2=0x55d8854616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.272 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854616a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f5b50095740 tx=0x7f5b5009d000).stop 2023-11-06T13:39:43.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 shutdown_connections 2023-11-06T13:39:43.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885451620 0x55d88541cf80 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d8854620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854616a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.273 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/1754583578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d885460ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.261+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 >> 172.21.15.38:0/1754583578 conn(0x55d88524c4f0 msgr2=0x55d8853e2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.262+0000 7f5b377fe700 0 client.5622 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:43.274 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.262+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 shutdown_connections 2023-11-06T13:39:43.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.262+0000 7f5b711cdb80 1 -- 172.21.15.38:0/1754583578 wait complete. 2023-11-06T13:39:43.275 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.262+0000 7f5b711cdb80 20 client.5622 trim_cache size 0 max 16384 2023-11-06T13:39:43.290 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.287+0000 7f5b711cdb80 1 Processor -- start 2023-11-06T13:39:43.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.287+0000 7f5b711cdb80 1 -- start start 2023-11-06T13:39:43.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885461e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.293 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8854ad170 con 0x55d88519ee90 2023-11-06T13:39:43.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8854616a0 con 0x55d8854239a0 2023-11-06T13:39:43.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d88541cf80 con 0x55d88542b7f0 2023-11-06T13:39:43.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.288+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50726/0 (socket says 172.21.15.38:50726) 2023-11-06T13:39:43.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/3183384701 learned_addr learned my addr 172.21.15.38:0/3183384701 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:43.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5ddd2700 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885461e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/3183384701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 msgr2=0x55d885461e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:43.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885461e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/3183384701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 msgr2=0x55d8854608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:43.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/3183384701 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d885328a10 con 0x55d88519ee90 2023-11-06T13:39:43.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854acc80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5b50097380 tx=0x7f5b500a3000).ready entity=mon.0 client_cookie=a674d399660f2d28 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b42ffd700 1 -- 172.21.15.38:0/3183384701 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500c0ea0 con 0x55d88519ee90 2023-11-06T13:39:43.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b42ffd700 1 -- 172.21.15.38:0/3183384701 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b500953a0 con 0x55d88519ee90 2023-11-06T13:39:43.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.289+0000 7f5b42ffd700 1 -- 172.21.15.38:0/3183384701 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500017b0 con 0x55d88519ee90 2023-11-06T13:39:43.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.290+0000 7f5b711cdb80 1 -- 172.21.15.38:0/3183384701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 msgr2=0x55d8854acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.290+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854acc80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5b50097380 tx=0x7f5b500a3000).stop 2023-11-06T13:39:43.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.292+0000 7f5b711cdb80 1 -- 172.21.15.38:0/3183384701 shutdown_connections 2023-11-06T13:39:43.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.292+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885461e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.292+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d8854acc80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.292+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/3183384701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.292+0000 7f5b711cdb80 1 -- 172.21.15.38:0/3183384701 >> 172.21.15.38:0/3183384701 conn(0x55d88524c4f0 msgr2=0x55d88542b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:43.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.293+0000 7f5b711cdb80 1 -- 172.21.15.38:0/3183384701 shutdown_connections 2023-11-06T13:39:43.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.293+0000 7f5b711cdb80 1 -- 172.21.15.38:0/3183384701 wait complete. 2023-11-06T13:39:43.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.294+0000 7f5b711cdb80 1 -- start start 2023-11-06T13:39:43.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.295+0000 7f5b711cdb80 1 Processor -- start 2023-11-06T13:39:43.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d88541f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.302 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885454300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8854b63b0 con 0x55d88519ee90 2023-11-06T13:39:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8854ba5f0 con 0x55d8854239a0 2023-11-06T13:39:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8854618b0 con 0x55d88542b7f0 2023-11-06T13:39:43.303 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b711cdb80 10 client.0 ll_register_callbacks cb 0x55d8853a25b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:39:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b5cdd0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d88541f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b5d5d1700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d88541f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:50734/0 (socket says 172.21.15.38:50734) 2023-11-06T13:39:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/2964831513 learned_addr learned my addr 172.21.15.38:0/2964831513 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:39:43.304 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.296+0000 7f5b5cdd0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854b9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:55826/0 (socket says 172.21.15.38:55826) 2023-11-06T13:39:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 msgr2=0x55d885454300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:39:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885454300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/2964831513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 msgr2=0x55d8854b9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:39:43.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854b9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b5d5d1700 1 -- 172.21.15.38:0/2964831513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b48015420 con 0x55d88519ee90 2023-11-06T13:39:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b5d5d1700 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d88541f9d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f5b50097380 tx=0x7f5b500af000).ready entity=mon.0 client_cookie=7dcbd2f1a9de993c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:39:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b377fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:39:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b377fe700 1 -- 172.21.15.38:0/2964831513 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500017b0 con 0x55d88519ee90 2023-11-06T13:39:43.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b377fe700 1 -- 172.21.15.38:0/2964831513 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f5b5009ccd0 con 0x55d88519ee90 2023-11-06T13:39:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b50095790 con 0x55d88519ee90 2023-11-06T13:39:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b377fe700 1 -- 172.21.15.38:0/2964831513 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b500971c0 con 0x55d88519ee90 2023-11-06T13:39:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b711cdb80 10 client.5628 fetch_fsmap learned FSMap version 43 2023-11-06T13:39:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55d885328760 con 0x55d88519ee90 2023-11-06T13:39:43.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.297+0000 7f5b377fe700 1 -- 172.21.15.38:0/2964831513 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50095790 con 0x55d88519ee90 2023-11-06T13:39:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b377fe700 1 -- 172.21.15.38:0/2964831513 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 43) v1 ==== 7532+0+0 (secure 0 0 0) 0x7f5b500968e0 con 0x55d88519ee90 2023-11-06T13:39:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b711cdb80 10 client.5628 fetch_fsmap finished waiting for FSMap version 43 2023-11-06T13:39:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b711cdb80 10 client.5628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:39:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b711cdb80 20 client.5628 populate_metadata read hostname 'smithi038' 2023-11-06T13:39:43.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885429ce0 0x55d8853e8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:39:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b711cdb80 4 client.5628 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:39:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d8851d1cf0 con 0x55d885429ce0 2023-11-06T13:39:43.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.298+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885429ce0 0x55d8853e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:39:43.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b5cdd0700 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885429ce0 0x55d8853e8230 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=719b819a6a4742f0 server_cookie=ec802e3a74b91123 in_seq=0 out_seq=0 2023-11-06T13:39:43.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b377fe700 10 client.5628 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:43.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b377fe700 1 -- 172.21.15.38:0/2964831513 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d8851d1cf0 con 0x55d885429ce0 2023-11-06T13:39:43.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b377fe700 10 client.5628 handle_command_reply: tid=0 2023-11-06T13:39:43.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 client.5628 shutdown 2023-11-06T13:39:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 msgr2=0x55d88541f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d88541f9d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f5b50097380 tx=0x7f5b500af000).stop 2023-11-06T13:39:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 shutdown_connections 2023-11-06T13:39:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55d885429ce0 0x55d8853e8230 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d88542b7f0 0x55d885454300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55d88519ee90 0x55d88541f9d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 --2- 172.21.15.38:0/2964831513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d8854239a0 0x55d8854b9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b377fe700 0 client.5628 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:39:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 >> 172.21.15.38:0/2964831513 conn(0x55d88524c4f0 msgr2=0x55d88541d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:43.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 shutdown_connections 2023-11-06T13:39:43.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.300+0000 7f5b711cdb80 1 -- 172.21.15.38:0/2964831513 wait complete. 2023-11-06T13:39:43.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.301+0000 7f5b711cdb80 20 client.5628 trim_cache size 0 max 16384 2023-11-06T13:39:43.314 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:39:43.315 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:39:43.315 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:39:43.315 INFO:teuthology.orchestra.run.smithi038.stdout: "b404008f-48ac-47ea-8eb9-846df09c2615": { 2023-11-06T13:39:43.315 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:39:43.315 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "b404008f-48ac-47ea-8eb9-846df09c2615", 2023-11-06T13:39:43.316 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:39:43.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:39:43.316 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:39:43.316 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:39:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.301+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5b3c08cb40 msgr2=0x7f5b3c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.301+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5b3c08cb40 0x7f5b3c08f000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5b58192f50 tx=0x7f5b48006a50).stop 2023-11-06T13:39:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.301+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 msgr2=0x7f5b5815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:39:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.301+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 0x7f5b5815a060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f5b50002220 tx=0x7f5b50001650).stop 2023-11-06T13:39:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 shutdown_connections 2023-11-06T13:39:43.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f5b58180730 0x7f5b58193ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f5b3c08cb40 0x7f5b3c08f000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5b580ed110 0x7f5b5815a060 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:39:43.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 --2- 172.21.15.38:0/1976194547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5b58178b60 0x7f5b581935c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:39:43.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 >> 172.21.15.38:0/1976194547 conn(0x7f5b580ee9e0 msgr2=0x7f5b580c7950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:39:43.319 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 shutdown_connections 2023-11-06T13:39:43.320 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:39:43.303+0000 7f5b5e5d3700 1 -- 172.21.15.38:0/1976194547 wait complete. 2023-11-06T13:39:43.323 INFO:tasks.cephfs.filesystem:scrub status for tag:b404008f-48ac-47ea-8eb9-846df09c2615 - {'path': '/', 'tag': 'b404008f-48ac-47ea-8eb9-846df09c2615', 'options': 'recursive,force'} 2023-11-06T13:40:13.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:40:13.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.451+0000 7f739973d700 1 Processor -- start 2023-11-06T13:40:13.455 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.451+0000 7f739973d700 1 -- start start 2023-11-06T13:40:13.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f739973d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7394171870 0x7f73940c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.458 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f739973d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f739417e4d0 0x7f7394179950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f739973d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739417ea00 con 0x7f7394179e40 2023-11-06T13:40:13.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f739973d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739417ece0 con 0x7f7394171870 2023-11-06T13:40:13.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f739973d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739417efc0 con 0x7f739417e4d0 2023-11-06T13:40:13.459 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f7393fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7394171870 0x7f73940c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f73937fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f739417e4d0 0x7f7394179950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f7398f3c700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7394179e40 0x7f73940c55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:60706/0 (socket says 172.21.15.38:60706) 2023-11-06T13:40:13.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.452+0000 7f7393fff700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7394171870 0x7f73940c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:33484/0 (socket says 172.21.15.38:33484) 2023-11-06T13:40:13.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f7398f3c700 1 -- 172.21.15.38:0/2819048679 learned_addr learned my addr 172.21.15.38:0/2819048679 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:40:13.460 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f7392ffd700 1 -- 172.21.15.38:0/2819048679 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565564654 0 0) 0x7f739417ea00 con 0x7f7394179e40 2023-11-06T13:40:13.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f7392ffd700 1 -- 172.21.15.38:0/2819048679 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f737c0033f0 con 0x7f7394179e40 2023-11-06T13:40:13.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f73937fe700 1 -- 172.21.15.38:0/2819048679 >> v2:172.21.15.44:3300/0 conn(0x7f7394171870 msgr2=0x7f73940c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f73937fe700 1 --2- 172.21.15.38:0/2819048679 >> v2:172.21.15.44:3300/0 conn(0x7f7394171870 0x7f73940c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f73937fe700 1 -- 172.21.15.38:0/2819048679 >> v1:172.21.15.44:6789/0 conn(0x7f7394179e40 legacy=0x7f73940c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.461 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f73937fe700 1 -- 172.21.15.38:0/2819048679 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739417f2a0 con 0x7f739417e4d0 2023-11-06T13:40:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f73937fe700 1 --2- 172.21.15.38:0/2819048679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394179950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f7394178d70 tx=0x7f7384006f30).ready entity=mon.2 client_cookie=499f7e3c65b4c51b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f7392ffd700 1 -- 172.21.15.38:0/2819048679 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400d9c0 con 0x7f739417e4d0 2023-11-06T13:40:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f7392ffd700 1 -- 172.21.15.38:0/2819048679 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400db20 con 0x7f739417e4d0 2023-11-06T13:40:13.462 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.453+0000 7f7392ffd700 1 -- 172.21.15.38:0/2819048679 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400dea0 con 0x7f739417e4d0 2023-11-06T13:40:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 -- 172.21.15.38:0/2819048679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 msgr2=0x7f7394179950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 --2- 172.21.15.38:0/2819048679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394179950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f7394178d70 tx=0x7f7384006f30).stop 2023-11-06T13:40:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 -- 172.21.15.38:0/2819048679 shutdown_connections 2023-11-06T13:40:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 --2- 172.21.15.38:0/2819048679 >> v2:172.21.15.44:3300/0 conn(0x7f7394171870 0x7f73940c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 --2- 172.21.15.38:0/2819048679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394179950 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.463 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 -- 172.21.15.38:0/2819048679 >> 172.21.15.38:0/2819048679 conn(0x7f73940f1900 msgr2=0x7f73940ed8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 -- 172.21.15.38:0/2819048679 shutdown_connections 2023-11-06T13:40:13.464 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.454+0000 7f739973d700 1 -- 172.21.15.38:0/2819048679 wait complete. 2023-11-06T13:40:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.455+0000 7f739973d700 1 Processor -- start 2023-11-06T13:40:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.456+0000 7f739973d700 1 -- start start 2023-11-06T13:40:13.469 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.456+0000 7f739973d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 0x7f73941583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.456+0000 7f739973d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7394179e40 0x7f73941588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f739973d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f739973d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394158dc0 con 0x7f7394171870 2023-11-06T13:40:13.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f739973d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394160ae0 con 0x7f7394179e40 2023-11-06T13:40:13.470 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f739973d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7394170850 con 0x7f739417e4d0 2023-11-06T13:40:13.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 0x7f73941583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 0x7f73941583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37620/0 (socket says 172.21.15.38:37620) 2023-11-06T13:40:13.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 -- 172.21.15.38:0/2244545543 learned_addr learned my addr 172.21.15.38:0/2244545543 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:13.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f73937fe700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7394179e40 0x7f73941588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.471 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7398f3c700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 -- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 msgr2=0x7f7394160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 -- 172.21.15.38:0/2244545543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7394179e40 msgr2=0x7f73941588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7394179e40 0x7f73941588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.472 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 -- 172.21.15.38:0/2244545543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738400b540 con 0x7f7394171870 2023-11-06T13:40:13.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f7393fff700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 0x7f73941583e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f738800e900 tx=0x7f7388009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f737bfff700 1 -- 172.21.15.38:0/2244545543 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388012600 con 0x7f7394171870 2023-11-06T13:40:13.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f737bfff700 1 -- 172.21.15.38:0/2244545543 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7388012760 con 0x7f7394171870 2023-11-06T13:40:13.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7394170b30 con 0x7f7394171870 2023-11-06T13:40:13.473 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f737bfff700 1 -- 172.21.15.38:0/2244545543 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388012ae0 con 0x7f7394171870 2023-11-06T13:40:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.457+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73941601b0 con 0x7f7394171870 2023-11-06T13:40:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.459+0000 7f737bfff700 1 -- 172.21.15.38:0/2244545543 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f738801b400 con 0x7f7394171870 2023-11-06T13:40:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.460+0000 7f737bfff700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f738008cb40 0x7f738008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.474 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.460+0000 7f737bfff700 1 -- 172.21.15.38:0/2244545543 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73880b2280 con 0x7f7394171870 2023-11-06T13:40:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.460+0000 7f73937fe700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f738008cb40 0x7f738008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.460+0000 7f73937fe700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f738008cb40 0x7f738008f000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7384006f70 tx=0x7f7384019000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.461+0000 7f73ac337b80 1 Processor -- start 2023-11-06T13:40:13.475 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.461+0000 7f73ac337b80 1 -- start start 2023-11-06T13:40:13.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e82569a0 0x55e7e825e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e825e7f0 0x55e7e825ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73ac337b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e81dafd0 con 0x55e7e7fd1e90 2023-11-06T13:40:13.476 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73ac337b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e8152240 con 0x55e7e82569a0 2023-11-06T13:40:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73ac337b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e8167490 con 0x55e7e825e7f0 2023-11-06T13:40:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37630/0 (socket says 172.21.15.38:37630) 2023-11-06T13:40:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 -- 172.21.15.38:0/3368876206 learned_addr learned my addr 172.21.15.38:0/3368876206 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:13.477 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73937fe700 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e82569a0 0x55e7e825e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7398f3c700 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e825e7f0 0x55e7e825ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 -- 172.21.15.38:0/3368876206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e825e7f0 msgr2=0x55e7e825ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e825e7f0 0x55e7e825ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.478 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 -- 172.21.15.38:0/3368876206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e82569a0 msgr2=0x55e7e825e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e82569a0 0x55e7e825e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 -- 172.21.15.38:0/3368876206 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e8160670 con 0x55e7e7fd1e90 2023-11-06T13:40:13.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f7393fff700 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82564b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f73880864d0 tx=0x7f7388012e90).ready entity=mon.0 client_cookie=94f12e9df894b7fe server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73797fa700 1 -- 172.21.15.38:0/3368876206 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388086590 con 0x55e7e7fd1e90 2023-11-06T13:40:13.479 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73797fa700 1 -- 172.21.15.38:0/3368876206 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738808be70 con 0x55e7e7fd1e90 2023-11-06T13:40:13.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.463+0000 7f73797fa700 1 -- 172.21.15.38:0/3368876206 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73880b2080 con 0x55e7e7fd1e90 2023-11-06T13:40:13.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 -- 172.21.15.38:0/3368876206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 msgr2=0x55e7e82564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82564b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f73880864d0 tx=0x7f7388012e90).stop 2023-11-06T13:40:13.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 -- 172.21.15.38:0/3368876206 shutdown_connections 2023-11-06T13:40:13.480 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e825e7f0 0x55e7e825ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82564b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3368876206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e82569a0 0x55e7e825e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 -- 172.21.15.38:0/3368876206 >> 172.21.15.38:0/3368876206 conn(0x55e7e807f4f0 msgr2=0x55e7e82156b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 -- 172.21.15.38:0/3368876206 shutdown_connections 2023-11-06T13:40:13.481 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.464+0000 7f73ac337b80 1 -- 172.21.15.38:0/3368876206 wait complete. 2023-11-06T13:40:13.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.465+0000 7f73ac337b80 1 -- start start 2023-11-06T13:40:13.482 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.465+0000 7f73ac337b80 1 Processor -- start 2023-11-06T13:40:13.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e827fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e8250d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.486 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e81675d0 con 0x55e7e825e7f0 2023-11-06T13:40:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e8167850 con 0x55e7e7fd1e90 2023-11-06T13:40:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e8132e60 con 0x55e7e82569a0 2023-11-06T13:40:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73ac337b80 10 client.0 ll_register_callbacks cb 0x55e7e81d55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f7398f3c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e8250d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.487 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f7398f3c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e8250d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37644/0 (socket says 172.21.15.38:37644) 2023-11-06T13:40:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f7398f3c700 1 -- 172.21.15.38:0/3727454593 learned_addr learned my addr 172.21.15.38:0/3727454593 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f73937fe700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e827fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.466+0000 7f7393fff700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.488 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f7398f3c700 1 -- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 msgr2=0x55e7e827fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f7398f3c700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e827fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f7398f3c700 1 -- 172.21.15.38:0/3727454593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 msgr2=0x55e7e82857a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f7398f3c700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82857a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f7398f3c700 1 -- 172.21.15.38:0/3727454593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73941601b0 con 0x55e7e825e7f0 2023-11-06T13:40:13.489 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f7398f3c700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e8250d60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f738c012920 tx=0x7f738c009040).ready entity=mon.0 client_cookie=a01f5f64d6e4b1fc server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73727fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73727fc700 1 -- 172.21.15.38:0/3727454593 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c001ad0 con 0x55e7e825e7f0 2023-11-06T13:40:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73727fc700 1 -- 172.21.15.38:0/3727454593 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f738c005d10 con 0x55e7e825e7f0 2023-11-06T13:40:13.490 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7e8209690 con 0x55e7e825e7f0 2023-11-06T13:40:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73727fc700 1 -- 172.21.15.38:0/3727454593 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f738c0012b0 con 0x55e7e825e7f0 2023-11-06T13:40:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 10 client.5637 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55e7e815ba10 con 0x55e7e825e7f0 2023-11-06T13:40:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73727fc700 1 -- 172.21.15.38:0/3727454593 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7e8209690 con 0x55e7e825e7f0 2023-11-06T13:40:13.491 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73727fc700 1 -- 172.21.15.38:0/3727454593 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f738c0072e0 con 0x55e7e825e7f0 2023-11-06T13:40:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 10 client.5637 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 10 client.5637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 20 client.5637 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827bee0 0x55e7e827c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.492 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 4 client.5637 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:40:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.467+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7e7fcdcf0 con 0x55e7e827bee0 2023-11-06T13:40:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.468+0000 7f7393fff700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827bee0 0x55e7e827c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.468+0000 7f7393fff700 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827bee0 0x55e7e827c2f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e087b13a56eda136 server_cookie=d267312da001e7f6 in_seq=0 out_seq=0 2023-11-06T13:40:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.468+0000 7f73727fc700 10 client.5637 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:13.493 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73727fc700 1 -- 172.21.15.38:0/3727454593 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55e7e7fcdcf0 con 0x55e7e827bee0 2023-11-06T13:40:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73727fc700 10 client.5637 handle_command_reply: tid=0 2023-11-06T13:40:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 client.5637 shutdown 2023-11-06T13:40:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 msgr2=0x55e7e8250d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.494 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e8250d60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f738c012920 tx=0x7f738c009040).stop 2023-11-06T13:40:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 shutdown_connections 2023-11-06T13:40:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e8250d60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82857a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827bee0 0x55e7e827c2f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 --2- 172.21.15.38:0/3727454593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e827fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.495 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73727fc700 0 client.5637 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 >> 172.21.15.38:0/3727454593 conn(0x55e7e807f4f0 msgr2=0x55e7e8252150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 shutdown_connections 2023-11-06T13:40:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 1 -- 172.21.15.38:0/3727454593 wait complete. 2023-11-06T13:40:13.496 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.469+0000 7f73ac337b80 20 client.5637 trim_cache size 0 max 16384 2023-11-06T13:40:13.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.485+0000 7f73ac337b80 1 Processor -- start 2023-11-06T13:40:13.501 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.485+0000 7f73ac337b80 1 -- start start 2023-11-06T13:40:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e8284be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e825e7f0 0x55e7e8211cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73ac337b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e8215140 con 0x55e7e7fd1e90 2023-11-06T13:40:13.502 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73ac337b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e82dab80 con 0x55e7e825e7f0 2023-11-06T13:40:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73ac337b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e8255aa0 con 0x55e7e82569a0 2023-11-06T13:40:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82112d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37652/0 (socket says 172.21.15.38:37652) 2023-11-06T13:40:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 -- 172.21.15.38:0/1334524279 learned_addr learned my addr 172.21.15.38:0/1334524279 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:13.503 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7398f3c700 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e825e7f0 0x55e7e8211cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f73937fe700 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e8284be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 -- 172.21.15.38:0/1334524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 msgr2=0x55e7e8284be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e8284be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 -- 172.21.15.38:0/1334524279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e825e7f0 msgr2=0x55e7e8211cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.504 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e825e7f0 0x55e7e8211cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 -- 172.21.15.38:0/1334524279 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7e815b760 con 0x55e7e7fd1e90 2023-11-06T13:40:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7393fff700 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82112d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f738800e8d0 tx=0x7f7388055000).ready entity=mon.0 client_cookie=199418462d3bf72 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7379ffb700 1 -- 172.21.15.38:0/1334524279 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738809b070 con 0x55e7e7fd1e90 2023-11-06T13:40:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7379ffb700 1 -- 172.21.15.38:0/1334524279 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738808f070 con 0x55e7e7fd1e90 2023-11-06T13:40:13.505 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.487+0000 7f7379ffb700 1 -- 172.21.15.38:0/1334524279 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7388084930 con 0x55e7e7fd1e90 2023-11-06T13:40:13.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 -- 172.21.15.38:0/1334524279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 msgr2=0x55e7e82112d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82112d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f738800e8d0 tx=0x7f7388055000).stop 2023-11-06T13:40:13.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 -- 172.21.15.38:0/1334524279 shutdown_connections 2023-11-06T13:40:13.506 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e825e7f0 0x55e7e8211cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e7fd1e90 0x55e7e82112d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 --2- 172.21.15.38:0/1334524279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e8284be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 -- 172.21.15.38:0/1334524279 >> 172.21.15.38:0/1334524279 conn(0x55e7e807f4f0 msgr2=0x55e7e8255240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 -- 172.21.15.38:0/1334524279 shutdown_connections 2023-11-06T13:40:13.507 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.488+0000 7f73ac337b80 1 -- 172.21.15.38:0/1334524279 wait complete. 2023-11-06T13:40:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.489+0000 7f73ac337b80 1 -- start start 2023-11-06T13:40:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.489+0000 7f73ac337b80 1 Processor -- start 2023-11-06T13:40:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e82e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.508 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e82164a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e82d66f0 con 0x55e7e825e7f0 2023-11-06T13:40:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e82e9200 con 0x55e7e7fd1e90 2023-11-06T13:40:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7e82d3780 con 0x55e7e82569a0 2023-11-06T13:40:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 10 client.0 ll_register_callbacks cb 0x55e7e81d55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e82164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.509 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7393fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e82164a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37660/0 (socket says 172.21.15.38:37660) 2023-11-06T13:40:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 -- 172.21.15.38:0/547256567 learned_addr learned my addr 172.21.15.38:0/547256567 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73937fe700 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e82e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 -- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 msgr2=0x55e7e82e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e82e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 -- 172.21.15.38:0/547256567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 msgr2=0x55e7e82d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82d3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 -- 172.21.15.38:0/547256567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7e8160670 con 0x55e7e825e7f0 2023-11-06T13:40:13.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f7398f3c700 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e82164a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f738c005ad0 tx=0x7f738c019000).ready entity=mon.0 client_cookie=e429f8d36e79a22a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73727fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73727fc700 1 -- 172.21.15.38:0/547256567 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c0077a0 con 0x55e7e825e7f0 2023-11-06T13:40:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7e8212910 con 0x55e7e825e7f0 2023-11-06T13:40:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.490+0000 7f73727fc700 1 -- 172.21.15.38:0/547256567 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f738c005d10 con 0x55e7e825e7f0 2023-11-06T13:40:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73727fc700 1 -- 172.21.15.38:0/547256567 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f738c007900 con 0x55e7e825e7f0 2023-11-06T13:40:13.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 10 client.5643 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:13.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55e7e7fd2fd0 con 0x55e7e825e7f0 2023-11-06T13:40:13.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73727fc700 1 -- 172.21.15.38:0/547256567 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7e8212910 con 0x55e7e825e7f0 2023-11-06T13:40:13.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73727fc700 1 -- 172.21.15.38:0/547256567 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f738c015650 con 0x55e7e825e7f0 2023-11-06T13:40:13.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 10 client.5643 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 10 client.5643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 20 client.5643 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827c2c0 0x55e7e82d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:13.514 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 4 client.5643 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:40:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f738808be70 con 0x55e7e827c2c0 2023-11-06T13:40:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f7393fff700 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827c2c0 0x55e7e82d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f73727fc700 10 client.5643 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.491+0000 7f7393fff700 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827c2c0 0x55e7e82d39b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=88faa0bf58b68c42 server_cookie=689b725a4874cf8f in_seq=0 out_seq=0 2023-11-06T13:40:13.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73727fc700 1 -- 172.21.15.38:0/547256567 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f738808be70 con 0x55e7e827c2c0 2023-11-06T13:40:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73727fc700 10 client.5643 handle_command_reply: tid=0 2023-11-06T13:40:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 client.5643 shutdown 2023-11-06T13:40:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 msgr2=0x55e7e82164a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e82164a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f738c005ad0 tx=0x7f738c019000).stop 2023-11-06T13:40:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 shutdown_connections 2023-11-06T13:40:13.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55e7e825e7f0 0x55e7e82164a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e7e7fd1e90 0x55e7e82d3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55e7e827c2c0 0x55e7e82d39b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 --2- 172.21.15.38:0/547256567 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e7e82569a0 0x55e7e82e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73727fc700 0 client.5643 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:13.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 >> 172.21.15.38:0/547256567 conn(0x55e7e807f4f0 msgr2=0x55e7e8284690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 shutdown_connections 2023-11-06T13:40:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 1 -- 172.21.15.38:0/547256567 wait complete. 2023-11-06T13:40:13.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f73ac337b80 20 client.5643 trim_cache size 0 max 16384 2023-11-06T13:40:13.521 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:40:13.521 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:40:13.521 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:40:13.522 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:40:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f738008cb40 msgr2=0x7f738008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f738008cb40 0x7f738008f000 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7384006f70 tx=0x7f7384019000).stop 2023-11-06T13:40:13.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 msgr2=0x7f73941583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 0x7f73941583e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f738800e900 tx=0x7f7388009060).stop 2023-11-06T13:40:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 shutdown_connections 2023-11-06T13:40:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f739417e4d0 0x7f7394160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f7394171870 0x7f73941583e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f738008cb40 0x7f738008f000 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.492+0000 7f739973d700 1 --2- 172.21.15.38:0/2244545543 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7394179e40 0x7f73941588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.493+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 >> 172.21.15.38:0/2244545543 conn(0x7f73940f1900 msgr2=0x7f73940ecfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.493+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 shutdown_connections 2023-11-06T13:40:13.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:13.493+0000 7f739973d700 1 -- 172.21.15.38:0/2244545543 wait complete. 2023-11-06T13:40:13.526 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:40:14.526 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:40:14.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:40:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.648+0000 7fc846a9d700 1 Processor -- start 2023-11-06T13:40:14.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.648+0000 7fc846a9d700 1 -- start start 2023-11-06T13:40:14.654 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc846a9d700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc840084420 0x7fc840084840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc846a9d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840083f90 con 0x7fc840176b50 2023-11-06T13:40:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc846a9d700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840083c60 con 0x7fc840176f30 2023-11-06T13:40:14.655 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc846a9d700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84017dbe0 con 0x7fc840084420 2023-11-06T13:40:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc844839700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc840176b50 0x7fc840065f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:34422/0 (socket says 172.21.15.38:34422) 2023-11-06T13:40:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc844839700 1 -- 172.21.15.38:0/1253940579 learned_addr learned my addr 172.21.15.38:0/1253940579 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:40:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.649+0000 7fc84503a700 1 --2- 172.21.15.38:0/1253940579 >> v2:172.21.15.44:3300/0 conn(0x7fc840084420 0x7fc840084840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967127071 0 0) 0x7fc840083f90 con 0x7fc840176b50 2023-11-06T13:40:14.656 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8280033f0 con 0x7fc840176b50 2023-11-06T13:40:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528672125 0 0) 0x7fc840083c60 con 0x7fc840176f30 2023-11-06T13:40:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc840083f90 con 0x7fc840176f30 2023-11-06T13:40:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc84503a700 1 -- 172.21.15.38:0/1253940579 >> v1:172.21.15.163:6789/0 conn(0x7fc840176f30 legacy=0x7fc8400666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.657 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc84503a700 1 -- 172.21.15.38:0/1253940579 >> v1:172.21.15.38:6789/0 conn(0x7fc840176b50 legacy=0x7fc840065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc84503a700 1 -- 172.21.15.38:0/1253940579 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840066e70 con 0x7fc840084420 2023-11-06T13:40:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc84503a700 1 --2- 172.21.15.38:0/1253940579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc840084840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc830009760 tx=0x7fc830009060).ready entity=mon.1 client_cookie=f43296f9f9e55ee3 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830009120 con 0x7fc840084420 2023-11-06T13:40:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000d4a0 con 0x7fc840084420 2023-11-06T13:40:14.658 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.650+0000 7fc83f7fe700 1 -- 172.21.15.38:0/1253940579 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000d820 con 0x7fc840084420 2023-11-06T13:40:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 -- 172.21.15.38:0/1253940579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 msgr2=0x7fc840084840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 --2- 172.21.15.38:0/1253940579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc840084840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc830009760 tx=0x7fc830009060).stop 2023-11-06T13:40:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 -- 172.21.15.38:0/1253940579 shutdown_connections 2023-11-06T13:40:14.659 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 --2- 172.21.15.38:0/1253940579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc840084840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 -- 172.21.15.38:0/1253940579 >> 172.21.15.38:0/1253940579 conn(0x7fc8400f2b30 msgr2=0x7fc8400eeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 -- 172.21.15.38:0/1253940579 shutdown_connections 2023-11-06T13:40:14.660 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.651+0000 7fc846a9d700 1 -- 172.21.15.38:0/1253940579 wait complete. 2023-11-06T13:40:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.652+0000 7fc846a9d700 1 Processor -- start 2023-11-06T13:40:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.652+0000 7fc846a9d700 1 -- start start 2023-11-06T13:40:14.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc846a9d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc8401746b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc846a9d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 0x7fc84016e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc846a9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc840174ba0 0x7fc8400e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc846a9d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400e91b0 con 0x7fc840176b50 2023-11-06T13:40:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc846a9d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840175560 con 0x7fc840084420 2023-11-06T13:40:14.671 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc846a9d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840175840 con 0x7fc840174ba0 2023-11-06T13:40:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 0x7fc84016e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 0x7fc84016e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37674/0 (socket says 172.21.15.38:37674) 2023-11-06T13:40:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc844839700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc8401746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.653+0000 7fc83ffff700 1 -- 172.21.15.38:0/2022726766 learned_addr learned my addr 172.21.15.38:0/2022726766 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83ffff700 1 -- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc840174ba0 msgr2=0x7fc8400e9640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-06T13:40:14.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83ffff700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc840174ba0 0x7fc8400e9640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:40:14.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83ffff700 1 -- 172.21.15.38:0/2022726766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 msgr2=0x7fc8401746b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83ffff700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc8401746b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83ffff700 1 -- 172.21.15.38:0/2022726766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300092a0 con 0x7fc840176b50 2023-11-06T13:40:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83ffff700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 0x7fc84016e0e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fc83400c490 tx=0x7fc834007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83cff9700 1 -- 172.21.15.38:0/2022726766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400f470 con 0x7fc840176b50 2023-11-06T13:40:14.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83cff9700 1 -- 172.21.15.38:0/2022726766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400f5d0 con 0x7fc840176b50 2023-11-06T13:40:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc840175b20 con 0x7fc840176b50 2023-11-06T13:40:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc83cff9700 1 -- 172.21.15.38:0/2022726766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400f990 con 0x7fc840176b50 2023-11-06T13:40:14.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.654+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8401760e0 con 0x7fc840176b50 2023-11-06T13:40:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.656+0000 7fc83cff9700 1 -- 172.21.15.38:0/2022726766 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fc834012400 con 0x7fc840176b50 2023-11-06T13:40:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.656+0000 7fc83cff9700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc82c08cb40 0x7fc82c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.656+0000 7fc83cff9700 1 -- 172.21.15.38:0/2022726766 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc8340b1400 con 0x7fc840176b50 2023-11-06T13:40:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.657+0000 7fc844839700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc82c08cb40 0x7fc82c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.657+0000 7fc844839700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc82c08cb40 0x7fc82c08f000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fc838005ad0 tx=0x7fc838009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.658+0000 7fc858435b80 1 Processor -- start 2023-11-06T13:40:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.658+0000 7fc858435b80 1 -- start start 2023-11-06T13:40:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc858435b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6cbf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc858435b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6ca9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc858435b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6ca9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc858435b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6c08050 con 0x5611e69fef10 2023-11-06T13:40:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc858435b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6b7f2c0 con 0x5611e6cbf4f0 2023-11-06T13:40:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc858435b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6b94510 con 0x5611e6ca9760 2023-11-06T13:40:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6cbf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6cbf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37678/0 (socket says 172.21.15.38:37678) 2023-11-06T13:40:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 -- 172.21.15.38:0/3195613033 learned_addr learned my addr 172.21.15.38:0/3195613033 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc84503a700 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6ca9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc83ffff700 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6ca9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.680 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 -- 172.21.15.38:0/3195613033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 msgr2=0x5611e6ca9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6ca9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 -- 172.21.15.38:0/3195613033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 msgr2=0x5611e6ca9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6ca9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 -- 172.21.15.38:0/3195613033 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611e6b8d6f0 con 0x5611e69fef10 2023-11-06T13:40:14.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.659+0000 7fc844839700 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6cbf000 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc83800fc30 tx=0x7fc838013000).ready entity=mon.0 client_cookie=638d020deed12ec2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc825ffb700 1 -- 172.21.15.38:0/3195613033 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838001c20 con 0x5611e69fef10 2023-11-06T13:40:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc825ffb700 1 -- 172.21.15.38:0/3195613033 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838018070 con 0x5611e69fef10 2023-11-06T13:40:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc825ffb700 1 -- 172.21.15.38:0/3195613033 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838014760 con 0x5611e69fef10 2023-11-06T13:40:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 -- 172.21.15.38:0/3195613033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 msgr2=0x5611e6cbf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6cbf000 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc83800fc30 tx=0x7fc838013000).stop 2023-11-06T13:40:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 -- 172.21.15.38:0/3195613033 shutdown_connections 2023-11-06T13:40:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6ca9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6cbf000 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 --2- 172.21.15.38:0/3195613033 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6ca9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 -- 172.21.15.38:0/3195613033 >> 172.21.15.38:0/3195613033 conn(0x5611e6aac570 msgr2=0x5611e6c42dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 -- 172.21.15.38:0/3195613033 shutdown_connections 2023-11-06T13:40:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.660+0000 7fc858435b80 1 -- 172.21.15.38:0/3195613033 wait complete. 2023-11-06T13:40:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.661+0000 7fc858435b80 1 -- start start 2023-11-06T13:40:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.661+0000 7fc858435b80 1 Processor -- start 2023-11-06T13:40:14.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6c78e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6c73290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6b94650 con 0x5611e69fef10 2023-11-06T13:40:14.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6b948d0 con 0x5611e6cbf4f0 2023-11-06T13:40:14.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6b5fee0 con 0x5611e6ca9760 2023-11-06T13:40:14.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc858435b80 10 client.0 ll_register_callbacks cb 0x5611e6c02450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.662+0000 7fc844839700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6c78e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6c78e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37686/0 (socket says 172.21.15.38:37686) 2023-11-06T13:40:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 -- 172.21.15.38:0/1222548575 learned_addr learned my addr 172.21.15.38:0/1222548575 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc84503a700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6c73290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc83ffff700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 -- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 msgr2=0x5611e6c404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 -- 172.21.15.38:0/1222548575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 msgr2=0x5611e6c73290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6c73290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 -- 172.21.15.38:0/1222548575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8280033f0 con 0x5611e69fef10 2023-11-06T13:40:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc83ffff700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:40:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc844839700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6c78e60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc83800ff40 tx=0x7fc838017000).ready entity=mon.0 client_cookie=b6df7b48b8b2c6e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc81effd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc81effd700 1 -- 172.21.15.38:0/1222548575 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838025070 con 0x5611e69fef10 2023-11-06T13:40:14.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc81effd700 1 -- 172.21.15.38:0/1222548575 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc838004c40 con 0x5611e69fef10 2023-11-06T13:40:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611e6c36710 con 0x5611e69fef10 2023-11-06T13:40:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc81effd700 1 -- 172.21.15.38:0/1222548575 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc838014760 con 0x5611e69fef10 2023-11-06T13:40:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc858435b80 10 client.5655 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5611e6b88a90 con 0x5611e69fef10 2023-11-06T13:40:14.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.663+0000 7fc81effd700 1 -- 172.21.15.38:0/1222548575 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838035020 con 0x5611e69fef10 2023-11-06T13:40:14.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc81effd700 1 -- 172.21.15.38:0/1222548575 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fc838005240 con 0x5611e69fef10 2023-11-06T13:40:14.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc858435b80 10 client.5655 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:14.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc858435b80 10 client.5655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:14.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc858435b80 20 client.5655 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:14.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc858435b80 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6cc8ba0 0x5611e6cc8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc858435b80 4 client.5655 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:40:14.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611e69fad70 con 0x5611e6cc8ba0 2023-11-06T13:40:14.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc83ffff700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6cc8ba0 0x5611e6cc8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc81effd700 10 client.5655 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.664+0000 7fc83ffff700 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6cc8ba0 0x5611e6cc8fb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4ff94d21b089c8d0 server_cookie=9bc447a9776aded1 in_seq=0 out_seq=0 2023-11-06T13:40:14.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc81effd700 1 -- 172.21.15.38:0/1222548575 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5611e69fad70 con 0x5611e6cc8ba0 2023-11-06T13:40:14.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc81effd700 10 client.5655 handle_command_reply: tid=0 2023-11-06T13:40:14.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 client.5655 shutdown 2023-11-06T13:40:14.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 msgr2=0x5611e6c78e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6c78e60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc83800ff40 tx=0x7fc838017000).stop 2023-11-06T13:40:14.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 shutdown_connections 2023-11-06T13:40:14.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6cbf4f0 0x5611e6c73290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6c78e60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6cc8ba0 0x5611e6cc8fb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 --2- 172.21.15.38:0/1222548575 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 >> 172.21.15.38:0/1222548575 conn(0x5611e6aac570 msgr2=0x5611e6c42160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc81effd700 0 client.5655 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 shutdown_connections 2023-11-06T13:40:14.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 1 -- 172.21.15.38:0/1222548575 wait complete. 2023-11-06T13:40:14.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.665+0000 7fc858435b80 20 client.5655 trim_cache size 0 max 16384 2023-11-06T13:40:14.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.681+0000 7fc858435b80 1 Processor -- start 2023-11-06T13:40:14.701 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.681+0000 7fc858435b80 1 -- start start 2023-11-06T13:40:14.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc858435b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6ca8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc858435b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6ca9760 0x5611e6c42d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc858435b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6cbf4f0 0x5611e6d11440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.702 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc858435b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6cbf250 con 0x5611e69fef10 2023-11-06T13:40:14.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc858435b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6cbed60 con 0x5611e6ca9760 2023-11-06T13:40:14.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc858435b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6c3e990 con 0x5611e6cbf4f0 2023-11-06T13:40:14.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6ca8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6ca8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37698/0 (socket says 172.21.15.38:37698) 2023-11-06T13:40:14.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 -- 172.21.15.38:0/860589259 learned_addr learned my addr 172.21.15.38:0/860589259 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc83ffff700 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6ca9760 0x5611e6c42d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc84503a700 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6cbf4f0 0x5611e6d11440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 -- 172.21.15.38:0/860589259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6cbf4f0 msgr2=0x5611e6d11440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6cbf4f0 0x5611e6d11440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 -- 172.21.15.38:0/860589259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6ca9760 msgr2=0x5611e6c42d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6ca9760 0x5611e6c42d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 -- 172.21.15.38:0/860589259 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611e6c36330 con 0x5611e69fef10 2023-11-06T13:40:14.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc84503a700 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6cbf4f0 0x5611e6d11440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:40:14.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc844839700 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6ca8620 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fc838014fd0 tx=0x7fc838025000).ready entity=mon.0 client_cookie=65709429ee5e0270 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc8267fc700 1 -- 172.21.15.38:0/860589259 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838001c20 con 0x5611e69fef10 2023-11-06T13:40:14.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc8267fc700 1 -- 172.21.15.38:0/860589259 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838035040 con 0x5611e69fef10 2023-11-06T13:40:14.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.683+0000 7fc8267fc700 1 -- 172.21.15.38:0/860589259 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838005940 con 0x5611e69fef10 2023-11-06T13:40:14.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 -- 172.21.15.38:0/860589259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 msgr2=0x5611e6ca8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6ca8620 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fc838014fd0 tx=0x7fc838025000).stop 2023-11-06T13:40:14.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 -- 172.21.15.38:0/860589259 shutdown_connections 2023-11-06T13:40:14.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6cbf4f0 0x5611e6d11440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e69fef10 0x5611e6ca8620 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 --2- 172.21.15.38:0/860589259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e6ca9760 0x5611e6c42d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 -- 172.21.15.38:0/860589259 >> 172.21.15.38:0/860589259 conn(0x5611e6aac570 msgr2=0x5611e6c49d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 -- 172.21.15.38:0/860589259 shutdown_connections 2023-11-06T13:40:14.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.684+0000 7fc858435b80 1 -- 172.21.15.38:0/860589259 wait complete. 2023-11-06T13:40:14.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.685+0000 7fc858435b80 1 -- start start 2023-11-06T13:40:14.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.685+0000 7fc858435b80 1 Processor -- start 2023-11-06T13:40:14.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e69fef10 0x5611e6d0ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c3dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 0x5611e6d1b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d0d330 con 0x5611e6cbf4f0 2023-11-06T13:40:14.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d1e460 con 0x5611e69fef10 2023-11-06T13:40:14.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e6d1f2c0 con 0x5611e6ca9760 2023-11-06T13:40:14.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc858435b80 10 client.0 ll_register_callbacks cb 0x5611e6c02450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:14.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 0x5611e6d1b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc844839700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e69fef10 0x5611e6d0ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c3dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 0x5611e6d1b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37702/0 (socket says 172.21.15.38:37702) 2023-11-06T13:40:14.710 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 -- 172.21.15.38:0/2417414413 learned_addr learned my addr 172.21.15.38:0/2417414413 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 -- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 msgr2=0x5611e6c3dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c3dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 -- 172.21.15.38:0/2417414413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e69fef10 msgr2=0x5611e6d0ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e69fef10 0x5611e6d0ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 -- 172.21.15.38:0/2417414413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611e6b88a90 con 0x5611e6cbf4f0 2023-11-06T13:40:14.711 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc83ffff700 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:40:14.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc84503a700 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 0x5611e6d1b1f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fc830010000 tx=0x7fc830016000).ready entity=mon.0 client_cookie=31c91ecccee684a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.686+0000 7fc81effd700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:14.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc81effd700 1 -- 172.21.15.38:0/2417414413 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830024070 con 0x5611e6cbf4f0 2023-11-06T13:40:14.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc81effd700 1 -- 172.21.15.38:0/2417414413 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc83001e620 con 0x5611e6cbf4f0 2023-11-06T13:40:14.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc838018070 con 0x5611e6cbf4f0 2023-11-06T13:40:14.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc81effd700 1 -- 172.21.15.38:0/2417414413 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc830009d80 con 0x5611e6cbf4f0 2023-11-06T13:40:14.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 10 client.5661 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:14.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5611e6b887e0 con 0x5611e6cbf4f0 2023-11-06T13:40:14.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc81effd700 1 -- 172.21.15.38:0/2417414413 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838018070 con 0x5611e6cbf4f0 2023-11-06T13:40:14.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc81effd700 1 -- 172.21.15.38:0/2417414413 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fc83001e9f0 con 0x5611e6cbf4f0 2023-11-06T13:40:14.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 10 client.5661 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:14.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 10 client.5661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:14.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 20 client.5661 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:14.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6ca7ce0 0x5611e6c7fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 4 client.5661 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:40:14.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5611e6a31d70 con 0x5611e6ca7ce0 2023-11-06T13:40:14.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.687+0000 7fc844839700 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6ca7ce0 0x5611e6c7fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.688+0000 7fc81effd700 10 client.5661 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.688+0000 7fc844839700 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6ca7ce0 0x5611e6c7fd00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8b62b6d2ce18eadd server_cookie=fbe6b85661096107 in_seq=0 out_seq=0 2023-11-06T13:40:14.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc81effd700 1 -- 172.21.15.38:0/2417414413 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5611e6a31d70 con 0x5611e6ca7ce0 2023-11-06T13:40:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc81effd700 10 client.5661 handle_command_reply: tid=0 2023-11-06T13:40:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 client.5661 shutdown 2023-11-06T13:40:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 msgr2=0x5611e6d1b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 0x5611e6d1b1f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fc830010000 tx=0x7fc830016000).stop 2023-11-06T13:40:14.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 shutdown_connections 2023-11-06T13:40:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5611e6cbf4f0 0x5611e6d1b1f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611e69fef10 0x5611e6d0ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5611e6ca7ce0 0x5611e6c7fd00 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 --2- 172.21.15.38:0/2417414413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5611e6ca9760 0x5611e6c3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc81effd700 0 client.5661 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 >> 172.21.15.38:0/2417414413 conn(0x5611e6aac570 msgr2=0x5611e6c73680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 shutdown_connections 2023-11-06T13:40:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 1 -- 172.21.15.38:0/2417414413 wait complete. 2023-11-06T13:40:14.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.689+0000 7fc858435b80 20 client.5661 trim_cache size 0 max 16384 2023-11-06T13:40:14.719 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:40:14.719 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:40:14.719 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "019d327f-33c4-4ee4-99f5-a79a42e73060", 2023-11-06T13:40:14.719 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:40:14.720 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:40:14.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc82c08cb40 msgr2=0x7fc82c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc82c08cb40 0x7fc82c08f000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fc838005ad0 tx=0x7fc838009040).stop 2023-11-06T13:40:14.721 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 msgr2=0x7fc84016e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 0x7fc84016e0e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fc83400c490 tx=0x7fc834007c40).stop 2023-11-06T13:40:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 shutdown_connections 2023-11-06T13:40:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc840174ba0 0x7fc8400e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:40:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc82c08cb40 0x7fc82c08f000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.722 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840084420 0x7fc8401746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 --2- 172.21.15.38:0/2022726766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc840176b50 0x7fc84016e0e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 >> 172.21.15.38:0/2022726766 conn(0x7fc8400f2b30 msgr2=0x7fc8400efee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 shutdown_connections 2023-11-06T13:40:14.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.690+0000 7fc846a9d700 1 -- 172.21.15.38:0/2022726766 wait complete. 2023-11-06T13:40:14.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:40:14.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.845+0000 7f87c8174700 1 Processor -- start 2023-11-06T13:40:14.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.846+0000 7f87c8174700 1 -- start start 2023-11-06T13:40:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c8174700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f87c0180810 0x7f87c0085400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c8174700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f87c0182200 0x7f87c0182670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c8174700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00ee2f0 con 0x7f87c01573e0 2023-11-06T13:40:14.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c8174700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00858f0 con 0x7f87c0180810 2023-11-06T13:40:14.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c8174700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00ed400 con 0x7f87c0182200 2023-11-06T13:40:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c6711700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f87c0182200 0x7f87c0182670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c6711700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f87c0182200 0x7f87c0182670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:49252/0 (socket says 172.21.15.38:49252) 2023-11-06T13:40:14.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c6711700 1 -- 172.21.15.38:0/2461663310 learned_addr learned my addr 172.21.15.38:0/2461663310 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.847+0000 7f87c5f10700 1 --1- 172.21.15.38:0/2461663310 >> v1:172.21.15.163:6789/0 conn(0x7f87c01573e0 0x7f87c0180100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.163:6789/0 says I am v1:172.21.15.38:52398/0 (socket says 172.21.15.38:52398) 2023-11-06T13:40:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c6711700 1 -- 172.21.15.38:0/2461663310 >> v2:172.21.15.44:3300/0 conn(0x7f87c0180810 msgr2=0x7f87c0085400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c6711700 1 --2- 172.21.15.38:0/2461663310 >> v2:172.21.15.44:3300/0 conn(0x7f87c0180810 0x7f87c0085400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:40:14.856 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c6711700 1 -- 172.21.15.38:0/2461663310 >> v1:172.21.15.163:6789/0 conn(0x7f87c01573e0 legacy=0x7f87c0180100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c4f0e700 1 -- 172.21.15.38:0/2461663310 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722636307 0 0) 0x7f87c00ee2f0 con 0x7f87c01573e0 2023-11-06T13:40:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c6711700 1 -- 172.21.15.38:0/2461663310 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00ed6e0 con 0x7f87c0182200 2023-11-06T13:40:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c6711700 1 --2- 172.21.15.38:0/2461663310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c0182670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f87c0175cd0 tx=0x7f87b8009840).ready entity=mon.2 client_cookie=85b721f8dd545008 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c4f0e700 1 -- 172.21.15.38:0/2461663310 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800e070 con 0x7f87c0182200 2023-11-06T13:40:14.857 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c4f0e700 1 -- 172.21.15.38:0/2461663310 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800ba50 con 0x7f87c0182200 2023-11-06T13:40:14.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.848+0000 7f87c4f0e700 1 -- 172.21.15.38:0/2461663310 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800bdd0 con 0x7f87c0182200 2023-11-06T13:40:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 -- 172.21.15.38:0/2461663310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 msgr2=0x7f87c0182670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 --2- 172.21.15.38:0/2461663310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c0182670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f87c0175cd0 tx=0x7f87b8009840).stop 2023-11-06T13:40:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 -- 172.21.15.38:0/2461663310 shutdown_connections 2023-11-06T13:40:14.861 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 --2- 172.21.15.38:0/2461663310 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c0182670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 --2- 172.21.15.38:0/2461663310 >> v2:172.21.15.44:3300/0 conn(0x7f87c0180810 0x7f87c0085400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:40:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 -- 172.21.15.38:0/2461663310 >> 172.21.15.38:0/2461663310 conn(0x7f87c00ef5b0 msgr2=0x7f87c005e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 -- 172.21.15.38:0/2461663310 shutdown_connections 2023-11-06T13:40:14.862 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.849+0000 7f87c8174700 1 -- 172.21.15.38:0/2461663310 wait complete. 2023-11-06T13:40:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.850+0000 7f87c8174700 1 Processor -- start 2023-11-06T13:40:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.850+0000 7f87c8174700 1 -- start start 2023-11-06T13:40:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.851+0000 7f87c8174700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 0x7f87c01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.863 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.851+0000 7f87c8174700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87c0180810 0x7f87c01792a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.851+0000 7f87c8174700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c00648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.851+0000 7f87c8174700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0064450 con 0x7f87c01573e0 2023-11-06T13:40:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.851+0000 7f87c8174700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0063880 con 0x7f87c0180810 2023-11-06T13:40:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.851+0000 7f87c8174700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0063b20 con 0x7f87c0182200 2023-11-06T13:40:14.864 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 0x7f87c01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c570f700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87c0180810 0x7f87c01792a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 0x7f87c01524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37708/0 (socket says 172.21.15.38:37708) 2023-11-06T13:40:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 -- 172.21.15.38:0/4214570547 learned_addr learned my addr 172.21.15.38:0/4214570547 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c6711700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c00648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.865 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 -- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 msgr2=0x7f87c00648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c00648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 -- 172.21.15.38:0/4214570547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87c0180810 msgr2=0x7f87c01792a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87c0180810 0x7f87c01792a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.866 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 -- 172.21.15.38:0/4214570547 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009ae0 con 0x7f87c01573e0 2023-11-06T13:40:14.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c570f700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87c0180810 0x7f87c01792a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:40:14.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c5f10700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 0x7f87c01524e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f87bc00c4c0 tx=0x7f87bc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87b5ffb700 1 -- 172.21.15.38:0/4214570547 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00ce30 con 0x7f87c01573e0 2023-11-06T13:40:14.867 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87b5ffb700 1 -- 172.21.15.38:0/4214570547 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc0072e0 con 0x7f87c01573e0 2023-11-06T13:40:14.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c0063e00 con 0x7f87c01573e0 2023-11-06T13:40:14.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87b5ffb700 1 -- 172.21.15.38:0/4214570547 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0056e0 con 0x7f87c01573e0 2023-11-06T13:40:14.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.852+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c017c280 con 0x7f87c01573e0 2023-11-06T13:40:14.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.855+0000 7f87b5ffb700 1 -- 172.21.15.38:0/4214570547 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f87bc005a90 con 0x7f87c01573e0 2023-11-06T13:40:14.868 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.855+0000 7f87b5ffb700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87a408cb40 0x7f87a408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.855+0000 7f87b5ffb700 1 -- 172.21.15.38:0/4214570547 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f87bc0b1730 con 0x7f87c01573e0 2023-11-06T13:40:14.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.856+0000 7f87c570f700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87a408cb40 0x7f87a408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.856+0000 7f87c570f700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87a408cb40 0x7f87a408f000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f87c00ea050 tx=0x7f87b0009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.857+0000 7f87d9b0cb80 1 Processor -- start 2023-11-06T13:40:14.869 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.857+0000 7f87d9b0cb80 1 -- start start 2023-11-06T13:40:14.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c56400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59c12c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59c53c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.875 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59bd8fd0 con 0x55ee59c568f0 2023-11-06T13:40:14.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59b50240 con 0x55ee59c13110 2023-11-06T13:40:14.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59b65490 con 0x55ee599cfe90 2023-11-06T13:40:14.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59c12c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.876 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59c12c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37710/0 (socket says 172.21.15.38:37710) 2023-11-06T13:40:14.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 -- 172.21.15.38:0/3992785217 learned_addr learned my addr 172.21.15.38:0/3992785217 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c5f10700 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c56400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c6711700 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59c53c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 -- 172.21.15.38:0/3992785217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 msgr2=0x55ee59c56400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.877 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c56400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 -- 172.21.15.38:0/3992785217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 msgr2=0x55ee59c53c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59c53c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 -- 172.21.15.38:0/3992785217 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee59b5e670 con 0x55ee59c568f0 2023-11-06T13:40:14.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.858+0000 7f87c570f700 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59c12c20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f87b000eeb0 tx=0x7f87b0012000).ready entity=mon.0 client_cookie=24feefa1265150c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.878 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87aaffd700 1 -- 172.21.15.38:0/3992785217 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0013aa0 con 0x55ee59c568f0 2023-11-06T13:40:14.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87aaffd700 1 -- 172.21.15.38:0/3992785217 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b0013c00 con 0x55ee59c568f0 2023-11-06T13:40:14.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87aaffd700 1 -- 172.21.15.38:0/3992785217 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b001f460 con 0x55ee59c568f0 2023-11-06T13:40:14.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3992785217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 msgr2=0x55ee59c12c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59c12c20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f87b000eeb0 tx=0x7f87b0012000).stop 2023-11-06T13:40:14.879 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3992785217 shutdown_connections 2023-11-06T13:40:14.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59c53c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c56400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3992785217 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59c12c20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3992785217 >> 172.21.15.38:0/3992785217 conn(0x55ee59a7d4f0 msgr2=0x55ee59c13d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.880 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3992785217 shutdown_connections 2023-11-06T13:40:14.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.859+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3992785217 wait complete. 2023-11-06T13:40:14.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.860+0000 7f87d9b0cb80 1 -- start start 2023-11-06T13:40:14.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.860+0000 7f87d9b0cb80 1 Processor -- start 2023-11-06T13:40:14.881 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee599cfe90 0x55ee59c59f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c85be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee59c568f0 0x55ee59c92390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59b655d0 con 0x55ee59c13110 2023-11-06T13:40:14.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59b65850 con 0x55ee599cfe90 2023-11-06T13:40:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59b30e60 con 0x55ee59c568f0 2023-11-06T13:40:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87d9b0cb80 10 client.0 ll_register_callbacks cb 0x55ee59bd33d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87c570f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c85be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87c570f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c85be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37718/0 (socket says 172.21.15.38:37718) 2023-11-06T13:40:14.883 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87c570f700 1 -- 172.21.15.38:0/3824236722 learned_addr learned my addr 172.21.15.38:0/3824236722 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87c5f10700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee599cfe90 0x55ee59c59f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.861+0000 7f87c6711700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee59c568f0 0x55ee59c92390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87c570f700 1 -- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee59c568f0 msgr2=0x55ee59c92390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87c570f700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee59c568f0 0x55ee59c92390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.884 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87c570f700 1 -- 172.21.15.38:0/3824236722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee599cfe90 msgr2=0x55ee59c59f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87c570f700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee599cfe90 0x55ee59c59f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87c570f700 1 -- 172.21.15.38:0/3824236722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b000ead0 con 0x55ee59c13110 2023-11-06T13:40:14.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87c570f700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c85be0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f87b0009c40 tx=0x7f87b0015000).ready entity=mon.0 client_cookie=1d20ea29c3578dac server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f879ffff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:14.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f879ffff700 1 -- 172.21.15.38:0/3824236722 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0027070 con 0x55ee59c13110 2023-11-06T13:40:14.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f879ffff700 1 -- 172.21.15.38:0/3824236722 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f87b001f460 con 0x55ee59c13110 2023-11-06T13:40:14.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee59c07690 con 0x55ee59c13110 2023-11-06T13:40:14.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f879ffff700 1 -- 172.21.15.38:0/3824236722 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87b0013aa0 con 0x55ee59c13110 2023-11-06T13:40:14.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 10 client.5670 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:14.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55ee59b59a10 con 0x55ee59c13110 2023-11-06T13:40:14.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f879ffff700 1 -- 172.21.15.38:0/3824236722 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ee59c07690 con 0x55ee59c13110 2023-11-06T13:40:14.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f879ffff700 1 -- 172.21.15.38:0/3824236722 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f87b002b3a0 con 0x55ee59c13110 2023-11-06T13:40:14.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 10 client.5670 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:14.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 10 client.5670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:14.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 20 client.5670 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:14.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c484f0 0x55ee59c85050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.862+0000 7f87d9b0cb80 4 client.5670 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:40:14.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.863+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee599cbcf0 con 0x55ee59c484f0 2023-11-06T13:40:14.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.863+0000 7f87c5f10700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c484f0 0x55ee59c85050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.863+0000 7f879ffff700 10 client.5670 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.863+0000 7f87c5f10700 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c484f0 0x55ee59c85050 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ddf7d705fcb23e7 server_cookie=d28a984047fc6c99 in_seq=0 out_seq=0 2023-11-06T13:40:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f879ffff700 1 -- 172.21.15.38:0/3824236722 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55ee599cbcf0 con 0x55ee59c484f0 2023-11-06T13:40:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f879ffff700 10 client.5670 handle_command_reply: tid=0 2023-11-06T13:40:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 client.5670 shutdown 2023-11-06T13:40:14.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 msgr2=0x55ee59c85be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c85be0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f87b0009c40 tx=0x7f87b0015000).stop 2023-11-06T13:40:14.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 shutdown_connections 2023-11-06T13:40:14.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c484f0 0x55ee59c85050 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee59c568f0 0x55ee59c92390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee599cfe90 0x55ee59c59f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/3824236722 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c85be0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 >> 172.21.15.38:0/3824236722 conn(0x55ee59a7d4f0 msgr2=0x55ee59c831f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f879ffff700 0 client.5670 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 shutdown_connections 2023-11-06T13:40:14.891 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/3824236722 wait complete. 2023-11-06T13:40:14.892 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.865+0000 7f87d9b0cb80 20 client.5670 trim_cache size 0 max 16384 2023-11-06T13:40:14.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.883+0000 7f87d9b0cb80 1 Processor -- start 2023-11-06T13:40:14.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.883+0000 7f87d9b0cb80 1 -- start start 2023-11-06T13:40:14.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c0f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59cdaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59cdafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59c920e0 con 0x55ee59c568f0 2023-11-06T13:40:14.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59cdbc00 con 0x55ee59c13110 2023-11-06T13:40:14.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59c83bf0 con 0x55ee599cfe90 2023-11-06T13:40:14.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59cdafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59cdafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37730/0 (socket says 172.21.15.38:37730) 2023-11-06T13:40:14.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 -- 172.21.15.38:0/831511172 learned_addr learned my addr 172.21.15.38:0/831511172 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c5f10700 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c0f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c570f700 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59cdaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 -- 172.21.15.38:0/831511172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 msgr2=0x55ee59c0f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c0f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 -- 172.21.15.38:0/831511172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 msgr2=0x55ee59cdaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59cdaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 -- 172.21.15.38:0/831511172 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee59b59760 con 0x55ee59c568f0 2023-11-06T13:40:14.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.884+0000 7f87c6711700 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59cdafe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f87c00ed540 tx=0x7f87b8009840).ready entity=mon.0 client_cookie=9c235dc23b360d6d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87ab7fe700 1 -- 172.21.15.38:0/831511172 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8025070 con 0x55ee59c568f0 2023-11-06T13:40:14.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87ab7fe700 1 -- 172.21.15.38:0/831511172 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80093b0 con 0x55ee59c568f0 2023-11-06T13:40:14.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87ab7fe700 1 -- 172.21.15.38:0/831511172 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800bbc0 con 0x55ee59c568f0 2023-11-06T13:40:14.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/831511172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 msgr2=0x55ee59cdafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59cdafe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f87c00ed540 tx=0x7f87b8009840).stop 2023-11-06T13:40:14.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/831511172 shutdown_connections 2023-11-06T13:40:14.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c568f0 0x55ee59cdafe0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59c0f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/831511172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c13110 0x55ee59cdaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/831511172 >> 172.21.15.38:0/831511172 conn(0x55ee59a7d4f0 msgr2=0x55ee59c13d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/831511172 shutdown_connections 2023-11-06T13:40:14.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.885+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/831511172 wait complete. 2023-11-06T13:40:14.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.886+0000 7f87d9b0cb80 1 -- start start 2023-11-06T13:40:14.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.886+0000 7f87d9b0cb80 1 Processor -- start 2023-11-06T13:40:14.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59ceb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.904 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c13d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c568f0 0x55ee59c19240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59c19e60 con 0x55ee59c13110 2023-11-06T13:40:14.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59cebc40 con 0x55ee59c568f0 2023-11-06T13:40:14.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee59ceb500 con 0x55ee599cfe90 2023-11-06T13:40:14.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87d9b0cb80 10 client.0 ll_register_callbacks cb 0x55ee59bd33d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:14.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87c570f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c13d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87c570f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c13d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:37740/0 (socket says 172.21.15.38:37740) 2023-11-06T13:40:14.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87c5f10700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59ceb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87c570f700 1 -- 172.21.15.38:0/1013132264 learned_addr learned my addr 172.21.15.38:0/1013132264 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:14.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.887+0000 7f87c6711700 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c568f0 0x55ee59c19240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87c570f700 1 -- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 msgr2=0x55ee59ceb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87c570f700 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59ceb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87c570f700 1 -- 172.21.15.38:0/1013132264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c568f0 msgr2=0x55ee59c19240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:14.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87c570f700 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c568f0 0x55ee59c19240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87c570f700 1 -- 172.21.15.38:0/1013132264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c00ed6e0 con 0x55ee59c13110 2023-11-06T13:40:14.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87c570f700 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c13d20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x55ee59c79d80 tx=0x7f87b0027000).ready entity=mon.0 client_cookie=e3e7033b1771dbf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:14.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f879ffff700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:14.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f879ffff700 1 -- 172.21.15.38:0/1013132264 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b002b8b0 con 0x55ee59c13110 2023-11-06T13:40:14.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f879ffff700 1 -- 172.21.15.38:0/1013132264 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f87b0006c80 con 0x55ee59c13110 2023-11-06T13:40:14.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87b0013c00 con 0x55ee59c13110 2023-11-06T13:40:14.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f879ffff700 1 -- 172.21.15.38:0/1013132264 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87b001f460 con 0x55ee59c13110 2023-11-06T13:40:14.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87d9b0cb80 10 client.5676 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:14.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55ee599d0fd0 con 0x55ee59c13110 2023-11-06T13:40:14.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.888+0000 7f879ffff700 1 -- 172.21.15.38:0/1013132264 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b0013c00 con 0x55ee59c13110 2023-11-06T13:40:14.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f879ffff700 1 -- 172.21.15.38:0/1013132264 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f87b00058b0 con 0x55ee59c13110 2023-11-06T13:40:14.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87d9b0cb80 10 client.5676 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:14.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87d9b0cb80 10 client.5676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:14.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87d9b0cb80 20 client.5676 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:14.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c95220 0x55ee59cd6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:14.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87d9b0cb80 4 client.5676 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:40:14.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee59a02cf0 con 0x55ee59c95220 2023-11-06T13:40:14.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87c5f10700 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c95220 0x55ee59cd6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:14.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f87c5f10700 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c95220 0x55ee59cd6300 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7b35173ec83fbbd6 server_cookie=5e8e5590aaef5681 in_seq=0 out_seq=0 2023-11-06T13:40:14.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.889+0000 7f879ffff700 10 client.5676 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.911 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f879ffff700 1 -- 172.21.15.38:0/1013132264 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ee59a02cf0 con 0x55ee59c95220 2023-11-06T13:40:14.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f879ffff700 10 client.5676 handle_command_reply: tid=0 2023-11-06T13:40:14.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 client.5676 shutdown 2023-11-06T13:40:14.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 msgr2=0x55ee59c13d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c13d20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x55ee59c79d80 tx=0x7f87b0027000).stop 2023-11-06T13:40:14.912 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 shutdown_connections 2023-11-06T13:40:14.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee59c568f0 0x55ee59c19240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ee59c95220 0x55ee59cd6300 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ee599cfe90 0x55ee59ceb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f879ffff700 0 client.5676 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:14.913 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 --2- 172.21.15.38:0/1013132264 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ee59c13110 0x55ee59c13d20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 >> 172.21.15.38:0/1013132264 conn(0x55ee59a7d4f0 msgr2=0x55ee59c85190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 shutdown_connections 2023-11-06T13:40:14.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 1 -- 172.21.15.38:0/1013132264 wait complete. 2023-11-06T13:40:14.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87d9b0cb80 20 client.5676 trim_cache size 0 max 16384 2023-11-06T13:40:14.915 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:40:14.915 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:40:14.915 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:40:14.915 INFO:teuthology.orchestra.run.smithi038.stdout: "019d327f-33c4-4ee4-99f5-a79a42e73060": { 2023-11-06T13:40:14.916 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:40:14.916 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "019d327f-33c4-4ee4-99f5-a79a42e73060", 2023-11-06T13:40:14.916 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:40:14.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:40:14.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:40:14.917 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:40:14.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87a408cb40 msgr2=0x7f87a408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87c8174700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87a408cb40 0x7f87a408f000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f87c00ea050 tx=0x7f87b0009060).stop 2023-11-06T13:40:14.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 msgr2=0x7f87c01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:14.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.890+0000 7f87c8174700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 0x7f87c01524e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f87bc00c4c0 tx=0x7f87bc007c10).stop 2023-11-06T13:40:14.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 shutdown_connections 2023-11-06T13:40:14.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c0182200 0x7f87c00648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87c01573e0 0x7f87c01524e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87a408cb40 0x7f87a408f000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 --2- 172.21.15.38:0/4214570547 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87c0180810 0x7f87c01792a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:14.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 >> 172.21.15.38:0/4214570547 conn(0x7f87c00ef5b0 msgr2=0x7f87c0174ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:14.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 shutdown_connections 2023-11-06T13:40:14.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:14.891+0000 7f87c8174700 1 -- 172.21.15.38:0/4214570547 wait complete. 2023-11-06T13:40:14.921 INFO:tasks.cephfs.filesystem:scrub status for tag:019d327f-33c4-4ee4-99f5-a79a42e73060 - {'path': '/', 'tag': '019d327f-33c4-4ee4-99f5-a79a42e73060', 'options': 'recursive,force'} 2023-11-06T13:40:44.922 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:40:45.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.083+0000 7f907e183700 1 Processor -- start 2023-11-06T13:40:45.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.083+0000 7f907e183700 1 -- start start 2023-11-06T13:40:45.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f907e183700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9078178a70 0x7f9078178e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f907e183700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9078064150 0x7f9078064600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f907e183700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907817dc00 con 0x7f907817e090 2023-11-06T13:40:45.089 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f907e183700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9078064af0 con 0x7f9078178a70 2023-11-06T13:40:45.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f907e183700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907817cd10 con 0x7f9078064150 2023-11-06T13:40:45.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9078178a70 0x7f9078178e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f906ffff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f9078064150 0x7f9078064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.090 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f9078178a70 0x7f9078178e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47982/0 (socket says 172.21.15.38:47982) 2023-11-06T13:40:45.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 -- 172.21.15.38:0/1091990662 learned_addr learned my addr 172.21.15.38:0/1091990662 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:45.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 -- 172.21.15.38:0/1091990662 >> v2:172.21.15.163:3300/0 conn(0x7f9078064150 msgr2=0x7f9078064600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 --2- 172.21.15.38:0/1091990662 >> v2:172.21.15.163:3300/0 conn(0x7f9078064150 0x7f9078064600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.091 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 -- 172.21.15.38:0/1091990662 >> v1:172.21.15.38:6789/0 conn(0x7f907817e090 legacy=0x7f907817e500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:40:45.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.085+0000 7f90777fe700 1 -- 172.21.15.38:0/1091990662 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907817cff0 con 0x7f9078178a70 2023-11-06T13:40:45.092 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.086+0000 7f90777fe700 1 --2- 172.21.15.38:0/1091990662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9078178a70 0x7f9078178e50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f9078088e30 tx=0x7f90680090f0).ready entity=mon.0 client_cookie=2d32be69881bb8a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.093 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.086+0000 7f9076ffd700 1 -- 172.21.15.38:0/1091990662 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800f510 con 0x7f9078178a70 2023-11-06T13:40:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.086+0000 7f9076ffd700 1 -- 172.21.15.38:0/1091990662 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906800f670 con 0x7f9078178a70 2023-11-06T13:40:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.086+0000 7f9076ffd700 1 -- 172.21.15.38:0/1091990662 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800f9f0 con 0x7f9078178a70 2023-11-06T13:40:45.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 -- 172.21.15.38:0/1091990662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9078178a70 msgr2=0x7f9078178e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 --2- 172.21.15.38:0/1091990662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9078178a70 0x7f9078178e50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f9078088e30 tx=0x7f90680090f0).stop 2023-11-06T13:40:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 -- 172.21.15.38:0/1091990662 shutdown_connections 2023-11-06T13:40:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 --2- 172.21.15.38:0/1091990662 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9078178a70 0x7f9078178e50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 --2- 172.21.15.38:0/1091990662 >> v2:172.21.15.163:3300/0 conn(0x7f9078064150 0x7f9078064600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.095 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 -- 172.21.15.38:0/1091990662 >> 172.21.15.38:0/1091990662 conn(0x7f9078069ea0 msgr2=0x7f907806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:45.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 -- 172.21.15.38:0/1091990662 shutdown_connections 2023-11-06T13:40:45.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.087+0000 7f907e183700 1 -- 172.21.15.38:0/1091990662 wait complete. 2023-11-06T13:40:45.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.089+0000 7f907e183700 1 Processor -- start 2023-11-06T13:40:45.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.089+0000 7f907e183700 1 -- start start 2023-11-06T13:40:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.090+0000 7f907e183700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 0x7f9078168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.090+0000 7f907e183700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9078178a70 0x7f9078192be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.090+0000 7f907e183700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 0x7f90781903c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.090+0000 7f907e183700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90781722a0 con 0x7f907817e090 2023-11-06T13:40:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.090+0000 7f907e183700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90781713d0 con 0x7f9078178a70 2023-11-06T13:40:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.090+0000 7f907e183700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078171690 con 0x7f9078064150 2023-11-06T13:40:45.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 0x7f90781903c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f90777fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 0x7f9078168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f90777fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 0x7f9078168260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:38846/0 (socket says 172.21.15.38:38846) 2023-11-06T13:40:45.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 0x7f90781903c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47994/0 (socket says 172.21.15.38:47994) 2023-11-06T13:40:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f90777fe700 1 -- 172.21.15.38:0/2130330898 learned_addr learned my addr 172.21.15.38:0/2130330898 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f906ffff700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9078178a70 0x7f9078192be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 -- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 msgr2=0x7f9078168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 0x7f9078168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 -- 172.21.15.38:0/2130330898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9078178a70 msgr2=0x7f9078192be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.103 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9078178a70 0x7f9078192be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.091+0000 7f9077fff700 1 -- 172.21.15.38:0/2130330898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068009370 con 0x7f907817e090 2023-11-06T13:40:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f90777fe700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 0x7f9078168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:40:45.104 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f9077fff700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 0x7f90781903c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f907000b810 tx=0x7f90700091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f906f7fe700 1 -- 172.21.15.38:0/2130330898 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000d4a0 con 0x7f907817e090 2023-11-06T13:40:45.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f906f7fe700 1 -- 172.21.15.38:0/2130330898 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000d600 con 0x7f907817e090 2023-11-06T13:40:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078171970 con 0x7f907817e090 2023-11-06T13:40:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078171f30 con 0x7f907817e090 2023-11-06T13:40:45.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.092+0000 7f906f7fe700 1 -- 172.21.15.38:0/2130330898 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000d9c0 con 0x7f907817e090 2023-11-06T13:40:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.094+0000 7f906f7fe700 1 -- 172.21.15.38:0/2130330898 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f9070011400 con 0x7f907817e090 2023-11-06T13:40:45.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.095+0000 7f906f7fe700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f905808cb40 0x7f905808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.095+0000 7f906f7fe700 1 -- 172.21.15.38:0/2130330898 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f90700b1730 con 0x7f907817e090 2023-11-06T13:40:45.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.096+0000 7f90777fe700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f905808cb40 0x7f905808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.096+0000 7f90777fe700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f905808cb40 0x7f905808f000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f9068006d00 tx=0x7f9068017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.097+0000 7f908fb1bb80 1 Processor -- start 2023-11-06T13:40:45.116 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.097+0000 7f908fb1bb80 1 -- start start 2023-11-06T13:40:45.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b188c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18884c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18885110 0x555b188c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b1884afd0 con 0x555b188c88f0 2023-11-06T13:40:45.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b187c2240 con 0x555b18641e90 2023-11-06T13:40:45.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b187d7490 con 0x555b18885110 2023-11-06T13:40:45.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18884c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18884c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48002/0 (socket says 172.21.15.38:48002) 2023-11-06T13:40:45.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 -- 172.21.15.38:0/3687618036 learned_addr learned my addr 172.21.15.38:0/3687618036 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:45.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f9077fff700 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18885110 0x555b188c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f90777fe700 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b188c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 -- 172.21.15.38:0/3687618036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18885110 msgr2=0x555b188c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18885110 0x555b188c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 -- 172.21.15.38:0/3687618036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 msgr2=0x555b188c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b188c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.098+0000 7f906ffff700 1 -- 172.21.15.38:0/3687618036 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b187d0670 con 0x555b188c88f0 2023-11-06T13:40:45.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.099+0000 7f906ffff700 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18884c20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f90600099f0 tx=0x7f9060008040).ready entity=mon.0 client_cookie=107878cde8a4a818 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.099+0000 7f906cff9700 1 -- 172.21.15.38:0/3687618036 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060009500 con 0x555b188c88f0 2023-11-06T13:40:45.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.099+0000 7f906cff9700 1 -- 172.21.15.38:0/3687618036 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060011540 con 0x555b188c88f0 2023-11-06T13:40:45.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.099+0000 7f906cff9700 1 -- 172.21.15.38:0/3687618036 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600118c0 con 0x555b188c88f0 2023-11-06T13:40:45.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.099+0000 7f908fb1bb80 1 -- 172.21.15.38:0/3687618036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 msgr2=0x555b18884c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.099+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18884c20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f90600099f0 tx=0x7f9060008040).stop 2023-11-06T13:40:45.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 -- 172.21.15.38:0/3687618036 shutdown_connections 2023-11-06T13:40:45.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18885110 0x555b188c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b188c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/3687618036 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18884c20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 -- 172.21.15.38:0/3687618036 >> 172.21.15.38:0/3687618036 conn(0x555b186ef4f0 msgr2=0x555b18885d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:45.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 -- 172.21.15.38:0/3687618036 shutdown_connections 2023-11-06T13:40:45.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 -- 172.21.15.38:0/3687618036 wait complete. 2023-11-06T13:40:45.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.100+0000 7f908fb1bb80 1 -- start start 2023-11-06T13:40:45.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.101+0000 7f908fb1bb80 1 Processor -- start 2023-11-06T13:40:45.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 0x555b18903eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b188b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b187d75d0 con 0x555b18641e90 2023-11-06T13:40:45.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b187d7850 con 0x555b18885110 2023-11-06T13:40:45.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b187a2e60 con 0x555b188c88f0 2023-11-06T13:40:45.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f908fb1bb80 10 client.0 ll_register_callbacks cb 0x555b188453d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:45.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 0x555b18903eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 0x555b18903eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48008/0 (socket says 172.21.15.38:48008) 2023-11-06T13:40:45.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 -- 172.21.15.38:0/4154862003 learned_addr learned my addr 172.21.15.38:0/4154862003 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:45.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f9077fff700 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b188b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 -- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 msgr2=0x555b188b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b188b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 -- 172.21.15.38:0/4154862003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 msgr2=0x555b188c0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:40:45.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.102+0000 7f90777fe700 1 -- 172.21.15.38:0/4154862003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90600096d0 con 0x555b18641e90 2023-11-06T13:40:45.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f90777fe700 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 0x555b18903eb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f9068011d10 tx=0x7f906801f040).ready entity=mon.0 client_cookie=2e8a3800ae9d24ae server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f9055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:45.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f9055ffb700 1 -- 172.21.15.38:0/4154862003 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906801dad0 con 0x555b18641e90 2023-11-06T13:40:45.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f9055ffb700 1 -- 172.21.15.38:0/4154862003 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f906801dc30 con 0x555b18641e90 2023-11-06T13:40:45.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b18879690 con 0x555b18641e90 2023-11-06T13:40:45.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f9055ffb700 1 -- 172.21.15.38:0/4154862003 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906801de80 con 0x555b18641e90 2023-11-06T13:40:45.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f908fb1bb80 10 client.5688 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:45.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x555b187cba10 con 0x555b18641e90 2023-11-06T13:40:45.132 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f9055ffb700 1 -- 172.21.15.38:0/4154862003 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b18879690 con 0x555b18641e90 2023-11-06T13:40:45.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f9055ffb700 1 -- 172.21.15.38:0/4154862003 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f9068032410 con 0x555b18641e90 2023-11-06T13:40:45.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.103+0000 7f908fb1bb80 10 client.5688 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:45.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.104+0000 7f908fb1bb80 10 client.5688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:45.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.104+0000 7f908fb1bb80 20 client.5688 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:45.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.104+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b1888c5e0 0x555b1888ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.104+0000 7f908fb1bb80 4 client.5688 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:40:45.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.104+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b1863dcf0 con 0x555b1888c5e0 2023-11-06T13:40:45.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.104+0000 7f906ffff700 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b1888c5e0 0x555b1888ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.105+0000 7f9055ffb700 10 client.5688 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:45.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.105+0000 7f906ffff700 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b1888c5e0 0x555b1888ca30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7dd5dc424f897c0b server_cookie=1bacbcf6e4a16270 in_seq=0 out_seq=0 2023-11-06T13:40:45.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.107+0000 7f9055ffb700 1 -- 172.21.15.38:0/4154862003 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x555b1863dcf0 con 0x555b1888c5e0 2023-11-06T13:40:45.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.107+0000 7f9055ffb700 10 client.5688 handle_command_reply: tid=0 2023-11-06T13:40:45.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.107+0000 7f908fb1bb80 1 client.5688 shutdown 2023-11-06T13:40:45.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 msgr2=0x555b18903eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 0x555b18903eb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f9068011d10 tx=0x7f906801f040).stop 2023-11-06T13:40:45.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 shutdown_connections 2023-11-06T13:40:45.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b1888c5e0 0x555b1888ca30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b188b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18641e90 0x555b18903eb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/4154862003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188c0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:40:45.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f9055ffb700 0 client.5688 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:45.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 >> 172.21.15.38:0/4154862003 conn(0x555b186ef4f0 msgr2=0x555b188c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:45.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 shutdown_connections 2023-11-06T13:40:45.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 1 -- 172.21.15.38:0/4154862003 wait complete. 2023-11-06T13:40:45.137 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.108+0000 7f908fb1bb80 20 client.5688 trim_cache size 0 max 16384 2023-11-06T13:40:45.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.127+0000 7f908fb1bb80 1 Processor -- start 2023-11-06T13:40:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.127+0000 7f908fb1bb80 1 -- start start 2023-11-06T13:40:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18641e90 0x555b188f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18951170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b188c7020 con 0x555b188c88f0 2023-11-06T13:40:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b188c83f0 con 0x555b18885110 2023-11-06T13:40:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b18881cc0 con 0x555b18641e90 2023-11-06T13:40:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f9077fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18951170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f9077fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18951170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48010/0 (socket says 172.21.15.38:48010) 2023-11-06T13:40:45.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f9077fff700 1 -- 172.21.15.38:0/2402253126 learned_addr learned my addr 172.21.15.38:0/2402253126 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:45.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f906ffff700 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.128+0000 7f90777fe700 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18641e90 0x555b188f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f9077fff700 1 -- 172.21.15.38:0/2402253126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18641e90 msgr2=0x555b188f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f9077fff700 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18641e90 0x555b188f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f9077fff700 1 -- 172.21.15.38:0/2402253126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 msgr2=0x555b188b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f9077fff700 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f9077fff700 1 -- 172.21.15.38:0/2402253126 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b188792b0 con 0x555b188c88f0 2023-11-06T13:40:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f9077fff700 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18951170 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9070000f80 tx=0x7f9070087040).ready entity=mon.0 client_cookie=35e94d16f7e3c83f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f906d7fa700 1 -- 172.21.15.38:0/2402253126 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070090070 con 0x555b188c88f0 2023-11-06T13:40:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f906d7fa700 1 -- 172.21.15.38:0/2402253126 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907008b2e0 con 0x555b188c88f0 2023-11-06T13:40:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.129+0000 7f906d7fa700 1 -- 172.21.15.38:0/2402253126 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000dd70 con 0x555b188c88f0 2023-11-06T13:40:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 -- 172.21.15.38:0/2402253126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 msgr2=0x555b18951170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18951170 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9070000f80 tx=0x7f9070087040).stop 2023-11-06T13:40:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 -- 172.21.15.38:0/2402253126 shutdown_connections 2023-11-06T13:40:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b188c88f0 0x555b18951170 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b18641e90 0x555b188f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/2402253126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18885110 0x555b188b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 -- 172.21.15.38:0/2402253126 >> 172.21.15.38:0/2402253126 conn(0x555b186ef4f0 msgr2=0x555b1888c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 -- 172.21.15.38:0/2402253126 shutdown_connections 2023-11-06T13:40:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 -- 172.21.15.38:0/2402253126 wait complete. 2023-11-06T13:40:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.130+0000 7f908fb1bb80 1 -- start start 2023-11-06T13:40:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.131+0000 7f908fb1bb80 1 Processor -- start 2023-11-06T13:40:45.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b18951460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 0x555b18883430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b18950bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b188f4040 con 0x555b18885110 2023-11-06T13:40:45.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b188f8190 con 0x555b18641e90 2023-11-06T13:40:45.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b18884060 con 0x555b188c88f0 2023-11-06T13:40:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 10 client.0 ll_register_callbacks cb 0x555b188453d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:40:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 0x555b18883430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 0x555b18883430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:48016/0 (socket says 172.21.15.38:48016) 2023-11-06T13:40:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 -- 172.21.15.38:0/425184337 learned_addr learned my addr 172.21.15.38:0/425184337 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:40:45.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f90777fe700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b18951460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f9077fff700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b18950bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 -- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 msgr2=0x555b18950bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b18950bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 -- 172.21.15.38:0/425184337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 msgr2=0x555b18951460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:40:45.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b18951460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 -- 172.21.15.38:0/425184337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078171f30 con 0x555b18885110 2023-11-06T13:40:45.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f906ffff700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 0x555b18883430 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f90780ec4e0 tx=0x7f9060025280).ready entity=mon.0 client_cookie=cb63137dfda07d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:40:45.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f9055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:40:45.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f9055ffb700 1 -- 172.21.15.38:0/425184337 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060000bc0 con 0x555b18885110 2023-11-06T13:40:45.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f9055ffb700 1 -- 172.21.15.38:0/425184337 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f90600116b0 con 0x555b18885110 2023-11-06T13:40:45.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.132+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9060011540 con 0x555b18885110 2023-11-06T13:40:45.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f9055ffb700 1 -- 172.21.15.38:0/425184337 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9060000d20 con 0x555b18885110 2023-11-06T13:40:45.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 10 client.5694 fetch_fsmap learned FSMap version 44 2023-11-06T13:40:45.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x555b187cb760 con 0x555b18885110 2023-11-06T13:40:45.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f9055ffb700 1 -- 172.21.15.38:0/425184337 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060011540 con 0x555b18885110 2023-11-06T13:40:45.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f9055ffb700 1 -- 172.21.15.38:0/425184337 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 44) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f9060015480 con 0x555b18885110 2023-11-06T13:40:45.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 10 client.5694 fetch_fsmap finished waiting for FSMap version 44 2023-11-06T13:40:45.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 10 client.5694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:40:45.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 20 client.5694 populate_metadata read hostname 'smithi038' 2023-11-06T13:40:45.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b188f7a30 0x555b188c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:40:45.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 4 client.5694 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:40:45.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555b18674cf0 con 0x555b188f7a30 2023-11-06T13:40:45.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f90777fe700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b188f7a30 0x555b188c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:40:45.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f9055ffb700 10 client.5694 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:45.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.133+0000 7f90777fe700 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b188f7a30 0x555b188c5c00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=187eb81a6cd721f0 server_cookie=be383bd4c2e21ae1 in_seq=0 out_seq=0 2023-11-06T13:40:45.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f9055ffb700 1 -- 172.21.15.38:0/425184337 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555b18674cf0 con 0x555b188f7a30 2023-11-06T13:40:45.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f9055ffb700 10 client.5694 handle_command_reply: tid=0 2023-11-06T13:40:45.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 client.5694 shutdown 2023-11-06T13:40:45.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 msgr2=0x555b18883430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 0x555b18883430 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f90780ec4e0 tx=0x7f9060025280).stop 2023-11-06T13:40:45.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 shutdown_connections 2023-11-06T13:40:45.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x555b188f7a30 0x555b188c5c00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555b188c88f0 0x555b18950bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b18641e90 0x555b18951460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 --2- 172.21.15.38:0/425184337 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x555b18885110 0x555b18883430 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f9055ffb700 0 client.5694 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:40:45.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 >> 172.21.15.38:0/425184337 conn(0x555b186ef4f0 msgr2=0x555b188c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:45.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 shutdown_connections 2023-11-06T13:40:45.160 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 1 -- 172.21.15.38:0/425184337 wait complete. 2023-11-06T13:40:45.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f908fb1bb80 20 client.5694 trim_cache size 0 max 16384 2023-11-06T13:40:45.161 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:40:45.161 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:40:45.162 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:40:45.162 INFO:teuthology.orchestra.run.smithi038.stdout: "019d327f-33c4-4ee4-99f5-a79a42e73060": { 2023-11-06T13:40:45.162 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:40:45.162 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "019d327f-33c4-4ee4-99f5-a79a42e73060", 2023-11-06T13:40:45.162 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:40:45.163 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:40:45.163 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:40:45.163 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:40:45.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f905808cb40 msgr2=0x7f905808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f905808cb40 0x7f905808f000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f9068006d00 tx=0x7f9068017000).stop 2023-11-06T13:40:45.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 msgr2=0x7f90781903c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:40:45.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 0x7f90781903c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f907000b810 tx=0x7f90700091d0).stop 2023-11-06T13:40:45.165 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 shutdown_connections 2023-11-06T13:40:45.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f907817e090 0x7f90781903c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9078064150 0x7f9078168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f905808cb40 0x7f905808f000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 --2- 172.21.15.38:0/2130330898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9078178a70 0x7f9078192be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:40:45.166 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 >> 172.21.15.38:0/2130330898 conn(0x7f9078069ea0 msgr2=0x7f9078172b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:40:45.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 shutdown_connections 2023-11-06T13:40:45.167 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:40:45.134+0000 7f907e183700 1 -- 172.21.15.38:0/2130330898 wait complete. 2023-11-06T13:40:45.167 INFO:tasks.cephfs.filesystem:scrub status for tag:019d327f-33c4-4ee4-99f5-a79a42e73060 - {'path': '/', 'tag': '019d327f-33c4-4ee4-99f5-a79a42e73060', 'options': 'recursive,force'} 2023-11-06T13:41:15.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:41:15.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.339+0000 7fc30b6e2700 1 Processor -- start 2023-11-06T13:41:15.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.339+0000 7fc30b6e2700 1 -- start start 2023-11-06T13:41:15.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30b6e2700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc304156f00 0x7fc3041572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30b6e2700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3041577d0 con 0x7fc3040ec480 2023-11-06T13:41:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30b6e2700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3041818d0 con 0x7fc3040e86d0 2023-11-06T13:41:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30b6e2700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc304181bb0 con 0x7fc304156f00 2023-11-06T13:41:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30947e700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc304156f00 0x7fc3041572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc308c7d700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7fc3040ec480 0x7fc3040ec900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:37518/0 (socket says 172.21.15.38:37518) 2023-11-06T13:41:15.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc308c7d700 1 -- 172.21.15.38:0/3255849223 learned_addr learned my addr 172.21.15.38:0/3255849223 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:41:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30947e700 1 -- 172.21.15.38:0/3255849223 >> v1:172.21.15.44:6789/0 conn(0x7fc3040e86d0 legacy=0x7fc3040e8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30947e700 1 -- 172.21.15.38:0/3255849223 >> v1:172.21.15.38:6789/0 conn(0x7fc3040ec480 legacy=0x7fc3040ec900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.341+0000 7fc30947e700 1 -- 172.21.15.38:0/3255849223 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304181e90 con 0x7fc304156f00 2023-11-06T13:41:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.342+0000 7fc30947e700 1 --2- 172.21.15.38:0/3255849223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc304156f00 0x7fc3041572e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fc2f4009760 tx=0x7fc2f4009060).ready entity=mon.0 client_cookie=d6920544beeb4188 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.342+0000 7fc303fff700 1 -- 172.21.15.38:0/3255849223 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40090d0 con 0x7fc304156f00 2023-11-06T13:41:15.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.342+0000 7fc303fff700 1 -- 172.21.15.38:0/3255849223 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400f510 con 0x7fc304156f00 2023-11-06T13:41:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.342+0000 7fc303fff700 1 -- 172.21.15.38:0/3255849223 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400f890 con 0x7fc304156f00 2023-11-06T13:41:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 -- 172.21.15.38:0/3255849223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc304156f00 msgr2=0x7fc3041572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/3255849223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc304156f00 0x7fc3041572e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fc2f4009760 tx=0x7fc2f4009060).stop 2023-11-06T13:41:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 -- 172.21.15.38:0/3255849223 shutdown_connections 2023-11-06T13:41:15.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/3255849223 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc304156f00 0x7fc3041572e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 -- 172.21.15.38:0/3255849223 >> 172.21.15.38:0/3255849223 conn(0x7fc3040f19d0 msgr2=0x7fc3040eda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 -- 172.21.15.38:0/3255849223 shutdown_connections 2023-11-06T13:41:15.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.343+0000 7fc30b6e2700 1 -- 172.21.15.38:0/3255849223 wait complete. 2023-11-06T13:41:15.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.345+0000 7fc30b6e2700 1 Processor -- start 2023-11-06T13:41:15.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.345+0000 7fc30b6e2700 1 -- start start 2023-11-06T13:41:15.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30b6e2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 0x7fc30417bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30b6e2700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3040ec480 0x7fc304158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30b6e2700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc304156f00 0x7fc30417d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30b6e2700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30414d9a0 con 0x7fc3040ec480 2023-11-06T13:41:15.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30b6e2700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304175a20 con 0x7fc304156f00 2023-11-06T13:41:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30b6e2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304159020 con 0x7fc3040e86d0 2023-11-06T13:41:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 0x7fc30417bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 0x7fc30417bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:45420/0 (socket says 172.21.15.38:45420) 2023-11-06T13:41:15.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 -- 172.21.15.38:0/1304189092 learned_addr learned my addr 172.21.15.38:0/1304189092 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 -- 172.21.15.38:0/1304189092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc304156f00 msgr2=0x7fc30417d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc304156f00 0x7fc30417d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 -- 172.21.15.38:0/1304189092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3040ec480 msgr2=0x7fc304158b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-06T13:41:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3040ec480 0x7fc304158b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.347+0000 7fc30947e700 1 -- 172.21.15.38:0/1304189092 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40092a0 con 0x7fc3040e86d0 2023-11-06T13:41:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.348+0000 7fc30947e700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 0x7fc30417bc30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fc2f400fa00 tx=0x7fc2f4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.348+0000 7fc3017fa700 1 -- 172.21.15.38:0/1304189092 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4009110 con 0x7fc3040e86d0 2023-11-06T13:41:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.349+0000 7fc3017fa700 1 -- 172.21.15.38:0/1304189092 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4011c50 con 0x7fc3040e86d0 2023-11-06T13:41:15.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.349+0000 7fc3017fa700 1 -- 172.21.15.38:0/1304189092 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f401c420 con 0x7fc3040e86d0 2023-11-06T13:41:15.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.349+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3041586a0 con 0x7fc3040e86d0 2023-11-06T13:41:15.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.349+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc304157a90 con 0x7fc3040e86d0 2023-11-06T13:41:15.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.352+0000 7fc3017fa700 1 -- 172.21.15.38:0/1304189092 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fc2f401c810 con 0x7fc3040e86d0 2023-11-06T13:41:15.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.352+0000 7fc3017fa700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc2f008cb40 0x7fc2f008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.353+0000 7fc3017fa700 1 -- 172.21.15.38:0/1304189092 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc2f40b3af0 con 0x7fc3040e86d0 2023-11-06T13:41:15.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.353+0000 7fc308c7d700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc2f008cb40 0x7fc2f008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.353+0000 7fc308c7d700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc2f008cb40 0x7fc2f008f000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fc2fc005ad0 tx=0x7fc2fc007c50).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.354+0000 7fc31d07ab80 1 Processor -- start 2023-11-06T13:41:15.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.354+0000 7fc31d07ab80 1 -- start start 2023-11-06T13:41:15.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589aafc5e90 0x5589ab24c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab208c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab249c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab1cefd0 con 0x5589ab24c8f0 2023-11-06T13:41:15.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab146240 con 0x5589ab209110 2023-11-06T13:41:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab15b490 con 0x5589aafc5e90 2023-11-06T13:41:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.355+0000 7fc308c7d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab208c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc30947e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589aafc5e90 0x5589ab24c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab208c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55200/0 (socket says 172.21.15.38:55200) 2023-11-06T13:41:15.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 -- 172.21.15.38:0/998971451 learned_addr learned my addr 172.21.15.38:0/998971451 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc309c7f700 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab249c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 -- 172.21.15.38:0/998971451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589aafc5e90 msgr2=0x5589ab24c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589aafc5e90 0x5589ab24c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 -- 172.21.15.38:0/998971451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 msgr2=0x5589ab249c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab249c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 -- 172.21.15.38:0/998971451 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ab154670 con 0x5589ab24c8f0 2023-11-06T13:41:15.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc308c7d700 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab208c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fc2fc005fd0 tx=0x7fc2fc007000).ready entity=mon.0 client_cookie=5ae5fecf77e13a51 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc2ea7fc700 1 -- 172.21.15.38:0/998971451 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00ce90 con 0x5589ab24c8f0 2023-11-06T13:41:15.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc2ea7fc700 1 -- 172.21.15.38:0/998971451 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc01c030 con 0x5589ab24c8f0 2023-11-06T13:41:15.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.356+0000 7fc2ea7fc700 1 -- 172.21.15.38:0/998971451 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc007570 con 0x5589ab24c8f0 2023-11-06T13:41:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 -- 172.21.15.38:0/998971451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 msgr2=0x5589ab208c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab208c20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fc2fc005fd0 tx=0x7fc2fc007000).stop 2023-11-06T13:41:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 -- 172.21.15.38:0/998971451 shutdown_connections 2023-11-06T13:41:15.369 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab249c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589aafc5e90 0x5589ab24c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/998971451 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab208c20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.370 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 -- 172.21.15.38:0/998971451 >> 172.21.15.38:0/998971451 conn(0x5589ab0734f0 msgr2=0x5589ab209d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 -- 172.21.15.38:0/998971451 shutdown_connections 2023-11-06T13:41:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.357+0000 7fc31d07ab80 1 -- 172.21.15.38:0/998971451 wait complete. 2023-11-06T13:41:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.359+0000 7fc31d07ab80 1 -- start start 2023-11-06T13:41:15.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.359+0000 7fc31d07ab80 1 Processor -- start 2023-11-06T13:41:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab24bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab242c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab24c8f0 0x5589ab28efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab15b5d0 con 0x5589aafc5e90 2023-11-06T13:41:15.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab15b850 con 0x5589ab209110 2023-11-06T13:41:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab126e60 con 0x5589ab24c8f0 2023-11-06T13:41:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc31d07ab80 10 client.0 ll_register_callbacks cb 0x5589ab1c93d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc30947e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab24bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc30947e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab24bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55212/0 (socket says 172.21.15.38:55212) 2023-11-06T13:41:15.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc30947e700 1 -- 172.21.15.38:0/3356222555 learned_addr learned my addr 172.21.15.38:0/3356222555 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.360+0000 7fc308c7d700 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab242c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc30947e700 1 -- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab24c8f0 msgr2=0x5589ab28efd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:41:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc30947e700 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab24c8f0 0x5589ab28efd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc30947e700 1 -- 172.21.15.38:0/3356222555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 msgr2=0x5589ab242c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc30947e700 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab242c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc30947e700 1 -- 172.21.15.38:0/3356222555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc005d10 con 0x5589aafc5e90 2023-11-06T13:41:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc30947e700 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab24bbe0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc2f4011fd0 tx=0x7fc2f401e040).ready entity=mon.0 client_cookie=8212054751eb2c7c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc2e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:15.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3356222555 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40872b0 con 0x5589aafc5e90 2023-11-06T13:41:15.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.361+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3356222555 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc2f4087410 con 0x5589aafc5e90 2023-11-06T13:41:15.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589ab1fd690 con 0x5589aafc5e90 2023-11-06T13:41:15.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3356222555 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2f408d420 con 0x5589aafc5e90 2023-11-06T13:41:15.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 10 client.5706 fetch_fsmap learned FSMap version 45 2023-11-06T13:41:15.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5589ab14fa10 con 0x5589aafc5e90 2023-11-06T13:41:15.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3356222555 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589ab1fd690 con 0x5589aafc5e90 2023-11-06T13:41:15.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3356222555 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 45) v1 ==== 7524+0+0 (secure 0 0 0) 0x7fc2f4083bb0 con 0x5589aafc5e90 2023-11-06T13:41:15.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 10 client.5706 fetch_fsmap finished waiting for FSMap version 45 2023-11-06T13:41:15.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 10 client.5706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:15.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 20 client.5706 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28f720 0x5589ab290450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 4 client.5706 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:41:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.363+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589aafc1cf0 con 0x5589ab28f720 2023-11-06T13:41:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.364+0000 7fc308c7d700 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28f720 0x5589ab290450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.378 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.364+0000 7fc308c7d700 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28f720 0x5589ab290450 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d57da88903943e14 server_cookie=3dbaa916dc7c6844 in_seq=0 out_seq=0 2023-11-06T13:41:15.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.367+0000 7fc2e37fe700 10 client.5706 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:15.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.367+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3356222555 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5589aafc1cf0 con 0x5589ab28f720 2023-11-06T13:41:15.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.367+0000 7fc2e37fe700 10 client.5706 handle_command_reply: tid=0 2023-11-06T13:41:15.380 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.367+0000 7fc31d07ab80 1 client.5706 shutdown 2023-11-06T13:41:15.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.368+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 msgr2=0x5589ab24bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.368+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab24bbe0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fc2f4011fd0 tx=0x7fc2f401e040).stop 2023-11-06T13:41:15.381 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 shutdown_connections 2023-11-06T13:41:15.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28f720 0x5589ab290450 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab24c8f0 0x5589ab28efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.382 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab24bbe0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc2e37fe700 0 client.5706 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:15.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3356222555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab209110 0x5589ab242c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 >> 172.21.15.38:0/3356222555 conn(0x5589ab0734f0 msgr2=0x5589ab203ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:15.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 shutdown_connections 2023-11-06T13:41:15.383 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.369+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3356222555 wait complete. 2023-11-06T13:41:15.384 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.370+0000 7fc31d07ab80 20 client.5706 trim_cache size 0 max 16384 2023-11-06T13:41:15.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.392+0000 7fc31d07ab80 1 Processor -- start 2023-11-06T13:41:15.396 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.393+0000 7fc31d07ab80 1 -- start start 2023-11-06T13:41:15.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab20ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab210f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab24c8f0 0x5589ab242c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab290870 con 0x5589aafc5e90 2023-11-06T13:41:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab279b70 con 0x5589ab24c8f0 2023-11-06T13:41:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab28dec0 con 0x5589ab209110 2023-11-06T13:41:15.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab20ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab20ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55224/0 (socket says 172.21.15.38:55224) 2023-11-06T13:41:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 -- 172.21.15.38:0/2511397210 learned_addr learned my addr 172.21.15.38:0/2511397210 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 -- 172.21.15.38:0/2511397210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 msgr2=0x5589ab210f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:41:15.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab210f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 -- 172.21.15.38:0/2511397210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab24c8f0 msgr2=0x5589ab242c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab24c8f0 0x5589ab242c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 -- 172.21.15.38:0/2511397210 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ab14f760 con 0x5589aafc5e90 2023-11-06T13:41:15.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.394+0000 7fc30947e700 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab20ddc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc2f4009eb0 tx=0x7fc2f4056000).ready entity=mon.0 client_cookie=18cf7b85d82fa1d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.395+0000 7fc2eaffd700 1 -- 172.21.15.38:0/2511397210 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f408d420 con 0x5589aafc5e90 2023-11-06T13:41:15.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.395+0000 7fc2eaffd700 1 -- 172.21.15.38:0/2511397210 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f401c5e0 con 0x5589aafc5e90 2023-11-06T13:41:15.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.395+0000 7fc2eaffd700 1 -- 172.21.15.38:0/2511397210 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40872b0 con 0x5589aafc5e90 2023-11-06T13:41:15.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.395+0000 7fc31d07ab80 1 -- 172.21.15.38:0/2511397210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 msgr2=0x5589ab20ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.395+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab20ddc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fc2f4009eb0 tx=0x7fc2f4056000).stop 2023-11-06T13:41:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.397+0000 7fc31d07ab80 1 -- 172.21.15.38:0/2511397210 shutdown_connections 2023-11-06T13:41:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.397+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589ab24c8f0 0x5589ab242c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.397+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589aafc5e90 0x5589ab20ddc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.397+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/2511397210 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab210f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.397+0000 7fc31d07ab80 1 -- 172.21.15.38:0/2511397210 >> 172.21.15.38:0/2511397210 conn(0x5589ab0734f0 msgr2=0x5589ab205910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:15.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.399+0000 7fc31d07ab80 1 -- 172.21.15.38:0/2511397210 shutdown_connections 2023-11-06T13:41:15.406 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.399+0000 7fc31d07ab80 1 -- 172.21.15.38:0/2511397210 wait complete. 2023-11-06T13:41:15.410 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.400+0000 7fc31d07ab80 1 -- start start 2023-11-06T13:41:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.400+0000 7fc31d07ab80 1 Processor -- start 2023-11-06T13:41:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589aafc5e90 0x5589ab2dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab2d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.411 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab2e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab2ea420 con 0x5589ab24c8f0 2023-11-06T13:41:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab2e8000 con 0x5589aafc5e90 2023-11-06T13:41:15.412 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ab2e82e0 con 0x5589ab209110 2023-11-06T13:41:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc31d07ab80 10 client.0 ll_register_callbacks cb 0x5589ab1c93d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab2e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.413 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab2e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:55238/0 (socket says 172.21.15.38:55238) 2023-11-06T13:41:15.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 -- 172.21.15.38:0/3243874721 learned_addr learned my addr 172.21.15.38:0/3243874721 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:15.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc308c7d700 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab2d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 -- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 msgr2=0x5589ab2d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.414 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab2d5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 -- 172.21.15.38:0/3243874721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589aafc5e90 msgr2=0x5589ab2dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:15.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589aafc5e90 0x5589ab2dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 -- 172.21.15.38:0/3243874721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f408b070 con 0x5589ab24c8f0 2023-11-06T13:41:15.415 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc309c7f700 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab2e85c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fc2f800dbe0 tx=0x7fc2f8008040).ready entity=mon.0 client_cookie=b73cd01116112b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:15.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.402+0000 7fc2e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:15.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3243874721 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8009890 con 0x5589ab24c8f0 2023-11-06T13:41:15.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3243874721 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fc2f80099f0 con 0x5589ab24c8f0 2023-11-06T13:41:15.416 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc2fc01c030 con 0x5589ab24c8f0 2023-11-06T13:41:15.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3243874721 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2f8009dc0 con 0x5589ab24c8f0 2023-11-06T13:41:15.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 10 client.5712 fetch_fsmap learned FSMap version 45 2023-11-06T13:41:15.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5589aafc6fd0 con 0x5589ab24c8f0 2023-11-06T13:41:15.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3243874721 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f801e020 con 0x5589ab24c8f0 2023-11-06T13:41:15.417 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3243874721 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 45) v1 ==== 7524+0+0 (secure 0 0 0) 0x7fc2f8014440 con 0x5589ab24c8f0 2023-11-06T13:41:15.418 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:41:15.418 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:41:15.419 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:41:15.419 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:41:15.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 10 client.5712 fetch_fsmap finished waiting for FSMap version 45 2023-11-06T13:41:15.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 10 client.5712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:15.420 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 20 client.5712 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:15.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28d670 0x5589ab2e79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:15.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 4 client.5712 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:41:15.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.403+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5589aaff8cf0 con 0x5589ab28d670 2023-11-06T13:41:15.421 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc30947e700 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28d670 0x5589ab2e79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:15.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc2e37fe700 10 client.5712 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:15.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc30947e700 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28d670 0x5589ab2e79a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3ec2c9c95191346c server_cookie=ba2086347216333 in_seq=0 out_seq=0 2023-11-06T13:41:15.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc2e37fe700 1 -- 172.21.15.38:0/3243874721 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5589aaff8cf0 con 0x5589ab28d670 2023-11-06T13:41:15.422 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc2e37fe700 10 client.5712 handle_command_reply: tid=0 2023-11-06T13:41:15.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc31d07ab80 1 client.5712 shutdown 2023-11-06T13:41:15.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 msgr2=0x5589ab2e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.404+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab2e85c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fc2f800dbe0 tx=0x7fc2f8008040).stop 2023-11-06T13:41:15.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 shutdown_connections 2023-11-06T13:41:15.423 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5589ab24c8f0 0x5589ab2e85c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589aafc5e90 0x5589ab2dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5589ab28d670 0x5589ab2e79a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 --2- 172.21.15.38:0/3243874721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5589ab209110 0x5589ab2d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc2e37fe700 0 client.5712 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:15.424 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 >> 172.21.15.38:0/3243874721 conn(0x5589ab0734f0 msgr2=0x5589ab242ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:15.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 shutdown_connections 2023-11-06T13:41:15.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 1 -- 172.21.15.38:0/3243874721 wait complete. 2023-11-06T13:41:15.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc31d07ab80 20 client.5712 trim_cache size 0 max 16384 2023-11-06T13:41:15.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc2f008cb40 msgr2=0x7fc2f008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.425 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc2f008cb40 0x7fc2f008f000 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fc2fc005ad0 tx=0x7fc2fc007c50).stop 2023-11-06T13:41:15.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 msgr2=0x7fc30417bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:15.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 0x7fc30417bc30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fc2f400fa00 tx=0x7fc2f4017000).stop 2023-11-06T13:41:15.426 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 shutdown_connections 2023-11-06T13:41:15.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fc2f008cb40 0x7fc2f008f000 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc304156f00 0x7fc30417d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3040e86d0 0x7fc30417bc30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:15.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 --2- 172.21.15.38:0/1304189092 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc3040ec480 0x7fc304158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:15.427 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.405+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 >> 172.21.15.38:0/1304189092 conn(0x7fc3040f19d0 msgr2=0x7fc3040eee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:15.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.406+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 shutdown_connections 2023-11-06T13:41:15.428 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:15.406+0000 7fc30b6e2700 1 -- 172.21.15.38:0/1304189092 wait complete. 2023-11-06T13:41:15.429 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:41:16.431 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:41:16.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:41:16.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.600+0000 7ff846481700 1 Processor -- start 2023-11-06T13:41:16.604 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.600+0000 7ff846481700 1 -- start start 2023-11-06T13:41:16.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.601+0000 7ff846481700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7ff8400eca50 0x7ff8400ee250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.605 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.601+0000 7ff846481700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400eddc0 con 0x7ff840178680 2023-11-06T13:41:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.601+0000 7ff846481700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400842d0 con 0x7ff840178a60 2023-11-06T13:41:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.601+0000 7ff846481700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400eced0 con 0x7ff8400eca50 2023-11-06T13:41:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.602+0000 7ff83ffff700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7ff840178680 0x7ff840083bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:57518/0 (socket says 172.21.15.38:57518) 2023-11-06T13:41:16.606 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.602+0000 7ff83ffff700 1 -- 172.21.15.38:0/3840232949 learned_addr learned my addr 172.21.15.38:0/3840232949 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:41:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.602+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/3840232949 >> v2:172.21.15.163:3300/0 conn(0x7ff8400eca50 0x7ff8400ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.607 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.602+0000 7ff83f7fe700 1 -- 172.21.15.38:0/3840232949 >> v1:172.21.15.163:6789/0 conn(0x7ff840178a60 legacy=0x7ff840066a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.602+0000 7ff83f7fe700 1 -- 172.21.15.38:0/3840232949 >> v1:172.21.15.38:6789/0 conn(0x7ff840178680 legacy=0x7ff840083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.602+0000 7ff83f7fe700 1 -- 172.21.15.38:0/3840232949 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400ed1b0 con 0x7ff8400eca50 2023-11-06T13:41:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.603+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/3840232949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400ee250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff834009760 tx=0x7ff834009060).ready entity=mon.2 client_cookie=eaa350ca6590bcda server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.608 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.603+0000 7ff83effd700 1 -- 172.21.15.38:0/3840232949 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340090d0 con 0x7ff8400eca50 2023-11-06T13:41:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.603+0000 7ff83effd700 1 -- 172.21.15.38:0/3840232949 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400b580 con 0x7ff8400eca50 2023-11-06T13:41:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.603+0000 7ff83effd700 1 -- 172.21.15.38:0/3840232949 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400b900 con 0x7ff8400eca50 2023-11-06T13:41:16.609 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.605+0000 7ff846481700 1 -- 172.21.15.38:0/3840232949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 msgr2=0x7ff8400ee250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.605+0000 7ff846481700 1 --2- 172.21.15.38:0/3840232949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400ee250 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff834009760 tx=0x7ff834009060).stop 2023-11-06T13:41:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.605+0000 7ff846481700 1 -- 172.21.15.38:0/3840232949 shutdown_connections 2023-11-06T13:41:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.605+0000 7ff846481700 1 --2- 172.21.15.38:0/3840232949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400ee250 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.610 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.605+0000 7ff846481700 1 -- 172.21.15.38:0/3840232949 >> 172.21.15.38:0/3840232949 conn(0x7ff8400f2b30 msgr2=0x7ff8400eeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.611 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.606+0000 7ff846481700 1 -- 172.21.15.38:0/3840232949 shutdown_connections 2023-11-06T13:41:16.612 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.608+0000 7ff846481700 1 -- 172.21.15.38:0/3840232949 wait complete. 2023-11-06T13:41:16.613 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.610+0000 7ff846481700 1 Processor -- start 2023-11-06T13:41:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.610+0000 7ff846481700 1 -- start start 2023-11-06T13:41:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.611+0000 7ff846481700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.616 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.611+0000 7ff846481700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 0x7ff8401618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.611+0000 7ff846481700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff840178a60 0x7ff84006a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.611+0000 7ff846481700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840194110 con 0x7ff840178680 2023-11-06T13:41:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.611+0000 7ff846481700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84006a1d0 con 0x7ff840178a60 2023-11-06T13:41:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.611+0000 7ff846481700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400695c0 con 0x7ff8400eca50 2023-11-06T13:41:16.617 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 0x7ff8401618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 0x7ff8401618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38610/0 (socket says 172.21.15.38:38610) 2023-11-06T13:41:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 -- 172.21.15.38:0/1429931496 learned_addr learned my addr 172.21.15.38:0/1429931496 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83ffff700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 -- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 msgr2=0x7ff8400c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.618 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 -- 172.21.15.38:0/1429931496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff840178a60 msgr2=0x7ff84006a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff840178a60 0x7ff84006a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 -- 172.21.15.38:0/1429931496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340092a0 con 0x7ff840178680 2023-11-06T13:41:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 0x7ff8401618e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7ff834009eb0 tx=0x7ff834017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.619 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.612+0000 7ff827fff700 1 -- 172.21.15.38:0/1429931496 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400bec0 con 0x7ff840178680 2023-11-06T13:41:16.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.613+0000 7ff827fff700 1 -- 172.21.15.38:0/1429931496 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834006950 con 0x7ff840178680 2023-11-06T13:41:16.620 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.613+0000 7ff827fff700 1 -- 172.21.15.38:0/1429931496 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400b900 con 0x7ff840178680 2023-11-06T13:41:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.613+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8400698a0 con 0x7ff840178680 2023-11-06T13:41:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.613+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff840069e60 con 0x7ff840178680 2023-11-06T13:41:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.616+0000 7ff827fff700 1 -- 172.21.15.38:0/1429931496 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7ff83401b650 con 0x7ff840178680 2023-11-06T13:41:16.621 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.617+0000 7ff827fff700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff82c08cb40 0x7ff82c08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.617+0000 7ff827fff700 1 -- 172.21.15.38:0/1429931496 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff8340b34e0 con 0x7ff840178680 2023-11-06T13:41:16.622 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.619+0000 7ff857e19b80 1 Processor -- start 2023-11-06T13:41:16.623 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.619+0000 7ff83ffff700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff82c08cb40 0x7ff82c08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.624 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.621+0000 7ff857e19b80 1 -- start start 2023-11-06T13:41:16.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.622+0000 7ff83ffff700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff82c08cb40 0x7ff82c08f000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff830007fd0 tx=0x7ff830000bc0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc26480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.626 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfbe2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc23c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.628 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff857e19b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfba9050 con 0x5610cfbe3190 2023-11-06T13:41:16.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff857e19b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfb202c0 con 0x5610cf99ff10 2023-11-06T13:41:16.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff857e19b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfb35510 con 0x5610cfc26970 2023-11-06T13:41:16.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc26480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.629 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc26480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:53892/0 (socket says 172.21.15.38:53892) 2023-11-06T13:41:16.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 -- 172.21.15.38:0/3151201744 learned_addr learned my addr 172.21.15.38:0/3151201744 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 -- 172.21.15.38:0/3151201744 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 msgr2=0x5610cfbe2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfbe2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 -- 172.21.15.38:0/3151201744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 msgr2=0x5610cfc23c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:41:16.630 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc23c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 -- 172.21.15.38:0/3151201744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610cfb2e6f0 con 0x5610cf99ff10 2023-11-06T13:41:16.631 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.623+0000 7ff83ffff700 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc26480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff8300176f0 tx=0x7ff83000a000).ready entity=mon.1 client_cookie=ed651c12dc9b9c23 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.632 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.629+0000 7ff8257fa700 1 -- 172.21.15.38:0/3151201744 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83001c070 con 0x5610cf99ff10 2023-11-06T13:41:16.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.629+0000 7ff8257fa700 1 -- 172.21.15.38:0/3151201744 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff830017030 con 0x5610cf99ff10 2023-11-06T13:41:16.633 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.629+0000 7ff8257fa700 1 -- 172.21.15.38:0/3151201744 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300155f0 con 0x5610cf99ff10 2023-11-06T13:41:16.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.631+0000 7ff857e19b80 1 -- 172.21.15.38:0/3151201744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 msgr2=0x5610cfc26480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.635 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.631+0000 7ff857e19b80 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc26480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff8300176f0 tx=0x7ff83000a000).stop 2023-11-06T13:41:16.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 -- 172.21.15.38:0/3151201744 shutdown_connections 2023-11-06T13:41:16.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc23c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc26480 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.636 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 --2- 172.21.15.38:0/3151201744 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfbe2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 -- 172.21.15.38:0/3151201744 >> 172.21.15.38:0/3151201744 conn(0x5610cfa4d570 msgr2=0x5610cfbe3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 -- 172.21.15.38:0/3151201744 shutdown_connections 2023-11-06T13:41:16.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.632+0000 7ff857e19b80 1 -- 172.21.15.38:0/3151201744 wait complete. 2023-11-06T13:41:16.637 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.633+0000 7ff857e19b80 1 -- start start 2023-11-06T13:41:16.638 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.633+0000 7ff857e19b80 1 Processor -- start 2023-11-06T13:41:16.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.634+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc61ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.634+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc0d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.640 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.634+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc55b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.634+0000 7ff857e19b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfb35650 con 0x5610cfbe3190 2023-11-06T13:41:16.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.634+0000 7ff857e19b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfb358d0 con 0x5610cf99ff10 2023-11-06T13:41:16.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.634+0000 7ff857e19b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfb00ee0 con 0x5610cfc26970 2023-11-06T13:41:16.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff857e19b80 10 client.0 ll_register_callbacks cb 0x5610cfba3450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:16.641 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc61ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff844a1e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc55b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc61ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:53908/0 (socket says 172.21.15.38:53908) 2023-11-06T13:41:16.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff844a1e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc55b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:46464/0 (socket says 172.21.15.38:46464) 2023-11-06T13:41:16.642 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 -- 172.21.15.38:0/1691000263 learned_addr learned my addr 172.21.15.38:0/1691000263 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 -- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 msgr2=0x5610cfc55b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc55b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 -- 172.21.15.38:0/1691000263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 msgr2=0x5610cfc0d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc0d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.643 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 -- 172.21.15.38:0/1691000263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8400eddc0 con 0x5610cf99ff10 2023-11-06T13:41:16.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff83ffff700 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc61ec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x5610cfc289c0 tx=0x7ff830019000).ready entity=mon.1 client_cookie=5661f51a98bec85d server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff81e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:41:16.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff81e7fc700 1 -- 172.21.15.38:0/1691000263 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830016440 con 0x5610cf99ff10 2023-11-06T13:41:16.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff81e7fc700 1 -- 172.21.15.38:0/1691000263 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff8300165a0 con 0x5610cf99ff10 2023-11-06T13:41:16.644 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.635+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610cfbd7710 con 0x5610cf99ff10 2023-11-06T13:41:16.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff81e7fc700 1 -- 172.21.15.38:0/1691000263 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff830016970 con 0x5610cf99ff10 2023-11-06T13:41:16.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 10 client.5533 fetch_fsmap learned FSMap version 45 2023-11-06T13:41:16.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5610cfb29a90 con 0x5610cf99ff10 2023-11-06T13:41:16.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff81e7fc700 1 -- 172.21.15.38:0/1691000263 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610cfbd7710 con 0x5610cf99ff10 2023-11-06T13:41:16.645 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff81e7fc700 1 -- 172.21.15.38:0/1691000263 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 45) v1 ==== 7524+0+0 (secure 0 0 0) 0x7ff83002c060 con 0x5610cf99ff10 2023-11-06T13:41:16.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 10 client.5533 fetch_fsmap finished waiting for FSMap version 45 2023-11-06T13:41:16.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 10 client.5533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:16.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 20 client.5533 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:16.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfbe2360 0x5610cfbe2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.646 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 4 client.5533 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:41:16.647 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.636+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610cf99bd70 con 0x5610cfbe2360 2023-11-06T13:41:16.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.640+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfbe2360 0x5610cfbe2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.648 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.640+0000 7ff81e7fc700 10 client.5533 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.640+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfbe2360 0x5610cfbe2770 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=baa88cdcb4d09b8a server_cookie=91e6adfb37b81cc1 in_seq=0 out_seq=0 2023-11-06T13:41:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff81e7fc700 1 -- 172.21.15.38:0/1691000263 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5610cf99bd70 con 0x5610cfbe2360 2023-11-06T13:41:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff81e7fc700 10 client.5533 handle_command_reply: tid=0 2023-11-06T13:41:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 client.5533 shutdown 2023-11-06T13:41:16.649 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 msgr2=0x5610cfc61ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc61ec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x5610cfc289c0 tx=0x7ff830019000).stop 2023-11-06T13:41:16.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 shutdown_connections 2023-11-06T13:41:16.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfbe2360 0x5610cfbe2770 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc55b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.650 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff81e7fc700 0 client.5533 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc61ec0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 --2- 172.21.15.38:0/1691000263 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc0d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 >> 172.21.15.38:0/1691000263 conn(0x5610cfa4d570 msgr2=0x5610cfbea660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 shutdown_connections 2023-11-06T13:41:16.651 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.641+0000 7ff857e19b80 1 -- 172.21.15.38:0/1691000263 wait complete. 2023-11-06T13:41:16.652 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.642+0000 7ff857e19b80 20 client.5533 trim_cache size 0 max 16384 2023-11-06T13:41:16.669 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.665+0000 7ff857e19b80 1 Processor -- start 2023-11-06T13:41:16.670 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.665+0000 7ff857e19b80 1 -- start start 2023-11-06T13:41:16.672 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc55b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc1a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc22a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.673 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff857e19b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfcaa110 con 0x5610cfbe3190 2023-11-06T13:41:16.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff857e19b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfc56840 con 0x5610cf99ff10 2023-11-06T13:41:16.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff857e19b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfbe17e0 con 0x5610cfc26970 2023-11-06T13:41:16.674 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc22a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc22a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:46476/0 (socket says 172.21.15.38:46476) 2023-11-06T13:41:16.675 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 -- 172.21.15.38:0/621019974 learned_addr learned my addr 172.21.15.38:0/621019974 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 -- 172.21.15.38:0/621019974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 msgr2=0x5610cfc55b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc55b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.676 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 -- 172.21.15.38:0/621019974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 msgr2=0x5610cfc1a250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:41:16.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc1a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.677 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 -- 172.21.15.38:0/621019974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610cfbd7330 con 0x5610cfc26970 2023-11-06T13:41:16.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.667+0000 7ff844a1e700 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc22a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ff838009890 tx=0x7ff8380091d0).ready entity=mon.2 client_cookie=f4a95fa964ed3098 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.670+0000 7ff825ffb700 1 -- 172.21.15.38:0/621019974 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838009560 con 0x5610cfc26970 2023-11-06T13:41:16.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.670+0000 7ff825ffb700 1 -- 172.21.15.38:0/621019974 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838001630 con 0x5610cfc26970 2023-11-06T13:41:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.670+0000 7ff825ffb700 1 -- 172.21.15.38:0/621019974 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8380019b0 con 0x5610cfc26970 2023-11-06T13:41:16.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 -- 172.21.15.38:0/621019974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 msgr2=0x5610cfc22a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc22a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ff838009890 tx=0x7ff8380091d0).stop 2023-11-06T13:41:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 -- 172.21.15.38:0/621019974 shutdown_connections 2023-11-06T13:41:16.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cfc26970 0x5610cfc22a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cf99ff10 0x5610cfc55b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 --2- 172.21.15.38:0/621019974 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfbe3190 0x5610cfc1a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 -- 172.21.15.38:0/621019974 >> 172.21.15.38:0/621019974 conn(0x5610cfa4d570 msgr2=0x5610cfbdfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.671+0000 7ff857e19b80 1 -- 172.21.15.38:0/621019974 shutdown_connections 2023-11-06T13:41:16.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.672+0000 7ff857e19b80 1 -- 172.21.15.38:0/621019974 wait complete. 2023-11-06T13:41:16.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.673+0000 7ff857e19b80 1 -- start start 2023-11-06T13:41:16.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.673+0000 7ff857e19b80 1 Processor -- start 2023-11-06T13:41:16.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.674+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cf99ff10 0x5610cfc55a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.674+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 0x5610cfc230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.674+0000 7ff857e19b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfc26970 0x5610cfca8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.674+0000 7ff857e19b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfcbca60 con 0x5610cfc26970 2023-11-06T13:41:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff857e19b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfca90d0 con 0x5610cfbe3190 2023-11-06T13:41:16.688 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff857e19b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610cfcbbc00 con 0x5610cf99ff10 2023-11-06T13:41:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff857e19b80 10 client.0 ll_register_callbacks cb 0x5610cfba3450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 0x5610cfc230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.689 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 0x5610cfc230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:53924/0 (socket says 172.21.15.38:53924) 2023-11-06T13:41:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 -- 172.21.15.38:0/2169364847 learned_addr learned my addr 172.21.15.38:0/2169364847 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 -- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cf99ff10 msgr2=0x5610cfc55a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cf99ff10 0x5610cfc55a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 -- 172.21.15.38:0/2169364847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfc26970 msgr2=0x5610cfca8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfc26970 0x5610cfca8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 -- 172.21.15.38:0/2169364847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83800e040 con 0x5610cfbe3190 2023-11-06T13:41:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff83f7fe700 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 0x5610cfc230d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff834000e50 tx=0x7ff834089040).ready entity=mon.1 client_cookie=adca87855fe73c8c server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.675+0000 7ff81e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2023-11-06T13:41:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff81e7fc700 1 -- 172.21.15.38:0/2169364847 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83408d090 con 0x5610cfbe3190 2023-11-06T13:41:16.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff81e7fc700 1 -- 172.21.15.38:0/2169364847 <== mon.1 v2:172.21.15.44:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ff8340b07f0 con 0x5610cfbe3190 2023-11-06T13:41:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff830017030 con 0x5610cfbe3190 2023-11-06T13:41:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff81e7fc700 1 -- 172.21.15.38:0/2169364847 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8340b09b0 con 0x5610cfbe3190 2023-11-06T13:41:16.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 10 client.5536 fetch_fsmap learned FSMap version 45 2023-11-06T13:41:16.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5610cfb297e0 con 0x5610cfbe3190 2023-11-06T13:41:16.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff81e7fc700 1 -- 172.21.15.38:0/2169364847 <== mon.1 v2:172.21.15.44:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff830017030 con 0x5610cfbe3190 2023-11-06T13:41:16.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff81e7fc700 1 -- 172.21.15.38:0/2169364847 <== mon.1 v2:172.21.15.44:3300/0 5 ==== fsmap(e 45) v1 ==== 7524+0+0 (secure 0 0 0) 0x7ff834018030 con 0x5610cfbe3190 2023-11-06T13:41:16.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 10 client.5536 fetch_fsmap finished waiting for FSMap version 45 2023-11-06T13:41:16.697 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 10 client.5536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:16.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 20 client.5536 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:16.698 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfc56040 0x5610cfcb8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 4 client.5536 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:41:16.699 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.676+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5610cf9d2d70 con 0x5610cfc56040 2023-11-06T13:41:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.677+0000 7ff83ffff700 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfc56040 0x5610cfcb8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.677+0000 7ff83ffff700 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfc56040 0x5610cfcb8a20 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ce6fef8173ede42d server_cookie=289c5a0b3f465522 in_seq=0 out_seq=0 2023-11-06T13:41:16.700 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.677+0000 7ff81e7fc700 10 client.5536 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.703 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff81e7fc700 1 -- 172.21.15.38:0/2169364847 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5610cf9d2d70 con 0x5610cfc56040 2023-11-06T13:41:16.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff81e7fc700 10 client.5536 handle_command_reply: tid=0 2023-11-06T13:41:16.704 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 client.5536 shutdown 2023-11-06T13:41:16.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 msgr2=0x5610cfc230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.705 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 0x5610cfc230d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff834000e50 tx=0x7ff834089040).stop 2023-11-06T13:41:16.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 shutdown_connections 2023-11-06T13:41:16.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5610cfc26970 0x5610cfca8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.706 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5610cfc56040 0x5610cfcb8a20 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5610cf99ff10 0x5610cfc55a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.707 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 --2- 172.21.15.38:0/2169364847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5610cfbe3190 0x5610cfc230d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff81e7fc700 0 client.5536 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 >> 172.21.15.38:0/2169364847 conn(0x5610cfa4d570 msgr2=0x5610cfbdfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.708 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 shutdown_connections 2023-11-06T13:41:16.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 1 -- 172.21.15.38:0/2169364847 wait complete. 2023-11-06T13:41:16.709 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.681+0000 7ff857e19b80 20 client.5536 trim_cache size 0 max 16384 2023-11-06T13:41:16.710 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:41:16.710 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:41:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "a0b7a723-e7b5-4489-a6ec-587cadbf70f9", 2023-11-06T13:41:16.711 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:41:16.712 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:41:16.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff82c08cb40 msgr2=0x7ff82c08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff82c08cb40 0x7ff82c08f000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7ff830007fd0 tx=0x7ff830000bc0).stop 2023-11-06T13:41:16.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 msgr2=0x7ff8401618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 0x7ff8401618e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7ff834009eb0 tx=0x7ff834017000).stop 2023-11-06T13:41:16.714 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 shutdown_connections 2023-11-06T13:41:16.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ff82c08cb40 0x7ff82c08f000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff840178a60 0x7ff84006a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:16.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8400eca50 0x7ff8400c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 --2- 172.21.15.38:0/1429931496 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ff840178680 0x7ff8401618e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 >> 172.21.15.38:0/1429931496 conn(0x7ff8400f2b30 msgr2=0x7ff8400683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 shutdown_connections 2023-11-06T13:41:16.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.682+0000 7ff846481700 1 -- 172.21.15.38:0/1429931496 wait complete. 2023-11-06T13:41:16.716 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:41:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.878+0000 7f00f4e29700 1 Processor -- start 2023-11-06T13:41:16.882 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.878+0000 7f00f4e29700 1 -- start start 2023-11-06T13:41:16.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00f4e29700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f00f0175890 0x7f00f00f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00f4e29700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00f017cac0 0x7f00f01857a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00f4e29700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f017e250 con 0x7f00f00cb960 2023-11-06T13:41:16.885 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00f4e29700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f017d360 con 0x7f00f017cac0 2023-11-06T13:41:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00f4e29700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f017d640 con 0x7f00f0175890 2023-11-06T13:41:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00effff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00f017cac0 0x7f00f01857a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00effff700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f00f017cac0 0x7f00f01857a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38640/0 (socket says 172.21.15.38:38640) 2023-11-06T13:41:16.886 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00effff700 1 -- 172.21.15.38:0/4048164183 learned_addr learned my addr 172.21.15.38:0/4048164183 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.879+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/4048164183 >> v2:172.21.15.163:3300/0 conn(0x7f00f0175890 0x7f00f00f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00effff700 1 -- 172.21.15.38:0/4048164183 >> v2:172.21.15.163:3300/0 conn(0x7f00f0175890 msgr2=0x7f00f00f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00effff700 1 --2- 172.21.15.38:0/4048164183 >> v2:172.21.15.163:3300/0 conn(0x7f00f0175890 0x7f00f00f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00effff700 1 -- 172.21.15.38:0/4048164183 >> v1:172.21.15.163:6789/0 conn(0x7f00f00cb960 legacy=0x7f00f017e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.887 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00ee7fc700 1 -- 172.21.15.38:0/4048164183 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838791276 0 0) 0x7f00f017e250 con 0x7f00f00cb960 2023-11-06T13:41:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00effff700 1 -- 172.21.15.38:0/4048164183 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f017d920 con 0x7f00f017cac0 2023-11-06T13:41:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00effff700 1 --2- 172.21.15.38:0/4048164183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f01857a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f00f00894b0 tx=0x7f00e8009840).ready entity=mon.0 client_cookie=63c3c51304715f12 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00ee7fc700 1 -- 172.21.15.38:0/4048164183 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800e070 con 0x7f00f017cac0 2023-11-06T13:41:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00ee7fc700 1 -- 172.21.15.38:0/4048164183 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e800ba20 con 0x7f00f017cac0 2023-11-06T13:41:16.888 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00ee7fc700 1 -- 172.21.15.38:0/4048164183 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800bda0 con 0x7f00f017cac0 2023-11-06T13:41:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00f4e29700 1 -- 172.21.15.38:0/4048164183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 msgr2=0x7f00f01857a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00f4e29700 1 --2- 172.21.15.38:0/4048164183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f01857a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f00f00894b0 tx=0x7f00e8009840).stop 2023-11-06T13:41:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00f4e29700 1 -- 172.21.15.38:0/4048164183 shutdown_connections 2023-11-06T13:41:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00f4e29700 1 --2- 172.21.15.38:0/4048164183 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f01857a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.889 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00f4e29700 1 --2- 172.21.15.38:0/4048164183 >> v2:172.21.15.163:3300/0 conn(0x7f00f0175890 0x7f00f00f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.880+0000 7f00f4e29700 1 -- 172.21.15.38:0/4048164183 >> 172.21.15.38:0/4048164183 conn(0x7f00f00f5d20 msgr2=0x7f00f00f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.881+0000 7f00f4e29700 1 -- 172.21.15.38:0/4048164183 shutdown_connections 2023-11-06T13:41:16.890 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.881+0000 7f00f4e29700 1 -- 172.21.15.38:0/4048164183 wait complete. 2023-11-06T13:41:16.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.882+0000 7f00f4e29700 1 Processor -- start 2023-11-06T13:41:16.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.882+0000 7f00f4e29700 1 -- start start 2023-11-06T13:41:16.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00f4e29700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f00cb960 0x7f00f00ece90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.895 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00f4e29700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0175890 0x7f00f0156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00f4e29700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f0156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00f4e29700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0167e70 con 0x7f00f017cac0 2023-11-06T13:41:16.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00f4e29700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f016f6a0 con 0x7f00f0175890 2023-11-06T13:41:16.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00f4e29700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00ed860 con 0x7f00f00cb960 2023-11-06T13:41:16.896 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00effff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f0156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00effff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f0156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38654/0 (socket says 172.21.15.38:38654) 2023-11-06T13:41:16.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00ef7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f00cb960 0x7f00f00ece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00effff700 1 -- 172.21.15.38:0/987903939 learned_addr learned my addr 172.21.15.38:0/987903939 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.897 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.883+0000 7f00eeffd700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0175890 0x7f00f0156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00effff700 1 -- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f00cb960 msgr2=0x7f00f00ece90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00effff700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f00cb960 0x7f00f00ece90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00effff700 1 -- 172.21.15.38:0/987903939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0175890 msgr2=0x7f00f0156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00effff700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0175890 0x7f00f0156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00effff700 1 -- 172.21.15.38:0/987903939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8009ae0 con 0x7f00f017cac0 2023-11-06T13:41:16.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00effff700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f0156600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f00e800b6c0 tx=0x7f00e8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00d77fe700 1 -- 172.21.15.38:0/987903939 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800bda0 con 0x7f00f017cac0 2023-11-06T13:41:16.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00d77fe700 1 -- 172.21.15.38:0/987903939 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8009500 con 0x7f00f017cac0 2023-11-06T13:41:16.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00d77fe700 1 -- 172.21.15.38:0/987903939 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e801d6b0 con 0x7f00f017cac0 2023-11-06T13:41:16.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f00edb40 con 0x7f00f017cac0 2023-11-06T13:41:16.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.884+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f00ee100 con 0x7f00f017cac0 2023-11-06T13:41:16.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.886+0000 7f00d77fe700 1 -- 172.21.15.38:0/987903939 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f00e8003040 con 0x7f00f017cac0 2023-11-06T13:41:16.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.886+0000 7f00d77fe700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f00dc08cb40 0x7f00dc08f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.900 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.886+0000 7f00d77fe700 1 -- 172.21.15.38:0/987903939 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f00e80b3110 con 0x7f00f017cac0 2023-11-06T13:41:16.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.886+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f00dc08cb40 0x7f00dc08f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.887+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f00dc08cb40 0x7f00dc08f000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f00e0009b90 tx=0x7f00e0009060).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.888+0000 7f0107a23b80 1 Processor -- start 2023-11-06T13:41:16.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.888+0000 7f0107a23b80 1 -- start start 2023-11-06T13:41:16.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56be84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56bf0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56bf07f0 0x556f56bf0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f0107a23b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56b6cfd0 con 0x556f56be89a0 2023-11-06T13:41:16.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f0107a23b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56ae4240 con 0x556f56bf07f0 2023-11-06T13:41:16.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f0107a23b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56af9490 con 0x556f56963e90 2023-11-06T13:41:16.905 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f00eeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56bf0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f00ef7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56be84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f00eeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56bf0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38666/0 (socket says 172.21.15.38:38666) 2023-11-06T13:41:16.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.889+0000 7f00eeffd700 1 -- 172.21.15.38:0/1229445853 learned_addr learned my addr 172.21.15.38:0/1229445853 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.906 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00effff700 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56bf07f0 0x556f56bf0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00eeffd700 1 -- 172.21.15.38:0/1229445853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 msgr2=0x556f56be84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00eeffd700 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56be84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00eeffd700 1 -- 172.21.15.38:0/1229445853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56bf07f0 msgr2=0x556f56bf0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00eeffd700 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56bf07f0 0x556f56bf0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.907 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00eeffd700 1 -- 172.21.15.38:0/1229445853 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f56af2670 con 0x556f56be89a0 2023-11-06T13:41:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56be84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00effff700 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56bf07f0 0x556f56bf0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00eeffd700 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56bf0300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f00e4003830 tx=0x7f00e4007d20).ready entity=mon.0 client_cookie=99263925544d1dfa server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00d4ff9700 1 -- 172.21.15.38:0/1229445853 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4003290 con 0x556f56be89a0 2023-11-06T13:41:16.908 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00d4ff9700 1 -- 172.21.15.38:0/1229445853 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e400f5b0 con 0x556f56be89a0 2023-11-06T13:41:16.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.890+0000 7f00d4ff9700 1 -- 172.21.15.38:0/1229445853 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e400f950 con 0x556f56be89a0 2023-11-06T13:41:16.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 -- 172.21.15.38:0/1229445853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 msgr2=0x556f56bf0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56bf0300 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f00e4003830 tx=0x7f00e4007d20).stop 2023-11-06T13:41:16.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 -- 172.21.15.38:0/1229445853 shutdown_connections 2023-11-06T13:41:16.909 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56bf07f0 0x556f56bf0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56be84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1229445853 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56bf0300 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 -- 172.21.15.38:0/1229445853 >> 172.21.15.38:0/1229445853 conn(0x556f56a114f0 msgr2=0x556f56ba76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 -- 172.21.15.38:0/1229445853 shutdown_connections 2023-11-06T13:41:16.910 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.891+0000 7f0107a23b80 1 -- 172.21.15.38:0/1229445853 wait complete. 2023-11-06T13:41:16.914 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.892+0000 7f0107a23b80 1 -- start start 2023-11-06T13:41:16.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.892+0000 7f0107a23b80 1 Processor -- start 2023-11-06T13:41:16.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56beb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56be2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.915 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c25e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56af95d0 con 0x556f56bf07f0 2023-11-06T13:41:16.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56af9850 con 0x556f56be89a0 2023-11-06T13:41:16.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56ac4e60 con 0x556f56963e90 2023-11-06T13:41:16.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 10 client.0 ll_register_callbacks cb 0x556f56b675b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:16.916 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c25e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c25e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38678/0 (socket says 172.21.15.38:38678) 2023-11-06T13:41:16.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 -- 172.21.15.38:0/3122558220 learned_addr learned my addr 172.21.15.38:0/3122558220 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56beb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00eeffd700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56be2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 -- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 msgr2=0x556f56beb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56beb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 -- 172.21.15.38:0/3122558220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 msgr2=0x556f56be2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56be2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.918 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 -- 172.21.15.38:0/3122558220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e0011820 con 0x556f56bf07f0 2023-11-06T13:41:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00effff700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c25e90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f00e8087060 tx=0x7f00e8029040).ready entity=mon.0 client_cookie=8af2582ead2fa302 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00cdffb700 1 -- 172.21.15.38:0/3122558220 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e808b220 con 0x556f56bf07f0 2023-11-06T13:41:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f00cdffb700 1 -- 172.21.15.38:0/3122558220 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f00e8086a60 con 0x556f56bf07f0 2023-11-06T13:41:16.919 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.893+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f56b9b690 con 0x556f56bf07f0 2023-11-06T13:41:16.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f00cdffb700 1 -- 172.21.15.38:0/3122558220 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00e8086ea0 con 0x556f56bf07f0 2023-11-06T13:41:16.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 10 client.5727 fetch_fsmap learned FSMap version 45 2023-11-06T13:41:16.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x7f00f00ee100 con 0x556f56bf07f0 2023-11-06T13:41:16.920 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f00cdffb700 1 -- 172.21.15.38:0/3122558220 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f56b9b690 con 0x556f56bf07f0 2023-11-06T13:41:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f00cdffb700 1 -- 172.21.15.38:0/3122558220 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 45) v1 ==== 7524+0+0 (secure 0 0 0) 0x7f00e8083150 con 0x556f56bf07f0 2023-11-06T13:41:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 10 client.5727 fetch_fsmap finished waiting for FSMap version 45 2023-11-06T13:41:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 10 client.5727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 20 client.5727 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:16.921 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c29680 0x556f56c29a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 4 client.5727 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:41:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f5695fcf0 con 0x556f56c29680 2023-11-06T13:41:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c29680 0x556f56c29a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f00cdffb700 10 client.5727 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.922 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.894+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c29680 0x556f56c29a90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9681433b26c747a0 server_cookie=f64bee0d8cc7872d in_seq=0 out_seq=0 2023-11-06T13:41:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f00cdffb700 1 -- 172.21.15.38:0/3122558220 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x556f5695fcf0 con 0x556f56c29680 2023-11-06T13:41:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f00cdffb700 10 client.5727 handle_command_reply: tid=0 2023-11-06T13:41:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 client.5727 shutdown 2023-11-06T13:41:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 msgr2=0x556f56c25e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.923 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c25e90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f00e8087060 tx=0x7f00e8029040).stop 2023-11-06T13:41:16.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 shutdown_connections 2023-11-06T13:41:16.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c25e90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c29680 0x556f56c29a90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56beb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3122558220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56be2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f00cdffb700 0 client.5727 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 >> 172.21.15.38:0/3122558220 conn(0x556f56a114f0 msgr2=0x556f56be4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 shutdown_connections 2023-11-06T13:41:16.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 1 -- 172.21.15.38:0/3122558220 wait complete. 2023-11-06T13:41:16.925 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.895+0000 7f0107a23b80 20 client.5727 trim_cache size 0 max 16384 2023-11-06T13:41:16.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.911+0000 7f0107a23b80 1 Processor -- start 2023-11-06T13:41:16.931 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.911+0000 7f0107a23b80 1 -- start start 2023-11-06T13:41:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56ba5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56c72e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c75ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f0107a23b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56bf0350 con 0x556f56bf07f0 2023-11-06T13:41:16.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f0107a23b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56c0db80 con 0x556f56be89a0 2023-11-06T13:41:16.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f0107a23b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56be9220 con 0x556f56963e90 2023-11-06T13:41:16.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.912+0000 7f00effff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c75ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00eeffd700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56c72e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c75ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38682/0 (socket says 172.21.15.38:38682) 2023-11-06T13:41:16.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 -- 172.21.15.38:0/3926857646 learned_addr learned my addr 172.21.15.38:0/3926857646 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56ba5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 -- 172.21.15.38:0/3926857646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 msgr2=0x556f56ba5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56ba5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 -- 172.21.15.38:0/3926857646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 msgr2=0x556f56c72e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56c72e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 -- 172.21.15.38:0/3926857646 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4003480 con 0x556f56bf07f0 2023-11-06T13:41:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00eeffd700 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56c72e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:16.935 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00effff700 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c75ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f00e80872f0 tx=0x7f00e808b000).ready entity=mon.0 client_cookie=709ab745b8834656 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00d57fa700 1 -- 172.21.15.38:0/3926857646 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8013e80 con 0x556f56bf07f0 2023-11-06T13:41:16.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00d57fa700 1 -- 172.21.15.38:0/3926857646 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e808ce90 con 0x556f56bf07f0 2023-11-06T13:41:16.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.913+0000 7f00d57fa700 1 -- 172.21.15.38:0/3926857646 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8086ea0 con 0x556f56bf07f0 2023-11-06T13:41:16.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 -- 172.21.15.38:0/3926857646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 msgr2=0x556f56c75ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.936 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c75ba0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f00e80872f0 tx=0x7f00e808b000).stop 2023-11-06T13:41:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 -- 172.21.15.38:0/3926857646 shutdown_connections 2023-11-06T13:41:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56bf07f0 0x556f56c75ba0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56963e90 0x556f56ba5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 --2- 172.21.15.38:0/3926857646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56be89a0 0x556f56c72e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.937 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 -- 172.21.15.38:0/3926857646 >> 172.21.15.38:0/3926857646 conn(0x556f56a114f0 msgr2=0x556f56b9ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 -- 172.21.15.38:0/3926857646 shutdown_connections 2023-11-06T13:41:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 -- 172.21.15.38:0/3926857646 wait complete. 2023-11-06T13:41:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 -- start start 2023-11-06T13:41:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.914+0000 7f0107a23b80 1 Processor -- start 2023-11-06T13:41:16.938 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.915+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56963e90 0x556f56c0d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.915+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56be8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.915+0000 7f0107a23b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56bf07f0 0x556f56be94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.915+0000 7f0107a23b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56c6f1d0 con 0x556f56be89a0 2023-11-06T13:41:16.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.915+0000 7f0107a23b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56be9d50 con 0x556f56963e90 2023-11-06T13:41:16.939 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.915+0000 7f0107a23b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f56c7f670 con 0x556f56bf07f0 2023-11-06T13:41:16.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f0107a23b80 10 client.0 ll_register_callbacks cb 0x556f56b675b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:16.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56be8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56be8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:38688/0 (socket says 172.21.15.38:38688) 2023-11-06T13:41:16.940 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 -- 172.21.15.38:0/1043204397 learned_addr learned my addr 172.21.15.38:0/1043204397 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56963e90 0x556f56c0d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00effff700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56bf07f0 0x556f56be94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 -- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56bf07f0 msgr2=0x556f56be94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56bf07f0 0x556f56be94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.941 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 -- 172.21.15.38:0/1043204397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56963e90 msgr2=0x556f56c0d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:16.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56963e90 0x556f56c0d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 -- 172.21.15.38:0/1043204397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f56af2670 con 0x556f56be89a0 2023-11-06T13:41:16.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56963e90 0x556f56c0d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:16.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00eeffd700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56be8e10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f00e4003f10 tx=0x7f00e4016000).ready entity=mon.0 client_cookie=ed3bfa4a446dfcde server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:16.942 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:16.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00cdffb700 1 -- 172.21.15.38:0/1043204397 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4007320 con 0x556f56be89a0 2023-11-06T13:41:16.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00cdffb700 1 -- 172.21.15.38:0/1043204397 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f00e4007480 con 0x556f56be89a0 2023-11-06T13:41:16.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00e400f5b0 con 0x556f56be89a0 2023-11-06T13:41:16.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00cdffb700 1 -- 172.21.15.38:0/1043204397 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00e40066a0 con 0x556f56be89a0 2023-11-06T13:41:16.943 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f0107a23b80 10 client.5733 fetch_fsmap learned FSMap version 45 2023-11-06T13:41:16.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x7f00f00ee100 con 0x556f56be89a0 2023-11-06T13:41:16.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.916+0000 7f00cdffb700 1 -- 172.21.15.38:0/1043204397 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e400f5b0 con 0x556f56be89a0 2023-11-06T13:41:16.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f00cdffb700 1 -- 172.21.15.38:0/1043204397 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 45) v1 ==== 7524+0+0 (secure 0 0 0) 0x7f00e4003860 con 0x556f56be89a0 2023-11-06T13:41:16.944 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 10 client.5733 fetch_fsmap finished waiting for FSMap version 45 2023-11-06T13:41:16.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 10 client.5733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:16.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 20 client.5733 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:16.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c7fb00 0x556f56c105b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:16.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 4 client.5733 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:41:16.945 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556f56996cf0 con 0x556f56c7fb00 2023-11-06T13:41:16.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c7fb00 0x556f56c105b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:16.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f00cdffb700 10 client.5733 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f00ef7fe700 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c7fb00 0x556f56c105b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a65eafd98b5dd937 server_cookie=9400f1cbc403ac54 in_seq=0 out_seq=0 2023-11-06T13:41:16.946 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f00cdffb700 1 -- 172.21.15.38:0/1043204397 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556f56996cf0 con 0x556f56c7fb00 2023-11-06T13:41:16.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f00cdffb700 10 client.5733 handle_command_reply: tid=0 2023-11-06T13:41:16.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 1 client.5733 shutdown 2023-11-06T13:41:16.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 msgr2=0x556f56be8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.917+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56be8e10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f00e4003f10 tx=0x7f00e4016000).stop 2023-11-06T13:41:16.947 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 shutdown_connections 2023-11-06T13:41:16.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x556f56c7fb00 0x556f56c105b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556f56bf07f0 0x556f56be94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00cdffb700 0 client.5733 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:16.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556f56963e90 0x556f56c0d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.948 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 --2- 172.21.15.38:0/1043204397 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x556f56be89a0 0x556f56be8e10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 >> 172.21.15.38:0/1043204397 conn(0x556f56a114f0 msgr2=0x556f56beba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 shutdown_connections 2023-11-06T13:41:16.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 1 -- 172.21.15.38:0/1043204397 wait complete. 2023-11-06T13:41:16.949 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f0107a23b80 20 client.5733 trim_cache size 0 max 16384 2023-11-06T13:41:16.950 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:41:16.950 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:41:16.950 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:41:16.950 INFO:teuthology.orchestra.run.smithi038.stdout: "a0b7a723-e7b5-4489-a6ec-587cadbf70f9": { 2023-11-06T13:41:16.951 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:41:16.951 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "a0b7a723-e7b5-4489-a6ec-587cadbf70f9", 2023-11-06T13:41:16.951 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:41:16.951 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:41:16.952 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:41:16.952 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:41:16.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f00dc08cb40 msgr2=0x7f00dc08f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.953 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f00dc08cb40 0x7f00dc08f000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f00e0009b90 tx=0x7f00e0009060).stop 2023-11-06T13:41:16.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 msgr2=0x7f00f0156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:16.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f0156600 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f00e800b6c0 tx=0x7f00e8009840).stop 2023-11-06T13:41:16.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 shutdown_connections 2023-11-06T13:41:16.954 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f00f017cac0 0x7f00f0156600 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00f00cb960 0x7f00f00ece90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f00dc08cb40 0x7f00dc08f000 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 --2- 172.21.15.38:0/987903939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f0175890 0x7f00f0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:16.955 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 >> 172.21.15.38:0/987903939 conn(0x7f00f00f5d20 msgr2=0x7f00f01574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:16.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 shutdown_connections 2023-11-06T13:41:16.956 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:16.918+0000 7f00f4e29700 1 -- 172.21.15.38:0/987903939 wait complete. 2023-11-06T13:41:16.956 INFO:tasks.cephfs.filesystem:scrub status for tag:a0b7a723-e7b5-4489-a6ec-587cadbf70f9 - {'path': '/', 'tag': 'a0b7a723-e7b5-4489-a6ec-587cadbf70f9', 'options': 'recursive,force'} 2023-11-06T13:41:46.958 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:41:47.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.090+0000 7f73fd7df700 1 Processor -- start 2023-11-06T13:41:47.094 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.090+0000 7f73fd7df700 1 -- start start 2023-11-06T13:41:47.096 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73fd7df700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f73f8179040 0x7f73f817e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73fd7df700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73f80f0350 0x7f73f80f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73fd7df700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f817cbe0 con 0x7f73f8178c60 2023-11-06T13:41:47.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73fd7df700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f8064370 con 0x7f73f80f0350 2023-11-06T13:41:47.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73fd7df700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f817ce80 con 0x7f73f8179040 2023-11-06T13:41:47.097 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73f67fc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f73f8179040 0x7f73f817e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73f6ffd700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f73f8178c60 0x7f73f817d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:49182/0 (socket says 172.21.15.38:49182) 2023-11-06T13:41:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73f67fc700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f73f8179040 0x7f73f817e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36692/0 (socket says 172.21.15.38:36692) 2023-11-06T13:41:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73f77fe700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f73f80f0350 0x7f73f80f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.091+0000 7f73f67fc700 1 -- 172.21.15.38:0/3491177127 learned_addr learned my addr 172.21.15.38:0/3491177127 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:47.098 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f5ffb700 1 -- 172.21.15.38:0/3491177127 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139540719 0 0) 0x7f73f817cbe0 con 0x7f73f8178c60 2023-11-06T13:41:47.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f67fc700 1 -- 172.21.15.38:0/3491177127 >> v2:172.21.15.44:3300/0 conn(0x7f73f80f0350 msgr2=0x7f73f80f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f67fc700 1 --2- 172.21.15.38:0/3491177127 >> v2:172.21.15.44:3300/0 conn(0x7f73f80f0350 0x7f73f80f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f67fc700 1 -- 172.21.15.38:0/3491177127 >> v1:172.21.15.44:6789/0 conn(0x7f73f8178c60 legacy=0x7f73f817d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.099 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f67fc700 1 -- 172.21.15.38:0/3491177127 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f817d160 con 0x7f73f8179040 2023-11-06T13:41:47.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f67fc700 1 --2- 172.21.15.38:0/3491177127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f8179040 0x7f73f817e070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f73f80649c0 tx=0x7f73ec0090f0).ready entity=mon.2 client_cookie=ed01d87a74530828 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f5ffb700 1 -- 172.21.15.38:0/3491177127 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00b520 con 0x7f73f8179040 2023-11-06T13:41:47.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f5ffb700 1 -- 172.21.15.38:0/3491177127 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00b680 con 0x7f73f8179040 2023-11-06T13:41:47.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73f5ffb700 1 -- 172.21.15.38:0/3491177127 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00ba20 con 0x7f73f8179040 2023-11-06T13:41:47.100 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73fd7df700 1 -- 172.21.15.38:0/3491177127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f8179040 msgr2=0x7f73f817e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3491177127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f8179040 0x7f73f817e070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f73f80649c0 tx=0x7f73ec0090f0).stop 2023-11-06T13:41:47.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73fd7df700 1 -- 172.21.15.38:0/3491177127 shutdown_connections 2023-11-06T13:41:47.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3491177127 >> v2:172.21.15.44:3300/0 conn(0x7f73f80f0350 0x7f73f80f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3491177127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f8179040 0x7f73f817e070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.101 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.092+0000 7f73fd7df700 1 -- 172.21.15.38:0/3491177127 >> 172.21.15.38:0/3491177127 conn(0x7f73f80f5ea0 msgr2=0x7f73f80f1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:47.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.093+0000 7f73fd7df700 1 -- 172.21.15.38:0/3491177127 shutdown_connections 2023-11-06T13:41:47.102 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.093+0000 7f73fd7df700 1 -- 172.21.15.38:0/3491177127 wait complete. 2023-11-06T13:41:47.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.094+0000 7f73fd7df700 1 Processor -- start 2023-11-06T13:41:47.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.094+0000 7f73fd7df700 1 -- start start 2023-11-06T13:41:47.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73fd7df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 0x7f73f817aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73fd7df700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f8178c60 0x7f73f80637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.105 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73fd7df700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73f8179040 0x7f73f80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73fd7df700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8179490 con 0x7f73f8178c60 2023-11-06T13:41:47.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73fd7df700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f817a5d0 con 0x7f73f8179040 2023-11-06T13:41:47.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73fd7df700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80ecc30 con 0x7f73f80f0350 2023-11-06T13:41:47.106 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 0x7f73f817aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73f67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f8178c60 0x7f73f80637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 0x7f73f817aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36698/0 (socket says 172.21.15.38:36698) 2023-11-06T13:41:47.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73f6ffd700 1 -- 172.21.15.38:0/3448990013 learned_addr learned my addr 172.21.15.38:0/3448990013 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:47.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.095+0000 7f73f67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f8178c60 0x7f73f80637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36646/0 (socket says 172.21.15.38:36646) 2023-11-06T13:41:47.107 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f77fe700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73f8179040 0x7f73f80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f6ffd700 1 -- 172.21.15.38:0/3448990013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73f8179040 msgr2=0x7f73f80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73f8179040 0x7f73f80ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f6ffd700 1 -- 172.21.15.38:0/3448990013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f8178c60 msgr2=0x7f73f80637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f8178c60 0x7f73f80637d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.108 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f6ffd700 1 -- 172.21.15.38:0/3448990013 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec009370 con 0x7f73f80f0350 2023-11-06T13:41:47.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 0x7f73f817aa60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f73e800c4c0 tx=0x7f73e8007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73deffd700 1 -- 172.21.15.38:0/3448990013 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80072e0 con 0x7f73f80f0350 2023-11-06T13:41:47.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73deffd700 1 -- 172.21.15.38:0/3448990013 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8007460 con 0x7f73f80f0350 2023-11-06T13:41:47.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f81796e0 con 0x7f73f80f0350 2023-11-06T13:41:47.109 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73deffd700 1 -- 172.21.15.38:0/3448990013 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8005930 con 0x7f73f80f0350 2023-11-06T13:41:47.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.096+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8179ca0 con 0x7f73f80f0350 2023-11-06T13:41:47.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.098+0000 7f73deffd700 1 -- 172.21.15.38:0/3448990013 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f73e8005ca0 con 0x7f73f80f0350 2023-11-06T13:41:47.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.099+0000 7f73deffd700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f73e408cb10 0x7f73e408efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.110 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.099+0000 7f73deffd700 1 -- 172.21.15.38:0/3448990013 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73e80b17b0 con 0x7f73f80f0350 2023-11-06T13:41:47.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.099+0000 7f73f67fc700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f73e408cb10 0x7f73e408efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.099+0000 7f73f67fc700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f73e408cb10 0x7f73e408efd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f73ec00b2e0 tx=0x7f73ec017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.100+0000 7f740f177b80 1 Processor -- start 2023-11-06T13:41:47.111 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.101+0000 7f740f177b80 1 -- start start 2023-11-06T13:41:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f740f177b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bd94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f740f177b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.117 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f740f177b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd91c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f740f177b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bd16fd0 con 0x55be3bd948f0 2023-11-06T13:41:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f740f177b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bc8e240 con 0x55be3bb0de90 2023-11-06T13:41:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f740f177b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bca3490 con 0x55be3bd51110 2023-11-06T13:41:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.118 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f67fc700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36654/0 (socket says 172.21.15.38:36654) 2023-11-06T13:41:47.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f67fc700 1 -- 172.21.15.38:0/4045958268 learned_addr learned my addr 172.21.15.38:0/4045958268 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:47.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bd94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f77fe700 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd91c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 -- 172.21.15.38:0/4045958268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 msgr2=0x55be3bd91c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.119 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd91c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 -- 172.21.15.38:0/4045958268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 msgr2=0x55be3bd50c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 -- 172.21.15.38:0/4045958268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be3bc9c670 con 0x55be3bb0de90 2023-11-06T13:41:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f67fc700 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:47.120 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bd94400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f73e800c490 tx=0x7f73e80af360).ready entity=mon.1 client_cookie=30604ca0c30d3e76 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73d7fff700 1 -- 172.21.15.38:0/4045958268 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80853e0 con 0x55be3bb0de90 2023-11-06T13:41:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73d7fff700 1 -- 172.21.15.38:0/4045958268 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8085a80 con 0x55be3bb0de90 2023-11-06T13:41:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.102+0000 7f73d7fff700 1 -- 172.21.15.38:0/4045958268 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e808b360 con 0x55be3bb0de90 2023-11-06T13:41:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 -- 172.21.15.38:0/4045958268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 msgr2=0x55be3bd94400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.121 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bd94400 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f73e800c490 tx=0x7f73e80af360).stop 2023-11-06T13:41:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 -- 172.21.15.38:0/4045958268 shutdown_connections 2023-11-06T13:41:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd91c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bd94400 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.122 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 --2- 172.21.15.38:0/4045958268 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 -- 172.21.15.38:0/4045958268 >> 172.21.15.38:0/4045958268 conn(0x55be3bbbb4f0 msgr2=0x55be3bd51d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 -- 172.21.15.38:0/4045958268 shutdown_connections 2023-11-06T13:41:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.103+0000 7f740f177b80 1 -- 172.21.15.38:0/4045958268 wait complete. 2023-11-06T13:41:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.104+0000 7f740f177b80 1 -- start start 2023-11-06T13:41:47.123 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.104+0000 7f740f177b80 1 Processor -- start 2023-11-06T13:41:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 0x55be3bd4c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bd51110 0x55be3bdc4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd948f0 0x55be3bd4bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bca35d0 con 0x55be3bb0de90 2023-11-06T13:41:47.124 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bca3850 con 0x55be3bd51110 2023-11-06T13:41:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bc6ee60 con 0x55be3bd948f0 2023-11-06T13:41:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f740f177b80 10 client.0 ll_register_callbacks cb 0x55be3bd113d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 0x55be3bd4c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f73f6ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 0x55be3bd4c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36660/0 (socket says 172.21.15.38:36660) 2023-11-06T13:41:47.125 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f73f6ffd700 1 -- 172.21.15.38:0/2986207741 learned_addr learned my addr 172.21.15.38:0/2986207741 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f73f77fe700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd948f0 0x55be3bd4bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.105+0000 7f73f6ffd700 1 -- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd948f0 msgr2=0x55be3bd4bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd948f0 0x55be3bd4bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f6ffd700 1 -- 172.21.15.38:0/2986207741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bd51110 msgr2=0x55be3bdc4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.126 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f67fc700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bd51110 0x55be3bdc4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bd51110 0x55be3bdc4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f6ffd700 1 -- 172.21.15.38:0/2986207741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f817d160 con 0x55be3bb0de90 2023-11-06T13:41:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f77fe700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd948f0 0x55be3bd4bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:41:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 0x55be3bd4c6e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f73e8083dd0 tx=0x7f73e808d000).ready entity=mon.0 client_cookie=3bfefe4753d4d802 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.127 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73d57fa700 1 -- 172.21.15.38:0/2986207741 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e8001040 con 0x55be3bb0de90 2023-11-06T13:41:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73d57fa700 1 -- 172.21.15.38:0/2986207741 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73e808b360 con 0x55be3bb0de90 2023-11-06T13:41:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be3bd45690 con 0x55be3bb0de90 2023-11-06T13:41:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73d57fa700 1 -- 172.21.15.38:0/2986207741 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73e80853e0 con 0x55be3bb0de90 2023-11-06T13:41:47.128 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 10 client.5742 fetch_fsmap learned FSMap version 49 2023-11-06T13:41:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x7f73f8179ca0 con 0x55be3bb0de90 2023-11-06T13:41:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73d57fa700 1 -- 172.21.15.38:0/2986207741 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e80a1020 con 0x55be3bb0de90 2023-11-06T13:41:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f73d57fa700 1 -- 172.21.15.38:0/2986207741 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 49) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f73e801b340 con 0x55be3bb0de90 2023-11-06T13:41:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 10 client.5742 fetch_fsmap finished waiting for FSMap version 49 2023-11-06T13:41:47.129 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 10 client.5742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 20 client.5742 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bd80820 0x55be3bdc00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 4 client.5742 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:41:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.106+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be3bb09cf0 con 0x55be3bd80820 2023-11-06T13:41:47.130 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.107+0000 7f73f67fc700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bd80820 0x55be3bdc00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.107+0000 7f73d57fa700 10 client.5742 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.107+0000 7f73f67fc700 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bd80820 0x55be3bdc00a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=baaffabe04504f server_cookie=4ae79cdfac3b0a89 in_seq=0 out_seq=0 2023-11-06T13:41:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f73d57fa700 1 -- 172.21.15.38:0/2986207741 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55be3bb09cf0 con 0x55be3bd80820 2023-11-06T13:41:47.131 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f73d57fa700 10 client.5742 handle_command_reply: tid=0 2023-11-06T13:41:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 client.5742 shutdown 2023-11-06T13:41:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 msgr2=0x55be3bd4c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.133 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 0x55be3bd4c6e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f73e8083dd0 tx=0x7f73e808d000).stop 2023-11-06T13:41:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 shutdown_connections 2023-11-06T13:41:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bd80820 0x55be3bdc00a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd948f0 0x55be3bd4bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.134 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f73d57fa700 0 client.5742 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bb0de90 0x55be3bd4c6e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 --2- 172.21.15.38:0/2986207741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bd51110 0x55be3bdc4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 >> 172.21.15.38:0/2986207741 conn(0x55be3bbbb4f0 msgr2=0x55be3bdc1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 shutdown_connections 2023-11-06T13:41:47.135 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 1 -- 172.21.15.38:0/2986207741 wait complete. 2023-11-06T13:41:47.136 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.108+0000 7f740f177b80 20 client.5742 trim_cache size 0 max 16384 2023-11-06T13:41:47.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.125+0000 7f740f177b80 1 Processor -- start 2023-11-06T13:41:47.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.125+0000 7f740f177b80 1 -- start start 2023-11-06T13:41:47.141 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f740f177b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f740f177b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd4bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f740f177b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f740f177b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bd50700 con 0x55be3bd948f0 2023-11-06T13:41:47.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f740f177b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bd4caf0 con 0x55be3bb0de90 2023-11-06T13:41:47.142 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f740f177b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bdd0220 con 0x55be3bd51110 2023-11-06T13:41:47.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36668/0 (socket says 172.21.15.38:36668) 2023-11-06T13:41:47.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 -- 172.21.15.38:0/1601969979 learned_addr learned my addr 172.21.15.38:0/1601969979 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:47.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f67fc700 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd4bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.143 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 -- 172.21.15.38:0/1601969979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 msgr2=0x55be3bd4bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd4bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 -- 172.21.15.38:0/1601969979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 msgr2=0x55be3bdd3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.144 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 -- 172.21.15.38:0/1601969979 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be3bc97a10 con 0x55be3bd948f0 2023-11-06T13:41:47.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f67fc700 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd4bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:41:47.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73f77fe700 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f73f00136a0 tx=0x7f73f000b040).ready entity=mon.0 client_cookie=8113a909df310930 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73dcff9700 1 -- 172.21.15.38:0/1601969979 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000e040 con 0x55be3bd948f0 2023-11-06T13:41:47.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73dcff9700 1 -- 172.21.15.38:0/1601969979 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000f040 con 0x55be3bd948f0 2023-11-06T13:41:47.145 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.126+0000 7f73dcff9700 1 -- 172.21.15.38:0/1601969979 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00132a0 con 0x55be3bd948f0 2023-11-06T13:41:47.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 -- 172.21.15.38:0/1601969979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 msgr2=0x55be3bd50960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f73f00136a0 tx=0x7f73f000b040).stop 2023-11-06T13:41:47.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 -- 172.21.15.38:0/1601969979 shutdown_connections 2023-11-06T13:41:47.146 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bd50960 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 --2- 172.21.15.38:0/1601969979 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd4bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 -- 172.21.15.38:0/1601969979 >> 172.21.15.38:0/1601969979 conn(0x55be3bbbb4f0 msgr2=0x55be3bd7d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:47.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 -- 172.21.15.38:0/1601969979 shutdown_connections 2023-11-06T13:41:47.147 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.127+0000 7f740f177b80 1 -- 172.21.15.38:0/1601969979 wait complete. 2023-11-06T13:41:47.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.128+0000 7f740f177b80 1 -- start start 2023-11-06T13:41:47.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.128+0000 7f740f177b80 1 Processor -- start 2023-11-06T13:41:47.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd92320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.148 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bdb6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3bdb7230 con 0x55be3bd948f0 2023-11-06T13:41:47.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3be25a30 con 0x55be3bb0de90 2023-11-06T13:41:47.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be3be28e20 con 0x55be3bd51110 2023-11-06T13:41:47.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f740f177b80 10 client.0 ll_register_callbacks cb 0x55be3bd113d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:47.149 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bdb6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bdb6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36678/0 (socket says 172.21.15.38:36678) 2023-11-06T13:41:47.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 -- 172.21.15.38:0/3287279988 learned_addr learned my addr 172.21.15.38:0/3287279988 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:47.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f67fc700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd92320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.150 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 -- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 msgr2=0x55be3bd92320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd92320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 -- 172.21.15.38:0/3287279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 msgr2=0x55be3bdd3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:47.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.151 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 -- 172.21.15.38:0/3287279988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0013400 con 0x55be3bd948f0 2023-11-06T13:41:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:41:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73f77fe700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bdb6650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f73f0017fd0 tx=0x7f73f0020000).ready entity=mon.0 client_cookie=d3e25aa793d554bf server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.129+0000 7f73d57fa700 1 -- 172.21.15.38:0/3287279988 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000e040 con 0x55be3bd948f0 2023-11-06T13:41:47.152 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f73d57fa700 1 -- 172.21.15.38:0/3287279988 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f73f0018660 con 0x55be3bd948f0 2023-11-06T13:41:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73e8085a80 con 0x55be3bd948f0 2023-11-06T13:41:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f73d57fa700 1 -- 172.21.15.38:0/3287279988 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f0018a30 con 0x55be3bd948f0 2023-11-06T13:41:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 10 client.5748 fetch_fsmap learned FSMap version 49 2023-11-06T13:41:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55be3bc97760 con 0x55be3bd948f0 2023-11-06T13:41:47.153 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f73d57fa700 1 -- 172.21.15.38:0/3287279988 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e8085a80 con 0x55be3bd948f0 2023-11-06T13:41:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f73d57fa700 1 -- 172.21.15.38:0/3287279988 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 49) v1 ==== 7528+0+0 (secure 0 0 0) 0x7f73f0018b90 con 0x55be3bd948f0 2023-11-06T13:41:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 10 client.5748 fetch_fsmap finished waiting for FSMap version 49 2023-11-06T13:41:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 10 client.5748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 20 client.5748 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:47.154 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bdb7650 0x55be3be24990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 4 client.5748 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:41:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55be3bb40cf0 con 0x55be3bdb7650 2023-11-06T13:41:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.130+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bdb7650 0x55be3be24990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f73d57fa700 10 client.5748 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:47.155 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f73f6ffd700 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bdb7650 0x55be3be24990 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=912717ba7673abd8 server_cookie=9872f16ee2cad13 in_seq=0 out_seq=0 2023-11-06T13:41:47.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f73d57fa700 1 -- 172.21.15.38:0/3287279988 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55be3bb40cf0 con 0x55be3bdb7650 2023-11-06T13:41:47.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f73d57fa700 10 client.5748 handle_command_reply: tid=0 2023-11-06T13:41:47.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 client.5748 shutdown 2023-11-06T13:41:47.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 msgr2=0x55be3bdb6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.156 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bdb6650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f73f0017fd0 tx=0x7f73f0020000).stop 2023-11-06T13:41:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 shutdown_connections 2023-11-06T13:41:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55be3bd948f0 0x55be3bdb6650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55be3bb0de90 0x55be3bdd3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55be3bdb7650 0x55be3be24990 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.157 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 --2- 172.21.15.38:0/3287279988 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55be3bd51110 0x55be3bd92320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f73d57fa700 0 client.5748 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 >> 172.21.15.38:0/3287279988 conn(0x55be3bbbb4f0 msgr2=0x55be3bd4d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 shutdown_connections 2023-11-06T13:41:47.158 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 1 -- 172.21.15.38:0/3287279988 wait complete. 2023-11-06T13:41:47.159 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.131+0000 7f740f177b80 20 client.5748 trim_cache size 0 max 16384 2023-11-06T13:41:47.159 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:41:47.159 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:41:47.160 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:41:47.160 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:41:47.161 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f73e408cb10 msgr2=0x7f73e408efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f73e408cb10 0x7f73e408efd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f73ec00b2e0 tx=0x7f73ec017000).stop 2023-11-06T13:41:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 msgr2=0x7f73f817aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 0x7f73f817aa60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f73e800c4c0 tx=0x7f73e8007c10).stop 2023-11-06T13:41:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 shutdown_connections 2023-11-06T13:41:47.162 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f73e408cb10 0x7f73e408efd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73f8179040 0x7f73f80ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f73f80f0350 0x7f73f817aa60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 --2- 172.21.15.38:0/3448990013 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f73f8178c60 0x7f73f80637d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 >> 172.21.15.38:0/3448990013 conn(0x7f73f80f5ea0 msgr2=0x7f73f817ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:47.163 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 shutdown_connections 2023-11-06T13:41:47.164 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:47.132+0000 7f73fd7df700 1 -- 172.21.15.38:0/3448990013 wait complete. 2023-11-06T13:41:47.164 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:41:48.165 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-11-06T13:41:48.165 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-11-06T13:41:48.291 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.287+0000 7fccca8f0700 1 Processor -- start 2023-11-06T13:41:48.292 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.287+0000 7fccca8f0700 1 -- start start 2023-11-06T13:41:48.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.288+0000 7fccca8f0700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fccc417c250 0x7fccc417f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.288+0000 7fccca8f0700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc417f000 con 0x7fccc417f980 2023-11-06T13:41:48.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.288+0000 7fccca8f0700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc417e110 con 0x7fccc417c630 2023-11-06T13:41:48.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.288+0000 7fccca8f0700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc417e3f0 con 0x7fccc417c250 2023-11-06T13:41:48.294 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc3fff700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fccc417c250 0x7fccc417f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc8e8d700 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fccc417f980 0x7fccc40c1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.38:49196/0 (socket says 172.21.15.38:49196) 2023-11-06T13:41:48.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc8e8d700 1 -- 172.21.15.38:0/1293056294 learned_addr learned my addr 172.21.15.38:0/1293056294 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:41:48.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc2ffd700 1 -- 172.21.15.38:0/1293056294 <== mon.1 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772917639 0 0) 0x7fccc417f000 con 0x7fccc417f980 2023-11-06T13:41:48.295 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc2ffd700 1 -- 172.21.15.38:0/1293056294 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac0033f0 con 0x7fccc417f980 2023-11-06T13:41:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc2ffd700 1 -- 172.21.15.38:0/1293056294 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179901209 0 0) 0x7fccc417e110 con 0x7fccc417c630 2023-11-06T13:41:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc3fff700 1 -- 172.21.15.38:0/1293056294 >> v1:172.21.15.163:6789/0 conn(0x7fccc417c630 legacy=0x7fccc40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc3fff700 1 -- 172.21.15.38:0/1293056294 >> v1:172.21.15.44:6789/0 conn(0x7fccc417f980 legacy=0x7fccc40c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.296 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc3fff700 1 -- 172.21.15.38:0/1293056294 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc417e6d0 con 0x7fccc417c250 2023-11-06T13:41:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc3fff700 1 --2- 172.21.15.38:0/1293056294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417c250 0x7fccc417f490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fccb4009760 tx=0x7fccb4009060).ready entity=mon.2 client_cookie=4d763339e062d2d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc2ffd700 1 -- 172.21.15.38:0/1293056294 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb40090d0 con 0x7fccc417c250 2023-11-06T13:41:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc2ffd700 1 -- 172.21.15.38:0/1293056294 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb400f510 con 0x7fccc417c250 2023-11-06T13:41:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.289+0000 7fccc2ffd700 1 -- 172.21.15.38:0/1293056294 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400f890 con 0x7fccc417c250 2023-11-06T13:41:48.297 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 -- 172.21.15.38:0/1293056294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417c250 msgr2=0x7fccc417f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 --2- 172.21.15.38:0/1293056294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417c250 0x7fccc417f490 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fccb4009760 tx=0x7fccb4009060).stop 2023-11-06T13:41:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 -- 172.21.15.38:0/1293056294 shutdown_connections 2023-11-06T13:41:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 --2- 172.21.15.38:0/1293056294 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417c250 0x7fccc417f490 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 -- 172.21.15.38:0/1293056294 >> 172.21.15.38:0/1293056294 conn(0x7fccc405e1b0 msgr2=0x7fccc405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.298 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 -- 172.21.15.38:0/1293056294 shutdown_connections 2023-11-06T13:41:48.299 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.290+0000 7fccca8f0700 1 -- 172.21.15.38:0/1293056294 wait complete. 2023-11-06T13:41:48.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.291+0000 7fccca8f0700 1 Processor -- start 2023-11-06T13:41:48.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.291+0000 7fccca8f0700 1 -- start start 2023-11-06T13:41:48.305 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.292+0000 7fccca8f0700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 0x7fccc41902a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.292+0000 7fccca8f0700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc417c630 0x7fccc40c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.292+0000 7fccca8f0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417f980 0x7fccc41729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.292+0000 7fccca8f0700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c6df0 con 0x7fccc417c250 2023-11-06T13:41:48.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.292+0000 7fccca8f0700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c87c0 con 0x7fccc417c630 2023-11-06T13:41:48.306 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.292+0000 7fccca8f0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40c7bb0 con 0x7fccc417f980 2023-11-06T13:41:48.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 0x7fccc41902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 0x7fccc41902a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36686/0 (socket says 172.21.15.38:36686) 2023-11-06T13:41:48.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc417c630 0x7fccc40c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 -- 172.21.15.38:0/285561566 learned_addr learned my addr 172.21.15.38:0/285561566 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.307 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 -- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417f980 msgr2=0x7fccc41729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417f980 0x7fccc41729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 -- 172.21.15.38:0/285561566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc417c630 msgr2=0x7fccc40c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.308 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc417c630 0x7fccc40c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 -- 172.21.15.38:0/285561566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb40092a0 con 0x7fccc417c250 2023-11-06T13:41:48.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc37fe700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc417c630 0x7fccc40c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:48.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccc3fff700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 0x7fccc41902a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fccb40091b0 tx=0x7fccb4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.309 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccabfff700 1 -- 172.21.15.38:0/285561566 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400f890 con 0x7fccc417c250 2023-11-06T13:41:48.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccabfff700 1 -- 172.21.15.38:0/285561566 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb4006970 con 0x7fccc417c250 2023-11-06T13:41:48.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40c7e90 con 0x7fccc417c250 2023-11-06T13:41:48.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccabfff700 1 -- 172.21.15.38:0/285561566 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400fea0 con 0x7fccc417c250 2023-11-06T13:41:48.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.293+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc40c8450 con 0x7fccc417c250 2023-11-06T13:41:48.310 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.295+0000 7fccabfff700 1 -- 172.21.15.38:0/285561566 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fccb401b650 con 0x7fccc417c250 2023-11-06T13:41:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.296+0000 7fccabfff700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fccb008cb40 0x7fccb008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.296+0000 7fccabfff700 1 -- 172.21.15.38:0/285561566 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fccb40b3530 con 0x7fccc417c250 2023-11-06T13:41:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.296+0000 7fccc37fe700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fccb008cb40 0x7fccb008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.296+0000 7fccc37fe700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fccb008cb40 0x7fccb008f000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fccc4173fe0 tx=0x7fccb8009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.311 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.297+0000 7fccdc288b80 1 Processor -- start 2023-11-06T13:41:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.297+0000 7fccdc288b80 1 -- start start 2023-11-06T13:41:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.298+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 0x5608bfca5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfca5970 0x5608bfc61ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfc62190 0x5608bfca2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.312 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccdc288b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfc28050 con 0x5608bfca5970 2023-11-06T13:41:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccdc288b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfb9f2c0 con 0x5608bfa1ef10 2023-11-06T13:41:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccdc288b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfbb4510 con 0x5608bfc62190 2023-11-06T13:41:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfca5970 0x5608bfc61ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc8e8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfc62190 0x5608bfca2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.313 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 0x5608bfca5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 0x5608bfca5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42896/0 (socket says 172.21.15.38:42896) 2023-11-06T13:41:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfca5970 0x5608bfc61ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36694/0 (socket says 172.21.15.38:36694) 2023-11-06T13:41:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 -- 172.21.15.38:0/2496042577 learned_addr learned my addr 172.21.15.38:0/2496042577 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.314 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc8e8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfc62190 0x5608bfca2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36756/0 (socket says 172.21.15.38:36756) 2023-11-06T13:41:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 -- 172.21.15.38:0/2496042577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfc62190 msgr2=0x5608bfca2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfc62190 0x5608bfca2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 -- 172.21.15.38:0/2496042577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfca5970 msgr2=0x5608bfc61ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfca5970 0x5608bfc61ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 -- 172.21.15.38:0/2496042577 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608bfbad6f0 con 0x5608bfa1ef10 2023-11-06T13:41:48.315 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fccc3fff700 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 0x5608bfca5480 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fccb4087420 tx=0x7fccb4009f20).ready entity=mon.1 client_cookie=ad76f7e1053e8929 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fcca97fa700 1 -- 172.21.15.38:0/2496042577 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4083b40 con 0x5608bfa1ef10 2023-11-06T13:41:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fcca97fa700 1 -- 172.21.15.38:0/2496042577 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb40b3380 con 0x5608bfa1ef10 2023-11-06T13:41:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.299+0000 7fcca97fa700 1 -- 172.21.15.38:0/2496042577 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb408d0e0 con 0x5608bfa1ef10 2023-11-06T13:41:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 -- 172.21.15.38:0/2496042577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 msgr2=0x5608bfca5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.316 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 0x5608bfca5480 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fccb4087420 tx=0x7fccb4009f20).stop 2023-11-06T13:41:48.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 -- 172.21.15.38:0/2496042577 shutdown_connections 2023-11-06T13:41:48.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfc62190 0x5608bfca2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfa1ef10 0x5608bfca5480 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 --2- 172.21.15.38:0/2496042577 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfca5970 0x5608bfc61ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.317 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 -- 172.21.15.38:0/2496042577 >> 172.21.15.38:0/2496042577 conn(0x5608bfacc570 msgr2=0x5608bfc62dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 -- 172.21.15.38:0/2496042577 shutdown_connections 2023-11-06T13:41:48.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.300+0000 7fccdc288b80 1 -- 172.21.15.38:0/2496042577 wait complete. 2023-11-06T13:41:48.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.301+0000 7fccdc288b80 1 -- start start 2023-11-06T13:41:48.318 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.301+0000 7fccdc288b80 1 Processor -- start 2023-11-06T13:41:48.322 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfce4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc8e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfca32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfbb4650 con 0x5608bfc62190 2023-11-06T13:41:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfbb48d0 con 0x5608bfca5970 2023-11-06T13:41:48.323 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfb7fee0 con 0x5608bfa1ef10 2023-11-06T13:41:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccdc288b80 10 client.0 ll_register_callbacks cb 0x5608bfc22450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfce4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfce4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36764/0 (socket says 172.21.15.38:36764) 2023-11-06T13:41:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 -- 172.21.15.38:0/729693618 learned_addr learned my addr 172.21.15.38:0/729693618 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.324 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc37fe700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc8e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc8e8d700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfca32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 -- 172.21.15.38:0/729693618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 msgr2=0x5608bfca32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfca32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 -- 172.21.15.38:0/729693618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 msgr2=0x5608bfc8e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.325 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc8e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc3fff700 1 -- 172.21.15.38:0/729693618 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc40c8450 con 0x5608bfa1ef10 2023-11-06T13:41:48.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.302+0000 7fccc37fe700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc8e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:48.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccc3fff700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfce4d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fccb4009e00 tx=0x7fccb4058000).ready entity=mon.2 client_cookie=1563fd32d978a156 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.326 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fcca27fc700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:41:48.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fcca27fc700 1 -- 172.21.15.38:0/729693618 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4083f10 con 0x5608bfa1ef10 2023-11-06T13:41:48.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fcca27fc700 1 -- 172.21.15.38:0/729693618 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fccb4084070 con 0x5608bfa1ef10 2023-11-06T13:41:48.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5608bfc56710 con 0x5608bfa1ef10 2023-11-06T13:41:48.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fcca27fc700 1 -- 172.21.15.38:0/729693618 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb4086f00 con 0x5608bfa1ef10 2023-11-06T13:41:48.327 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 10 client.5636 fetch_fsmap learned FSMap version 49 2023-11-06T13:41:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5608bfba8a90 con 0x5608bfa1ef10 2023-11-06T13:41:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fcca27fc700 1 -- 172.21.15.38:0/729693618 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5608bfc56710 con 0x5608bfa1ef10 2023-11-06T13:41:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fcca27fc700 1 -- 172.21.15.38:0/729693618 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 49) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fccb408cc50 con 0x5608bfa1ef10 2023-11-06T13:41:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 10 client.5636 fetch_fsmap finished waiting for FSMap version 49 2023-11-06T13:41:48.328 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 10 client.5636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 20 client.5636 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5d530 0x5608bfc5dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 4 client.5636 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:41:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608bfa1ad70 con 0x5608bfc5d530 2023-11-06T13:41:48.329 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.303+0000 7fccc37fe700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5d530 0x5608bfc5dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.304+0000 7fcca27fc700 10 client.5636 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.304+0000 7fccc37fe700 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5d530 0x5608bfc5dd00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cccb78bc519cbe8c server_cookie=e83a4458f1d50d12 in_seq=0 out_seq=0 2023-11-06T13:41:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.304+0000 7fcca27fc700 1 -- 172.21.15.38:0/729693618 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5608bfa1ad70 con 0x5608bfc5d530 2023-11-06T13:41:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.304+0000 7fcca27fc700 10 client.5636 handle_command_reply: tid=0 2023-11-06T13:41:48.330 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.304+0000 7fccdc288b80 1 client.5636 shutdown 2023-11-06T13:41:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 msgr2=0x5608bfce4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfce4d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fccb4009e00 tx=0x7fccb4058000).stop 2023-11-06T13:41:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 shutdown_connections 2023-11-06T13:41:48.331 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfca32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5d530 0x5608bfc5dd00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfce4d00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 --2- 172.21.15.38:0/729693618 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc8e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fcca27fc700 0 client.5636 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.332 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 >> 172.21.15.38:0/729693618 conn(0x5608bfacc570 msgr2=0x5608bfcd1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 shutdown_connections 2023-11-06T13:41:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 1 -- 172.21.15.38:0/729693618 wait complete. 2023-11-06T13:41:48.333 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.305+0000 7fccdc288b80 20 client.5636 trim_cache size 0 max 16384 2023-11-06T13:41:48.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.321+0000 7fccdc288b80 1 Processor -- start 2023-11-06T13:41:48.339 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.321+0000 7fccdc288b80 1 -- start start 2023-11-06T13:41:48.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc5ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfc5dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.340 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccdc288b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfc989e0 con 0x5608bfc62190 2023-11-06T13:41:48.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccdc288b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfc5a170 con 0x5608bfca5970 2023-11-06T13:41:48.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccdc288b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfc5e1f0 con 0x5608bfa1ef10 2023-11-06T13:41:48.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc5ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc5ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36700/0 (socket says 172.21.15.38:36700) 2023-11-06T13:41:48.341 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 -- 172.21.15.38:0/93012336 learned_addr learned my addr 172.21.15.38:0/93012336 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc3fff700 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc8e8d700 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfc5dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 -- 172.21.15.38:0/93012336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 msgr2=0x5608bfc952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc952a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.342 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 -- 172.21.15.38:0/93012336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 msgr2=0x5608bfc5dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfc5dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 -- 172.21.15.38:0/93012336 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608bfc56330 con 0x5608bfc62190 2023-11-06T13:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc8e8d700 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfc5dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fccc37fe700 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc5ec70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fccc4192300 tx=0x7fccb8016040).ready entity=mon.0 client_cookie=af2b98257177ec36 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.343 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fcca9ffb700 1 -- 172.21.15.38:0/93012336 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8024020 con 0x5608bfc62190 2023-11-06T13:41:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fcca9ffb700 1 -- 172.21.15.38:0/93012336 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb8024180 con 0x5608bfc62190 2023-11-06T13:41:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.323+0000 7fcca9ffb700 1 -- 172.21.15.38:0/93012336 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8024d20 con 0x5608bfc62190 2023-11-06T13:41:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 -- 172.21.15.38:0/93012336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 msgr2=0x5608bfc5ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc5ec70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fccc4192300 tx=0x7fccb8016040).stop 2023-11-06T13:41:48.344 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 -- 172.21.15.38:0/93012336 shutdown_connections 2023-11-06T13:41:48.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfc5dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 --2- 172.21.15.38:0/93012336 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfc5ec70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 -- 172.21.15.38:0/93012336 >> 172.21.15.38:0/93012336 conn(0x5608bfacc570 msgr2=0x5608bfca3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.345 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 -- 172.21.15.38:0/93012336 shutdown_connections 2023-11-06T13:41:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.324+0000 7fccdc288b80 1 -- 172.21.15.38:0/93012336 wait complete. 2023-11-06T13:41:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.325+0000 7fccdc288b80 1 -- start start 2023-11-06T13:41:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.325+0000 7fccdc288b80 1 Processor -- start 2023-11-06T13:41:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.346 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfd23dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfd236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfce4750 con 0x5608bfc62190 2023-11-06T13:41:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfd242b0 con 0x5608bfca5970 2023-11-06T13:41:48.347 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608bfd23ba0 con 0x5608bfa1ef10 2023-11-06T13:41:48.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccdc288b80 10 client.0 ll_register_callbacks cb 0x5608bfc22450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:48.348 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfd23dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc8e8d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfd236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.349 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36784/0 (socket says 172.21.15.38:36784) 2023-11-06T13:41:48.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 -- 172.21.15.38:0/715898209 learned_addr learned my addr 172.21.15.38:0/715898209 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc37fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfd23dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36702/0 (socket says 172.21.15.38:36702) 2023-11-06T13:41:48.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 -- 172.21.15.38:0/715898209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 msgr2=0x5608bfd236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.350 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfd236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 -- 172.21.15.38:0/715898209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 msgr2=0x5608bfd23dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfd23dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 -- 172.21.15.38:0/715898209 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb8024470 con 0x5608bfa1ef10 2023-11-06T13:41:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc37fe700 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfd23dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:41:48.351 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fccc3fff700 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc607c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fccb4009e00 tx=0x7fccb4090000).ready entity=mon.2 client_cookie=68120aced0c07e2f server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.326+0000 7fcca27fc700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-11-06T13:41:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fcca27fc700 1 -- 172.21.15.38:0/715898209 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb4083b40 con 0x5608bfa1ef10 2023-11-06T13:41:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fcca27fc700 1 -- 172.21.15.38:0/715898209 <== mon.2 v2:172.21.15.163:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fccb4085940 con 0x5608bfa1ef10 2023-11-06T13:41:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccb40b3380 con 0x5608bfa1ef10 2023-11-06T13:41:48.352 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fcca27fc700 1 -- 172.21.15.38:0/715898209 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb4083f10 con 0x5608bfa1ef10 2023-11-06T13:41:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 10 client.5642 fetch_fsmap learned FSMap version 49 2023-11-06T13:41:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5608bfba87e0 con 0x5608bfa1ef10 2023-11-06T13:41:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fcca27fc700 1 -- 172.21.15.38:0/715898209 <== mon.2 v2:172.21.15.163:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb40ac020 con 0x5608bfa1ef10 2023-11-06T13:41:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fcca27fc700 1 -- 172.21.15.38:0/715898209 <== mon.2 v2:172.21.15.163:3300/0 5 ==== fsmap(e 49) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fccb4018030 con 0x5608bfa1ef10 2023-11-06T13:41:48.353 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 10 client.5642 fetch_fsmap finished waiting for FSMap version 49 2023-11-06T13:41:48.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 10 client.5642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:48.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 20 client.5642 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:48.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5cac0 0x5608bfd2e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 4 client.5642 mds_command: new command op to 4361 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-11-06T13:41:48.354 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5608bfa51d70 con 0x5608bfc5cac0 2023-11-06T13:41:48.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.327+0000 7fccc37fe700 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5cac0 0x5608bfd2e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.328+0000 7fcca27fc700 10 client.5642 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.328+0000 7fccc37fe700 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5cac0 0x5608bfd2e670 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=baf62222fea09415 server_cookie=dadb6b590b5f03b5 in_seq=0 out_seq=0 2023-11-06T13:41:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fcca27fc700 1 -- 172.21.15.38:0/715898209 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5608bfa51d70 con 0x5608bfc5cac0 2023-11-06T13:41:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fcca27fc700 10 client.5642 handle_command_reply: tid=0 2023-11-06T13:41:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 client.5642 shutdown 2023-11-06T13:41:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 msgr2=0x5608bfc607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.356 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc607c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fccb4009e00 tx=0x7fccb4090000).stop 2023-11-06T13:41:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 shutdown_connections 2023-11-06T13:41:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5608bfca5970 0x5608bfd236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5608bfc5cac0 0x5608bfd2e670 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5608bfa1ef10 0x5608bfc607c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.357 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 --2- 172.21.15.38:0/715898209 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5608bfc62190 0x5608bfd23dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fcca27fc700 0 client.5642 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 >> 172.21.15.38:0/715898209 conn(0x5608bfacc570 msgr2=0x5608bfc61a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 shutdown_connections 2023-11-06T13:41:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.329+0000 7fccdc288b80 1 -- 172.21.15.38:0/715898209 wait complete. 2023-11-06T13:41:48.358 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccdc288b80 20 client.5642 trim_cache size 0 max 16384 2023-11-06T13:41:48.360 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:41:48.360 INFO:teuthology.orchestra.run.smithi038.stdout: "return_code": 0, 2023-11-06T13:41:48.360 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_tag": "c6cb557f-583b-461f-bb09-29cd75208e83", 2023-11-06T13:41:48.360 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": "asynchronous" 2023-11-06T13:41:48.361 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:41:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fccb008cb40 msgr2=0x7fccb008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fccb008cb40 0x7fccb008f000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fccc4173fe0 tx=0x7fccb8009040).stop 2023-11-06T13:41:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 msgr2=0x7fccc41902a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 0x7fccc41902a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fccb40091b0 tx=0x7fccb4017000).stop 2023-11-06T13:41:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 shutdown_connections 2023-11-06T13:41:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccc417f980 0x7fccc41729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fccc417c250 0x7fccc41902a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fccb008cb40 0x7fccb008f000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 --2- 172.21.15.38:0/285561566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fccc417c630 0x7fccc40c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 >> 172.21.15.38:0/285561566 conn(0x7fccc405e1b0 msgr2=0x7fccc40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 shutdown_connections 2023-11-06T13:41:48.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.330+0000 7fccca8f0700 1 -- 172.21.15.38:0/285561566 wait complete. 2023-11-06T13:41:48.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:41:48.515 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.512+0000 7fdff2738700 1 Processor -- start 2023-11-06T13:41:48.516 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.512+0000 7fdff2738700 1 -- start start 2023-11-06T13:41:48.517 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdff2738700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdfec172130 0x7fdfec172510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdff2738700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdfec17dc80 0x7fdfec17e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdff2738700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec17fe00 con 0x7fdfec17e600 2023-11-06T13:41:48.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdff2738700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec0c9510 con 0x7fdfec172130 2023-11-06T13:41:48.518 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdff2738700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec0c9230 con 0x7fdfec17dc80 2023-11-06T13:41:48.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdfeb7fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdfec17dc80 0x7fdfec17e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdfeb7fe700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fdfec17dc80 0x7fdfec17e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.38:36800/0 (socket says 172.21.15.38:36800) 2023-11-06T13:41:48.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/563084644 learned_addr learned my addr 172.21.15.38:0/563084644 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.513+0000 7fdfebfff700 1 --2- 172.21.15.38:0/563084644 >> v2:172.21.15.44:3300/0 conn(0x7fdfec172130 0x7fdfec172510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.519 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/563084644 >> v2:172.21.15.44:3300/0 conn(0x7fdfec172130 msgr2=0x7fdfec172510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/563084644 >> v2:172.21.15.44:3300/0 conn(0x7fdfec172130 0x7fdfec172510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/563084644 >> v1:172.21.15.44:6789/0 conn(0x7fdfec17e600 legacy=0x7fdfec083bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/563084644 --> v2:172.21.15.163:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec17cec0 con 0x7fdfec17dc80 2023-11-06T13:41:48.520 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/563084644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17dc80 0x7fdfec17e110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fdfec17caf0 tx=0x7fdfe00090f0).ready entity=mon.2 client_cookie=2b36c635054319f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeaffd700 1 -- 172.21.15.38:0/563084644 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000b520 con 0x7fdfec17dc80 2023-11-06T13:41:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeaffd700 1 -- 172.21.15.38:0/563084644 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000b680 con 0x7fdfec17dc80 2023-11-06T13:41:48.521 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.514+0000 7fdfeaffd700 1 -- 172.21.15.38:0/563084644 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000ba00 con 0x7fdfec17dc80 2023-11-06T13:41:48.523 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 -- 172.21.15.38:0/563084644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17dc80 msgr2=0x7fdfec17e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 --2- 172.21.15.38:0/563084644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17dc80 0x7fdfec17e110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fdfec17caf0 tx=0x7fdfe00090f0).stop 2023-11-06T13:41:48.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 -- 172.21.15.38:0/563084644 shutdown_connections 2023-11-06T13:41:48.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 --2- 172.21.15.38:0/563084644 >> v2:172.21.15.44:3300/0 conn(0x7fdfec172130 0x7fdfec172510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.524 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 --2- 172.21.15.38:0/563084644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17dc80 0x7fdfec17e110 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 -- 172.21.15.38:0/563084644 >> 172.21.15.38:0/563084644 conn(0x7fdfec0f2090 msgr2=0x7fdfec0f24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 -- 172.21.15.38:0/563084644 shutdown_connections 2023-11-06T13:41:48.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.515+0000 7fdff2738700 1 -- 172.21.15.38:0/563084644 wait complete. 2023-11-06T13:41:48.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.516+0000 7fdff2738700 1 Processor -- start 2023-11-06T13:41:48.525 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.516+0000 7fdff2738700 1 -- start start 2023-11-06T13:41:48.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff2738700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 0x7fdfec1612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff2738700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec17dc80 0x7fdfec0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff2738700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17e600 0x7fdfec0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff2738700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec084750 con 0x7fdfec172130 2023-11-06T13:41:48.526 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff2738700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec18fe10 con 0x7fdfec17dc80 2023-11-06T13:41:48.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff2738700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0c4540 con 0x7fdfec17e600 2023-11-06T13:41:48.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 0x7fdfec1612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 0x7fdfec1612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36716/0 (socket says 172.21.15.38:36716) 2023-11-06T13:41:48.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 -- 172.21.15.38:0/2355983405 learned_addr learned my addr 172.21.15.38:0/2355983405 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.527 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17e600 0x7fdfec0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec17dc80 0x7fdfec0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 -- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17e600 msgr2=0x7fdfec0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17e600 0x7fdfec0c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 -- 172.21.15.38:0/2355983405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec17dc80 msgr2=0x7fdfec0c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.528 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec17dc80 0x7fdfec0c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 -- 172.21.15.38:0/2355983405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0009370 con 0x7fdfec172130 2023-11-06T13:41:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.518+0000 7fdfebfff700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 0x7fdfec1612f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fdfdc00e900 tx=0x7fdfdc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.519+0000 7fdfd3fff700 1 -- 172.21.15.38:0/2355983405 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc012600 con 0x7fdfec172130 2023-11-06T13:41:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.519+0000 7fdfd3fff700 1 -- 172.21.15.38:0/2355983405 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc012760 con 0x7fdfec172130 2023-11-06T13:41:48.529 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.519+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec0c4820 con 0x7fdfec172130 2023-11-06T13:41:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.519+0000 7fdfd3fff700 1 -- 172.21.15.38:0/2355983405 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc012ae0 con 0x7fdfec172130 2023-11-06T13:41:48.530 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.519+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec0c4de0 con 0x7fdfec172130 2023-11-06T13:41:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.521+0000 7fdfd3fff700 1 -- 172.21.15.38:0/2355983405 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fdfdc01b400 con 0x7fdfec172130 2023-11-06T13:41:48.532 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.522+0000 7fdfd3fff700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdfd808cb40 0x7fdfd808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.522+0000 7fdfd3fff700 1 -- 172.21.15.38:0/2355983405 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdfdc0b2340 con 0x7fdfec172130 2023-11-06T13:41:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.523+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdfd808cb40 0x7fdfd808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.524+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdfd808cb40 0x7fdfd808f000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fdfe0009130 tx=0x7fdfe0017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.533 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.524+0000 7fe0040d0b80 1 Processor -- start 2023-11-06T13:41:48.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.524+0000 7fe0040d0b80 1 -- start start 2023-11-06T13:41:48.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.526+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d4b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.526+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d07c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.526+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d48c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.534 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.526+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3ccdfd0 con 0x5557c3d4b8f0 2023-11-06T13:41:48.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.526+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3c45240 con 0x5557c3ac4e90 2023-11-06T13:41:48.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.526+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3c5a490 con 0x5557c3d08110 2023-11-06T13:41:48.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d07c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d07c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36718/0 (socket says 172.21.15.38:36718) 2023-11-06T13:41:48.535 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/1961514273 learned_addr learned my addr 172.21.15.38:0/1961514273 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d48c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/1961514273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 msgr2=0x5557c3d48c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d48c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/1961514273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 msgr2=0x5557c3d4b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:41:48.536 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d4b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/1961514273 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557c3c53670 con 0x5557c3d4b8f0 2023-11-06T13:41:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d07c20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fdfec0c9370 tx=0x7fdfe001f070).ready entity=mon.0 client_cookie=178ec2255c9da928 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.527+0000 7fdfd17fa700 1 -- 172.21.15.38:0/1961514273 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001d890 con 0x5557c3d4b8f0 2023-11-06T13:41:48.537 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.528+0000 7fdfd17fa700 1 -- 172.21.15.38:0/1961514273 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe001d9f0 con 0x5557c3d4b8f0 2023-11-06T13:41:48.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.528+0000 7fdfd17fa700 1 -- 172.21.15.38:0/1961514273 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001dd70 con 0x5557c3d4b8f0 2023-11-06T13:41:48.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.528+0000 7fe0040d0b80 1 -- 172.21.15.38:0/1961514273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 msgr2=0x5557c3d07c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.528+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d07c20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fdfec0c9370 tx=0x7fdfe001f070).stop 2023-11-06T13:41:48.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.529+0000 7fe0040d0b80 1 -- 172.21.15.38:0/1961514273 shutdown_connections 2023-11-06T13:41:48.538 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.529+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d48c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.529+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d4b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.529+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/1961514273 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d07c20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.539 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.529+0000 7fe0040d0b80 1 -- 172.21.15.38:0/1961514273 >> 172.21.15.38:0/1961514273 conn(0x5557c3b724f0 msgr2=0x5557c3d08d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.530+0000 7fe0040d0b80 1 -- 172.21.15.38:0/1961514273 shutdown_connections 2023-11-06T13:41:48.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.530+0000 7fe0040d0b80 1 -- 172.21.15.38:0/1961514273 wait complete. 2023-11-06T13:41:48.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.531+0000 7fe0040d0b80 1 -- start start 2023-11-06T13:41:48.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.531+0000 7fe0040d0b80 1 Processor -- start 2023-11-06T13:41:48.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d43d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d40e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d92c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3c5a5d0 con 0x5557c3d4b8f0 2023-11-06T13:41:48.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3c5a850 con 0x5557c3ac4e90 2023-11-06T13:41:48.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3c25e60 con 0x5557c3d08110 2023-11-06T13:41:48.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fe0040d0b80 10 client.0 ll_register_callbacks cb 0x5557c3cc83d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:48.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d92c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.545 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d92c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36726/0 (socket says 172.21.15.38:36726) 2023-11-06T13:41:48.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdfebfff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d43d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 -- 172.21.15.38:0/896471733 learned_addr learned my addr 172.21.15.38:0/896471733 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 -- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 msgr2=0x5557c3d40e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d40e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 -- 172.21.15.38:0/896471733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 msgr2=0x5557c3d43d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d43d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.532+0000 7fdff0cd5700 1 -- 172.21.15.38:0/896471733 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec17cec0 con 0x5557c3d4b8f0 2023-11-06T13:41:48.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d92c00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fdfe4011860 tx=0x7fdfe4001530).ready entity=mon.0 client_cookie=fcd4e3e4062b6162 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdfca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:48.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdfca7fc700 1 -- 172.21.15.38:0/896471733 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4019070 con 0x5557c3d4b8f0 2023-11-06T13:41:48.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdfca7fc700 1 -- 172.21.15.38:0/896471733 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdfe4013610 con 0x5557c3d4b8f0 2023-11-06T13:41:48.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557c3cfc690 con 0x5557c3d4b8f0 2023-11-06T13:41:48.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdfca7fc700 1 -- 172.21.15.38:0/896471733 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe40028a0 con 0x5557c3d4b8f0 2023-11-06T13:41:48.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fe0040d0b80 10 client.5772 fetch_fsmap learned FSMap version 49 2023-11-06T13:41:48.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5557c3c4ea10 con 0x5557c3d4b8f0 2023-11-06T13:41:48.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdfca7fc700 1 -- 172.21.15.38:0/896471733 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5557c3cfc690 con 0x5557c3d4b8f0 2023-11-06T13:41:48.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.533+0000 7fdfca7fc700 1 -- 172.21.15.38:0/896471733 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 49) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fdfe401c020 con 0x5557c3d4b8f0 2023-11-06T13:41:48.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fe0040d0b80 10 client.5772 fetch_fsmap finished waiting for FSMap version 49 2023-11-06T13:41:48.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fe0040d0b80 10 client.5772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:48.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fe0040d0b80 20 client.5772 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:48.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d0f5e0 0x5557c3d0f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fe0040d0b80 4 client.5772 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:41:48.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557c3ac0cf0 con 0x5557c3d0f5e0 2023-11-06T13:41:48.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fdfebfff700 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d0f5e0 0x5557c3d0f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.550 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fdfebfff700 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d0f5e0 0x5557c3d0f9f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2cfa2ee98653bd6e server_cookie=36c44a8846e2206f in_seq=0 out_seq=0 2023-11-06T13:41:48.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.534+0000 7fdfca7fc700 10 client.5772 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fdfca7fc700 1 -- 172.21.15.38:0/896471733 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5557c3ac0cf0 con 0x5557c3d0f5e0 2023-11-06T13:41:48.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fdfca7fc700 10 client.5772 handle_command_reply: tid=0 2023-11-06T13:41:48.551 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 client.5772 shutdown 2023-11-06T13:41:48.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 msgr2=0x5557c3d92c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d92c00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fdfe4011860 tx=0x7fdfe4001530).stop 2023-11-06T13:41:48.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 shutdown_connections 2023-11-06T13:41:48.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3d92c00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.552 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3ac4e90 0x5557c3d43d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d0f5e0 0x5557c3d0f9f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/896471733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3d08110 0x5557c3d40e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 >> 172.21.15.38:0/896471733 conn(0x5557c3b724f0 msgr2=0x5557c3d4bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fdfca7fc700 0 client.5772 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.553 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 shutdown_connections 2023-11-06T13:41:48.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 1 -- 172.21.15.38:0/896471733 wait complete. 2023-11-06T13:41:48.554 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.535+0000 7fe0040d0b80 20 client.5772 trim_cache size 0 max 16384 2023-11-06T13:41:48.563 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.559+0000 7fe0040d0b80 1 Processor -- start 2023-11-06T13:41:48.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.559+0000 7fe0040d0b80 1 -- start start 2023-11-06T13:41:48.565 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 0x5557c3d04a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3ddacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3d35500 con 0x5557c3d4b8f0 2023-11-06T13:41:48.566 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3d43240 con 0x5557c3d08110 2023-11-06T13:41:48.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3d087c0 con 0x5557c3ac4e90 2023-11-06T13:41:48.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dda800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:42958/0 (socket says 172.21.15.38:42958) 2023-11-06T13:41:48.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.561+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/2380763733 learned_addr learned my addr 172.21.15.38:0/2380763733 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.567 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/2380763733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 msgr2=0x5557c3d04a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 0x5557c3d04a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/2380763733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 msgr2=0x5557c3ddacf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-06T13:41:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3ddacf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfeb7fe700 1 -- 172.21.15.38:0/2380763733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557c3cfc2b0 con 0x5557c3d08110 2023-11-06T13:41:48.568 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfeb7fe700 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dda800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fdfe000b1a0 tx=0x7fdfe0028000).ready entity=mon.1 client_cookie=2cf6668795b1ab16 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.562+0000 7fdfd1ffb700 1 -- 172.21.15.38:0/2380763733 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0035070 con 0x5557c3d08110 2023-11-06T13:41:48.570 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fdfd1ffb700 1 -- 172.21.15.38:0/2380763733 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000b2e0 con 0x5557c3d08110 2023-11-06T13:41:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fdfd1ffb700 1 -- 172.21.15.38:0/2380763733 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001db60 con 0x5557c3d08110 2023-11-06T13:41:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 -- 172.21.15.38:0/2380763733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 msgr2=0x5557c3dda800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dda800 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fdfe000b1a0 tx=0x7fdfe0028000).stop 2023-11-06T13:41:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 -- 172.21.15.38:0/2380763733 shutdown_connections 2023-11-06T13:41:48.571 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3ddacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 0x5557c3d04a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/2380763733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dda800 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 -- 172.21.15.38:0/2380763733 >> 172.21.15.38:0/2380763733 conn(0x5557c3b724f0 msgr2=0x5557c3d03390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 -- 172.21.15.38:0/2380763733 shutdown_connections 2023-11-06T13:41:48.572 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.563+0000 7fe0040d0b80 1 -- 172.21.15.38:0/2380763733 wait complete. 2023-11-06T13:41:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.564+0000 7fe0040d0b80 1 -- start start 2023-11-06T13:41:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.565+0000 7fe0040d0b80 1 Processor -- start 2023-11-06T13:41:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 0x5557c3d3f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dcf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.573 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3dd9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3dda390 con 0x5557c3d4b8f0 2023-11-06T13:41:48.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3dcfde0 con 0x5557c3d08110 2023-11-06T13:41:48.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c3dd2710 con 0x5557c3ac4e90 2023-11-06T13:41:48.574 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.566+0000 7fe0040d0b80 10 client.0 ll_register_callbacks cb 0x5557c3cc83d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:41:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3dd9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3dd9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:36730/0 (socket says 172.21.15.38:36730) 2023-11-06T13:41:48.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 -- 172.21.15.38:0/4220321946 learned_addr learned my addr 172.21.15.38:0/4220321946 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 -- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 msgr2=0x5557c3d3f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 0x5557c3d3f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 -- 172.21.15.38:0/4220321946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 msgr2=0x5557c3dcf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:48.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dcf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 -- 172.21.15.38:0/4220321946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557c3c53670 con 0x5557c3d4b8f0 2023-11-06T13:41:48.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.567+0000 7fdff0cd5700 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3dd9a50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fdfe40011f0 tx=0x7fdfe4004020).ready entity=mon.0 client_cookie=f387916dc49f1fbc server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:48.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fdfca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:41:48.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fdfca7fc700 1 -- 172.21.15.38:0/4220321946 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4019040 con 0x5557c3d4b8f0 2023-11-06T13:41:48.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fdfca7fc700 1 -- 172.21.15.38:0/4220321946 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fdfe4013610 con 0x5557c3d4b8f0 2023-11-06T13:41:48.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdfe001d9f0 con 0x5557c3d4b8f0 2023-11-06T13:41:48.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fdfca7fc700 1 -- 172.21.15.38:0/4220321946 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe4013c10 con 0x5557c3d4b8f0 2023-11-06T13:41:48.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 10 client.5775 fetch_fsmap learned FSMap version 49 2023-11-06T13:41:48.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5557c3c4e760 con 0x5557c3d4b8f0 2023-11-06T13:41:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fdfca7fc700 1 -- 172.21.15.38:0/4220321946 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4033020 con 0x5557c3d4b8f0 2023-11-06T13:41:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fdfca7fc700 1 -- 172.21.15.38:0/4220321946 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 49) v1 ==== 7528+0+0 (secure 0 0 0) 0x7fdfe401c070 con 0x5557c3d4b8f0 2023-11-06T13:41:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 10 client.5775 fetch_fsmap finished waiting for FSMap version 49 2023-11-06T13:41:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 10 client.5775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:41:48.581 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 20 client.5775 populate_metadata read hostname 'smithi038' 2023-11-06T13:41:48.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d48650 0x5557c3dcaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:48.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.568+0000 7fe0040d0b80 4 client.5775 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:41:48.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.569+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5557c3af7cf0 con 0x5557c3d48650 2023-11-06T13:41:48.582 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.570+0000 7fdfebfff700 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d48650 0x5557c3dcaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.571+0000 7fdfca7fc700 10 client.5775 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.571+0000 7fdfebfff700 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d48650 0x5557c3dcaab0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d335005bac845615 server_cookie=887531906a3f9cc9 in_seq=0 out_seq=0 2023-11-06T13:41:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fdfca7fc700 1 -- 172.21.15.38:0/4220321946 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5557c3af7cf0 con 0x5557c3d48650 2023-11-06T13:41:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fdfca7fc700 10 client.5775 handle_command_reply: tid=0 2023-11-06T13:41:48.583 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 client.5775 shutdown 2023-11-06T13:41:48.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 msgr2=0x5557c3dd9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3dd9a50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fdfe40011f0 tx=0x7fdfe4004020).stop 2023-11-06T13:41:48.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 shutdown_connections 2023-11-06T13:41:48.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x5557c3d4b8f0 0x5557c3dd9a50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.584 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x5557c3d48650 0x5557c3dcaab0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5557c3ac4e90 0x5557c3d3f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 --2- 172.21.15.38:0/4220321946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557c3d08110 0x5557c3dcf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fdfca7fc700 0 client.5775 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:41:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 >> 172.21.15.38:0/4220321946 conn(0x5557c3b724f0 msgr2=0x5557c3d436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.585 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 shutdown_connections 2023-11-06T13:41:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 1 -- 172.21.15.38:0/4220321946 wait complete. 2023-11-06T13:41:48.586 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.572+0000 7fe0040d0b80 20 client.5775 trim_cache size 0 max 16384 2023-11-06T13:41:48.586 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:41:48.587 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-06T13:41:48.587 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": { 2023-11-06T13:41:48.587 INFO:teuthology.orchestra.run.smithi038.stdout: "c6cb557f-583b-461f-bb09-29cd75208e83": { 2023-11-06T13:41:48.587 INFO:teuthology.orchestra.run.smithi038.stdout: "path": "/", 2023-11-06T13:41:48.587 INFO:teuthology.orchestra.run.smithi038.stdout: "tag": "c6cb557f-583b-461f-bb09-29cd75208e83", 2023-11-06T13:41:48.588 INFO:teuthology.orchestra.run.smithi038.stdout: "options": "recursive,force" 2023-11-06T13:41:48.588 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:41:48.588 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:41:48.588 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:41:48.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdfd808cb40 msgr2=0x7fdfd808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.589 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdfd808cb40 0x7fdfd808f000 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fdfe0009130 tx=0x7fdfe0017000).stop 2023-11-06T13:41:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 msgr2=0x7fdfec1612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 0x7fdfec1612f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fdfdc00e900 tx=0x7fdfdc009060).stop 2023-11-06T13:41:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 shutdown_connections 2023-11-06T13:41:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfec17e600 0x7fdfec0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.590 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fdfec172130 0x7fdfec1612f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fdfd808cb40 0x7fdfd808f000 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 --2- 172.21.15.38:0/2355983405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdfec17dc80 0x7fdfec0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 >> 172.21.15.38:0/2355983405 conn(0x7fdfec0f2090 msgr2=0x7fdfec17a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 shutdown_connections 2023-11-06T13:41:48.591 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:48.573+0000 7fdff2738700 1 -- 172.21.15.38:0/2355983405 wait complete. 2023-11-06T13:41:48.593 INFO:tasks.cephfs.filesystem:scrub status for tag:c6cb557f-583b-461f-bb09-29cd75208e83 - {'path': '/', 'tag': 'c6cb557f-583b-461f-bb09-29cd75208e83', 'options': 'recursive,force'} 2023-11-06T13:41:59.195 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2023-11-06T13:41:59.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-06T13:41:59.481 DEBUG:teuthology.parallel:result is None 2023-11-06T13:41:59.481 DEBUG:teuthology.orchestra.run.smithi038:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-11-06T13:41:59.534 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-11-06T13:41:59.534 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-11-06T13:41:59.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-06T13:41:59.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.731+0000 7fca22c9b700 1 Processor -- start 2023-11-06T13:41:59.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.731+0000 7fca22c9b700 1 -- start start 2023-11-06T13:41:59.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca22c9b700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca1c171860 0x7fca1c17d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca22c9b700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fca1c171c40 0x7fca1c17d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca22c9b700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7fca1c17dce0 0x7fca1c0ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca22c9b700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c17ce70 con 0x7fca1c171860 2023-11-06T13:41:59.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca22c9b700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c0c2e40 con 0x7fca1c171c40 2023-11-06T13:41:59.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca22c9b700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c17c580 con 0x7fca1c17dce0 2023-11-06T13:41:59.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca21c99700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca1c171860 0x7fca1c17d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:59.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca21c99700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fca1c171860 0x7fca1c17d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53318/0 (socket says 172.21.15.38:53318) 2023-11-06T13:41:59.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca21c99700 1 -- 172.21.15.38:0/1653626707 learned_addr learned my addr 172.21.15.38:0/1653626707 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:59.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.733+0000 7fca2249a700 1 --2- 172.21.15.38:0/1653626707 >> v2:172.21.15.163:3300/0 conn(0x7fca1c17dce0 0x7fca1c0ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:59.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca21c99700 1 -- 172.21.15.38:0/1653626707 >> v2:172.21.15.163:3300/0 conn(0x7fca1c17dce0 msgr2=0x7fca1c0ebfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:59.739 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca21c99700 1 --2- 172.21.15.38:0/1653626707 >> v2:172.21.15.163:3300/0 conn(0x7fca1c17dce0 0x7fca1c0ebfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca21c99700 1 -- 172.21.15.38:0/1653626707 >> v2:172.21.15.44:3300/0 conn(0x7fca1c171c40 msgr2=0x7fca1c17d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:41:59.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca21c99700 1 --2- 172.21.15.38:0/1653626707 >> v2:172.21.15.44:3300/0 conn(0x7fca1c171c40 0x7fca1c17d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:59.740 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca21c99700 1 -- 172.21.15.38:0/1653626707 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c0c2b60 con 0x7fca1c171860 2023-11-06T13:41:59.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca21c99700 1 --2- 172.21.15.38:0/1653626707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c17d300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fca1c064b20 tx=0x7fca18009060).ready entity=mon.0 client_cookie=8180c07951b7de5b server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:59.741 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca20c97700 1 -- 172.21.15.38:0/1653626707 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800f2c0 con 0x7fca1c171860 2023-11-06T13:41:59.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca20c97700 1 -- 172.21.15.38:0/1653626707 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca18013a90 con 0x7fca1c171860 2023-11-06T13:41:59.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.734+0000 7fca20c97700 1 -- 172.21.15.38:0/1653626707 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18013e10 con 0x7fca1c171860 2023-11-06T13:41:59.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.735+0000 7fca22c9b700 1 -- 172.21.15.38:0/1653626707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 msgr2=0x7fca1c17d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:59.742 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.735+0000 7fca22c9b700 1 --2- 172.21.15.38:0/1653626707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c17d300 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fca1c064b20 tx=0x7fca18009060).stop 2023-11-06T13:41:59.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.736+0000 7fca22c9b700 1 -- 172.21.15.38:0/1653626707 shutdown_connections 2023-11-06T13:41:59.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.736+0000 7fca22c9b700 1 --2- 172.21.15.38:0/1653626707 >> v2:172.21.15.163:3300/0 conn(0x7fca1c17dce0 0x7fca1c0ebfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.736+0000 7fca22c9b700 1 --2- 172.21.15.38:0/1653626707 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c17d300 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.743 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.736+0000 7fca22c9b700 1 --2- 172.21.15.38:0/1653626707 >> v2:172.21.15.44:3300/0 conn(0x7fca1c171c40 0x7fca1c17d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:59.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.736+0000 7fca22c9b700 1 -- 172.21.15.38:0/1653626707 >> 172.21.15.38:0/1653626707 conn(0x7fca1c0ed830 msgr2=0x7fca1c0edc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:59.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.737+0000 7fca22c9b700 1 -- 172.21.15.38:0/1653626707 shutdown_connections 2023-11-06T13:41:59.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.737+0000 7fca22c9b700 1 -- 172.21.15.38:0/1653626707 wait complete. 2023-11-06T13:41:59.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.738+0000 7fca22c9b700 1 Processor -- start 2023-11-06T13:41:59.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.738+0000 7fca22c9b700 1 -- start start 2023-11-06T13:41:59.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca22c9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c168e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca22c9b700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca1c171c40 0x7fca1c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca22c9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1c17dce0 0x7fca1c15e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca22c9b700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0eb6b0 con 0x7fca1c171860 2023-11-06T13:41:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca22c9b700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c169780 con 0x7fca1c171c40 2023-11-06T13:41:59.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca22c9b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c169a60 con 0x7fca1c17dce0 2023-11-06T13:41:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca21c99700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca21c99700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c168e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53324/0 (socket says 172.21.15.38:53324) 2023-11-06T13:41:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1c17dce0 0x7fca1c15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca21c99700 1 -- 172.21.15.38:0/4150224565 learned_addr learned my addr 172.21.15.38:0/4150224565 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:41:59.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 -- 172.21.15.38:0/4150224565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca1c171c40 msgr2=0x7fca1c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca1c171c40 0x7fca1c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 -- 172.21.15.38:0/4150224565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 msgr2=0x7fca1c168e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c168e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 -- 172.21.15.38:0/4150224565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18009300 con 0x7fca1c17dce0 2023-11-06T13:41:59.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.740+0000 7fca2249a700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1c17dce0 0x7fca1c15e560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fca0c00e620 tx=0x7fca0c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.741+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c012600 con 0x7fca1c17dce0 2023-11-06T13:41:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.741+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c012760 con 0x7fca1c17dce0 2023-11-06T13:41:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.741+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c012ae0 con 0x7fca1c17dce0 2023-11-06T13:41:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.741+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c169d40 con 0x7fca1c17dce0 2023-11-06T13:41:59.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.741+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c16a300 con 0x7fca1c17dce0 2023-11-06T13:41:59.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.742+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c0eb860 con 0x7fca1c17dce0 2023-11-06T13:41:59.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.743+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fca0c01b400 con 0x7fca1c17dce0 2023-11-06T13:41:59.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.744+0000 7fca11ffb700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fca0008cb40 0x7fca0008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:41:59.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.744+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fca0c0b2350 con 0x7fca1c17dce0 2023-11-06T13:41:59.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.744+0000 7fca21c99700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fca0008cb40 0x7fca0008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:41:59.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.744+0000 7fca21c99700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fca0008cb40 0x7fca0008f000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fca18006e60 tx=0x7fca1801a000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:41:59.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.752+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fca1c0eb860 con 0x7fca1c17dce0 2023-11-06T13:41:59.927 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.924+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca1c0475a0 con 0x7fca1c17dce0 2023-11-06T13:41:59.929 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.926+0000 7fca11ffb700 1 -- 172.21.15.38:0/4150224565 <== mon.2 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+23605 (secure 0 0 0) 0x7fca0c016020 con 0x7fca1c17dce0 2023-11-06T13:41:59.930 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:41:59.930 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":33,"fsid":"678c2a34-c65e-414a-9c54-b10698be691f","created":"2023-11-06T13:27:22.476451+0000","modified":"2023-11-06T13:28:29.255525+0000","last_up_change":"2023-11-06T13:27:32.274503+0000","last_in_change":"2023-11-06T13:27:26.021334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-06T13:27:32.329856+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-06T13:27:35.599961+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-06T13:27:40.368418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-06T13:27:40.848313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-11-06T13:27:43.934481+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70dffe1e-03ba-483c-bbdb-4618ba574c34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":91141},{"type":"v1","addr":"172.21.15.38:6810","nonce":91141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":91141},{"type":"v1","addr":"172.21.15.38:6814","nonce":91141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6820","nonce":91141},{"type":"v1","addr":"172.21.15.38:6822","nonce":91141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6816","nonce":91141},{"type":"v1","addr":"172.21.15.38:6818","nonce":91141}]},"public_addr":"172.21.15.38:6810/91141","cluster_addr":"172.21.15.38:6814/91141","heartbeat_back_addr":"172.21.15.38:6822/91141","heartbeat_front_addr":"172.21.15.38:6818/91141","state":["exists","up"]},{"osd":1,"uuid":"efb0ea04-0df6-4615-b30e-30c437f23069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":121228},{"type":"v1","addr":"172.21.15.44:6802","nonce":121228}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":121228},{"type":"v1","addr":"172.21.15.44:6806","nonce":121228}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":121228},{"type":"v1","addr":"172.21.15.44:6814","nonce":121228}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":121228},{"type":"v1","addr":"172.21.15.44:6810","nonce":121228}]},"public_addr":"172.21.15.44:6802/121228","cluster_addr":"172.21.15.44:6806/121228","heartbeat_back_addr":"172.21.15.44:6814/121228","heartbeat_front_addr":"172.21.15.44:6810/121228","state":["exists","up"]},{"osd":2,"uuid":"5df266ba-af44-408a-913f-bbcee7dc4434","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":91791},{"type":"v1","addr":"172.21.15.163:6809","nonce":91791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":91791},{"type":"v1","addr":"172.21.15.163:6811","nonce":91791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":91791},{"type":"v1","addr":"172.21.15.163:6815","nonce":91791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":91791},{"type":"v1","addr":"172.21.15.163:6813","nonce":91791}]},"public_addr":"172.21.15.163:6809/91791","cluster_addr":"172.21.15.163:6811/91791","heartbeat_back_addr":"172.21.15.163:6815/91791","heartbeat_front_addr":"172.21.15.163:6813/91791","state":["exists","up"]},{"osd":3,"uuid":"07f1cee1-e1d2-450d-b9b1-79ef56cd178a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":91126},{"type":"v1","addr":"172.21.15.38:6801","nonce":91126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":91126},{"type":"v1","addr":"172.21.15.38:6803","nonce":91126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":91126},{"type":"v1","addr":"172.21.15.38:6807","nonce":91126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":91126},{"type":"v1","addr":"172.21.15.38:6805","nonce":91126}]},"public_addr":"172.21.15.38:6801/91126","cluster_addr":"172.21.15.38:6803/91126","heartbeat_back_addr":"172.21.15.38:6807/91126","heartbeat_front_addr":"172.21.15.38:6805/91126","state":["exists","up"]},{"osd":4,"uuid":"edf7bf5d-22a4-4cd2-bbfc-d2422221b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":121240},{"type":"v1","addr":"172.21.15.44:6817","nonce":121240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":121240},{"type":"v1","addr":"172.21.15.44:6819","nonce":121240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":121240},{"type":"v1","addr":"172.21.15.44:6823","nonce":121240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":121240},{"type":"v1","addr":"172.21.15.44:6821","nonce":121240}]},"public_addr":"172.21.15.44:6817/121240","cluster_addr":"172.21.15.44:6819/121240","heartbeat_back_addr":"172.21.15.44:6823/121240","heartbeat_front_addr":"172.21.15.44:6821/121240","state":["exists","up"]},{"osd":5,"uuid":"d6273ae2-d646-44f0-ac1f-f8eef352449f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":91792},{"type":"v1","addr":"172.21.15.163:6817","nonce":91792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":91792},{"type":"v1","addr":"172.21.15.163:6819","nonce":91792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":91792},{"type":"v1","addr":"172.21.15.163:6823","nonce":91792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":91792},{"type":"v1","addr":"172.21.15.163:6821","nonce":91792}]},"public_addr":"172.21.15.163:6817/91792","cluster_addr":"172.21.15.163:6819/91792","heartbeat_back_addr":"172.21.15.163:6823/91792","heartbeat_front_addr":"172.21.15.163:6821/91792","state":["exists","up"]},{"osd":6,"uuid":"324af172-8b41-451b-95b8-85fc8525db70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":91142},{"type":"v1","addr":"172.21.15.38:6811","nonce":91142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":91142},{"type":"v1","addr":"172.21.15.38:6815","nonce":91142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6821","nonce":91142},{"type":"v1","addr":"172.21.15.38:6823","nonce":91142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6817","nonce":91142},{"type":"v1","addr":"172.21.15.38:6819","nonce":91142}]},"public_addr":"172.21.15.38:6811/91142","cluster_addr":"172.21.15.38:6815/91142","heartbeat_back_addr":"172.21.15.38:6823/91142","heartbeat_front_addr":"172.21.15.38:6819/91142","state":["exists","up"]},{"osd":7,"uuid":"110ee541-83b3-4e88-a815-3aeef680ebd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6801","nonce":121229},{"type":"v1","addr":"172.21.15.44:6803","nonce":121229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6805","nonce":121229},{"type":"v1","addr":"172.21.15.44:6807","nonce":121229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6813","nonce":121229},{"type":"v1","addr":"172.21.15.44:6815","nonce":121229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6809","nonce":121229},{"type":"v1","addr":"172.21.15.44:6811","nonce":121229}]},"public_addr":"172.21.15.44:6803/121229","cluster_addr":"172.21.15.44:6807/121229","heartbeat_back_addr":"172.21.15.44:6815/121229","heartbeat_front_addr":"172.21.15.44:6811/121229","state":["exists","up"]},{"osd":8,"uuid":"03b86b1b-6b0e-441a-a3b8-6164aa1e2f06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":91790},{"type":"v1","addr":"172.21.15.163:6801","nonce":91790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":91790},{"type":"v1","addr":"172.21.15.163:6803","nonce":91790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":91790},{"type":"v1","addr":"172.21.15.163:6807","nonce":91790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":91790},{"type":"v1","addr":"172.21.15.163:6805","nonce":91790}]},"public_addr":"172.21.15.163:6801/91790","cluster_addr":"172.21.15.163:6803/91790","heartbeat_back_addr":"172.21.15.163:6807/91790","heartbeat_front_addr":"172.21.15.163:6805/91790","state":["exists","up"]},{"osd":9,"uuid":"b523c4f6-8029-4e95-8c2f-b0899cf5f730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6824","nonce":91143},{"type":"v1","addr":"172.21.15.38:6825","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6826","nonce":91143},{"type":"v1","addr":"172.21.15.38:6827","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6830","nonce":91143},{"type":"v1","addr":"172.21.15.38:6831","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6828","nonce":91143},{"type":"v1","addr":"172.21.15.38:6829","nonce":91143}]},"public_addr":"172.21.15.38:6825/91143","cluster_addr":"172.21.15.38:6827/91143","heartbeat_back_addr":"172.21.15.38:6831/91143","heartbeat_front_addr":"172.21.15.38:6829/91143","state":["exists","up"]},{"osd":10,"uuid":"b6b05e5a-2758-4224-9cdb-3abf69fc3124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":121259},{"type":"v1","addr":"172.21.15.44:6825","nonce":121259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":121259},{"type":"v1","addr":"172.21.15.44:6827","nonce":121259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":121259},{"type":"v1","addr":"172.21.15.44:6831","nonce":121259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":121259},{"type":"v1","addr":"172.21.15.44:6829","nonce":121259}]},"public_addr":"172.21.15.44:6825/121259","cluster_addr":"172.21.15.44:6827/121259","heartbeat_back_addr":"172.21.15.44:6831/121259","heartbeat_front_addr":"172.21.15.44:6829/121259","state":["exists","up"]},{"osd":11,"uuid":"74a1c2f7-c63a-45aa-8da3-35539631c9dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":91802},{"type":"v1","addr":"172.21.15.163:6825","nonce":91802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":91802},{"type":"v1","addr":"172.21.15.163:6827","nonce":91802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":91802},{"type":"v1","addr":"172.21.15.163:6831","nonce":91802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":91802},{"type":"v1","addr":"172.21.15.163:6829","nonce":91802}]},"public_addr":"172.21.15.163:6825/91802","cluster_addr":"172.21.15.163:6827/91802","heartbeat_back_addr":"172.21.15.163:6831/91802","heartbeat_front_addr":"172.21.15.163:6829/91802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.120089+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.203928+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.028605+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.213749+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.223038+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.153921+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.108406+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.148559+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.180685+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.172719+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-06T13:27:31.269422+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.18","mappings":[{"from":4,"to":8}]},{"pgid":"4.1c","mappings":[{"from":2,"to":8}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-06T13:41:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fca0008cb40 msgr2=0x7fca0008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fca0008cb40 0x7fca0008f000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fca18006e60 tx=0x7fca1801a000).stop 2023-11-06T13:41:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1c17dce0 msgr2=0x7fca1c15e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:41:59.932 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1c17dce0 0x7fca1c15e560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fca0c00e620 tx=0x7fca0c009060).stop 2023-11-06T13:41:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 shutdown_connections 2023-11-06T13:41:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca1c17dce0 0x7fca1c15e560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fca1c171860 0x7fca1c168e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fca0008cb40 0x7fca0008f000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:41:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 --2- 172.21.15.38:0/4150224565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca1c171c40 0x7fca1c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-11-06T13:41:59.933 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 >> 172.21.15.38:0/4150224565 conn(0x7fca1c0ed830 msgr2=0x7fca1c0c16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:41:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 shutdown_connections 2023-11-06T13:41:59.934 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:41:59.927+0000 7fca22c9b700 1 -- 172.21.15.38:0/4150224565 wait complete. 2023-11-06T13:41:59.944 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-11-06T13:27:32.329856+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-11-06T13:27:35.599961+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-06T13:27:40.368418+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-06T13:27:40.848313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-06T13:27:43.934481+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-06T13:41:59.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-11-06T13:42:00.065 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.062+0000 7f880690d700 1 Processor -- start 2023-11-06T13:42:00.066 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.062+0000 7f880690d700 1 -- start start 2023-11-06T13:42:00.069 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f880690d700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f880017e260 0x7f880017e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f880690d700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880017ddd0 con 0x7f8800183830 2023-11-06T13:42:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f880690d700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8800064780 con 0x7f8800175a40 2023-11-06T13:42:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f880690d700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000c4c20 con 0x7f880017e260 2023-11-06T13:42:00.070 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f8804eaa700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f8800183830 0x7f8800185c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50538/0 (socket says 172.21.15.38:50538) 2023-11-06T13:42:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f8804eaa700 1 -- 172.21.15.38:0/1058012766 learned_addr learned my addr 172.21.15.38:0/1058012766 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:42:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f87ff7fe700 1 --2- 172.21.15.38:0/1058012766 >> v2:172.21.15.163:3300/0 conn(0x7f880017e260 0x7f880017e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786855944 0 0) 0x7f880017ddd0 con 0x7f8800183830 2023-11-06T13:42:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.063+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ec0033f0 con 0x7f8800183830 2023-11-06T13:42:00.071 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3518402377 0 0) 0x7f87ec0033f0 con 0x7f8800183830 2023-11-06T13:42:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 >> v2:172.21.15.163:3300/0 conn(0x7f880017e260 msgr2=0x7f880017e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 --2- 172.21.15.38:0/1058012766 >> v2:172.21.15.163:3300/0 conn(0x7f880017e260 0x7f880017e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 >> v1:172.21.15.44:6789/0 conn(0x7f8800175a40 legacy=0x7f880017f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.072 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880017fda0 con 0x7f8800183830 2023-11-06T13:42:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f87f80017f0 con 0x7f8800183830 2023-11-06T13:42:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 >> v1:172.21.15.38:6789/0 conn(0x7f8800183830 legacy=0x7f8800185c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec0038e0 0x7f87ec003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87ec004690 0x7f87ec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.073 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87ec005000 0x7f87ec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c4c20 con 0x7f87ec005000 2023-11-06T13:42:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec00bee0 con 0x7f87ec004690 2023-11-06T13:42:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec00c0a0 con 0x7f87ec0038e0 2023-11-06T13:42:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87ec005000 0x7f87ec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.074 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87ff7fe700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87ec004690 0x7f87ec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87fffff700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec0038e0 0x7f87ec003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 -- 172.21.15.38:0/1058012766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec0038e0 msgr2=0x7f87ec003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec0038e0 0x7f87ec003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.075 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 -- 172.21.15.38:0/1058012766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87ec004690 msgr2=0x7f87ec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:00.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87ec004690 0x7f87ec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 -- 172.21.15.38:0/1058012766 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0033f0 con 0x7f87ec005000 2023-11-06T13:42:00.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 -- 172.21.15.38:0/1058012766 reap_dead start 2023-11-06T13:42:00.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f8804eaa700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87ec005000 0x7f87ec00b8e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f87f800c5f0 tx=0x7f87f8001d90).ready entity=mon.0 client_cookie=1c7f9a6708e5b5a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.076 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8001fc0 con 0x7f87ec005000 2023-11-06T13:42:00.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8005b20 con 0x7f87ec005000 2023-11-06T13:42:00.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.064+0000 7f87feffd700 1 -- 172.21.15.38:0/1058012766 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80070d0 con 0x7f87ec005000 2023-11-06T13:42:00.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 -- 172.21.15.38:0/1058012766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87ec005000 msgr2=0x7f87ec00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.077 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87ec005000 0x7f87ec00b8e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f87f800c5f0 tx=0x7f87f8001d90).stop 2023-11-06T13:42:00.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 -- 172.21.15.38:0/1058012766 shutdown_connections 2023-11-06T13:42:00.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 --2- 172.21.15.38:0/1058012766 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f87ec005000 0x7f87ec00b8e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 -- 172.21.15.38:0/1058012766 >> 172.21.15.38:0/1058012766 conn(0x7f880006a970 msgr2=0x7f88000f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:00.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 -- 172.21.15.38:0/1058012766 shutdown_connections 2023-11-06T13:42:00.078 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.065+0000 7f880690d700 1 -- 172.21.15.38:0/1058012766 wait complete. 2023-11-06T13:42:00.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.066+0000 7f880690d700 1 Processor -- start 2023-11-06T13:42:00.081 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.067+0000 7f880690d700 1 -- start start 2023-11-06T13:42:00.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec005000 0x7f8800156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88001570e0 0x7f88000c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 0x7f88000c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8800157ae0 con 0x7f8800157560 2023-11-06T13:42:00.082 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c5250 con 0x7f88001570e0 2023-11-06T13:42:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000c54f0 con 0x7f87ec005000 2023-11-06T13:42:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 0x7f88000c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 0x7f88000c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53348/0 (socket says 172.21.15.38:53348) 2023-11-06T13:42:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 -- 172.21.15.38:0/2495078972 learned_addr learned my addr 172.21.15.38:0/2495078972 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:00.083 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f87ff7fe700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88001570e0 0x7f88000c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f87fffff700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec005000 0x7f8800156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 -- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec005000 msgr2=0x7f8800156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec005000 0x7f8800156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 -- 172.21.15.38:0/2495078972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88001570e0 msgr2=0x7f88000c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.084 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88001570e0 0x7f88000c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 -- 172.21.15.38:0/2495078972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000c57d0 con 0x7f8800157560 2023-11-06T13:42:00.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f8804eaa700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 0x7f88000c67a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f87f8006000 tx=0x7f87f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80070d0 con 0x7f8800157560 2023-11-06T13:42:00.085 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f80017b0 con 0x7f8800157560 2023-11-06T13:42:00.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88000c5ab0 con 0x7f8800157560 2023-11-06T13:42:00.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8005ea0 con 0x7f8800157560 2023-11-06T13:42:00.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.068+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8800192070 con 0x7f8800157560 2023-11-06T13:42:00.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.069+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880006c580 con 0x7f8800157560 2023-11-06T13:42:00.086 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.070+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f87f80218c0 con 0x7f8800157560 2023-11-06T13:42:00.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.071+0000 7f87f7fff700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87e008cb40 0x7f87e008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.071+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f87f8019070 con 0x7f8800157560 2023-11-06T13:42:00.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.071+0000 7f87fffff700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87e008cb40 0x7f87e008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.071+0000 7f87fffff700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87e008cb40 0x7f87e008f000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f87f0000c00 tx=0x7f87f0009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.087 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.075+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f87f8083af0 con 0x7f8800157560 2023-11-06T13:42:00.249 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.245+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f880017cee0 con 0x7f8800157560 2023-11-06T13:42:00.250 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.246+0000 7f87f7fff700 1 -- 172.21.15.38:0/2495078972 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v33) v1 ==== 110+0+10 (secure 0 0 0) 0x7f87f8087110 con 0x7f8800157560 2023-11-06T13:42:00.250 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 1 2023-11-06T13:42:00.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87e008cb40 msgr2=0x7f87e008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87e008cb40 0x7f87e008f000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f87f0000c00 tx=0x7f87f0009040).stop 2023-11-06T13:42:00.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 msgr2=0x7f88000c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.252 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 0x7f88000c67a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f87f8006000 tx=0x7f87f8015000).stop 2023-11-06T13:42:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 shutdown_connections 2023-11-06T13:42:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f8800157560 0x7f88000c67a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87ec005000 0x7f8800156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.253 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f87e008cb40 0x7f87e008f000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 --2- 172.21.15.38:0/2495078972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88001570e0 0x7f88000c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 >> 172.21.15.38:0/2495078972 conn(0x7f880006a970 msgr2=0x7f8800171070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 shutdown_connections 2023-11-06T13:42:00.254 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.248+0000 7f880690d700 1 -- 172.21.15.38:0/2495078972 wait complete. 2023-11-06T13:42:00.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-06T13:42:00.385 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.382+0000 7f2a856ba700 1 Processor -- start 2023-11-06T13:42:00.386 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.382+0000 7f2a856ba700 1 -- start start 2023-11-06T13:42:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a856ba700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f2a80178c90 0x7f2a800eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.388 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a856ba700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a80179070 0x7f2a800ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a856ba700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a80180310 0x7f2a801807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a856ba700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a80063ed0 con 0x7f2a80179070 2023-11-06T13:42:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a856ba700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800641b0 con 0x7f2a80180310 2023-11-06T13:42:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a856ba700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a80064490 con 0x7f2a80178c90 2023-11-06T13:42:00.389 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a80179070 0x7f2a800ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f2a80179070 0x7f2a800ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53360/0 (socket says 172.21.15.38:53360) 2023-11-06T13:42:00.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 -- 172.21.15.38:0/449838935 learned_addr learned my addr 172.21.15.38:0/449838935 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:00.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7effd700 1 --2- 172.21.15.38:0/449838935 >> v2:172.21.15.163:3300/0 conn(0x7f2a80178c90 0x7f2a800eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7f7fe700 1 --2- 172.21.15.38:0/449838935 >> v2:172.21.15.44:3300/0 conn(0x7f2a80180310 0x7f2a801807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.390 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 -- 172.21.15.38:0/449838935 >> v2:172.21.15.163:3300/0 conn(0x7f2a80178c90 msgr2=0x7f2a800eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:00.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 --2- 172.21.15.38:0/449838935 >> v2:172.21.15.163:3300/0 conn(0x7f2a80178c90 0x7f2a800eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 -- 172.21.15.38:0/449838935 >> v2:172.21.15.44:3300/0 conn(0x7f2a80180310 msgr2=0x7f2a801807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:00.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 --2- 172.21.15.38:0/449838935 >> v2:172.21.15.44:3300/0 conn(0x7f2a80180310 0x7f2a801807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 -- 172.21.15.38:0/449838935 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a80064770 con 0x7f2a80179070 2023-11-06T13:42:00.391 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.383+0000 7f2a7e7fc700 1 --2- 172.21.15.38:0/449838935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80179070 0x7f2a800ecf50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f2a800ce030 tx=0x7f2a680090f0).ready entity=mon.0 client_cookie=2cd4835f34a847be server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a7dffb700 1 -- 172.21.15.38:0/449838935 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800b520 con 0x7f2a80179070 2023-11-06T13:42:00.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a7dffb700 1 -- 172.21.15.38:0/449838935 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6800b680 con 0x7f2a80179070 2023-11-06T13:42:00.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a7dffb700 1 -- 172.21.15.38:0/449838935 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800ba20 con 0x7f2a80179070 2023-11-06T13:42:00.392 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 -- 172.21.15.38:0/449838935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80179070 msgr2=0x7f2a800ecf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 --2- 172.21.15.38:0/449838935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80179070 0x7f2a800ecf50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f2a800ce030 tx=0x7f2a680090f0).stop 2023-11-06T13:42:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 -- 172.21.15.38:0/449838935 shutdown_connections 2023-11-06T13:42:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 --2- 172.21.15.38:0/449838935 >> v2:172.21.15.163:3300/0 conn(0x7f2a80178c90 0x7f2a800eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 --2- 172.21.15.38:0/449838935 >> v2:172.21.15.44:3300/0 conn(0x7f2a80180310 0x7f2a801807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.393 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 --2- 172.21.15.38:0/449838935 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80179070 0x7f2a800ecf50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 -- 172.21.15.38:0/449838935 >> 172.21.15.38:0/449838935 conn(0x7f2a800f5df0 msgr2=0x7f2a800f1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 -- 172.21.15.38:0/449838935 shutdown_connections 2023-11-06T13:42:00.394 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.384+0000 7f2a856ba700 1 -- 172.21.15.38:0/449838935 wait complete. 2023-11-06T13:42:00.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.386+0000 7f2a856ba700 1 Processor -- start 2023-11-06T13:42:00.397 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.386+0000 7f2a856ba700 1 -- start start 2023-11-06T13:42:00.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a856ba700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a80178c90 0x7f2a80168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a856ba700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a80179070 0x7f2a8016d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a856ba700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 0x7f2a8016d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.398 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a856ba700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8016cd00 con 0x7f2a80180310 2023-11-06T13:42:00.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a856ba700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8016f050 con 0x7f2a80178c90 2023-11-06T13:42:00.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a856ba700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8016f330 con 0x7f2a80179070 2023-11-06T13:42:00.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 0x7f2a8016d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 0x7f2a8016d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53372/0 (socket says 172.21.15.38:53372) 2023-11-06T13:42:00.399 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7e7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a80179070 0x7f2a8016d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 -- 172.21.15.38:0/4091675695 learned_addr learned my addr 172.21.15.38:0/4091675695 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:00.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7effd700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a80178c90 0x7f2a80168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 -- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a80179070 msgr2=0x7f2a8016d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.400 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a80179070 0x7f2a8016d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 -- 172.21.15.38:0/4091675695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a80178c90 msgr2=0x7f2a80168b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a80178c90 0x7f2a80168b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 -- 172.21.15.38:0/4091675695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a68009370 con 0x7f2a80180310 2023-11-06T13:42:00.401 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7e7fc700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a80179070 0x7f2a8016d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-11-06T13:42:00.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.387+0000 7f2a7f7fe700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 0x7f2a8016d680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f2a7000bfd0 tx=0x7f2a70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.388+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70011590 con 0x7f2a80180310 2023-11-06T13:42:00.402 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.388+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700116f0 con 0x7f2a80180310 2023-11-06T13:42:00.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.388+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70011a70 con 0x7f2a80180310 2023-11-06T13:42:00.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.388+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8016c3d0 con 0x7f2a80180310 2023-11-06T13:42:00.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.388+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8016c990 con 0x7f2a80180310 2023-11-06T13:42:00.403 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.389+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a80065250 con 0x7f2a80180310 2023-11-06T13:42:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.389+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f2a7001c460 con 0x7f2a80180310 2023-11-06T13:42:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.390+0000 7f2a76ffd700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2a6008cb40 0x7f2a6008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.390+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f2a700b1bd0 con 0x7f2a80180310 2023-11-06T13:42:00.404 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.390+0000 7f2a7effd700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2a6008cb40 0x7f2a6008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.390+0000 7f2a7effd700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2a6008cb40 0x7f2a6008f000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f2a78009fd0 tx=0x7f2a7800b040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.405 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.394+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f2a700821e0 con 0x7f2a80180310 2023-11-06T13:42:00.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.571+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a8006c580 con 0x7f2a80180310 2023-11-06T13:42:00.575 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.571+0000 7f2a76ffd700 1 -- 172.21.15.38:0/4091675695 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a70011e60 con 0x7f2a80180310 2023-11-06T13:42:00.576 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2023-11-06T13:42:00.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2a6008cb40 msgr2=0x7f2a6008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.577 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2a6008cb40 0x7f2a6008f000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f2a78009fd0 tx=0x7f2a7800b040).stop 2023-11-06T13:42:00.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 msgr2=0x7f2a8016d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 0x7f2a8016d680 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f2a7000bfd0 tx=0x7f2a70008040).stop 2023-11-06T13:42:00.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 shutdown_connections 2023-11-06T13:42:00.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f2a80180310 0x7f2a8016d680 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.578 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f2a6008cb40 0x7f2a6008f000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a80178c90 0x7f2a80168b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 --2- 172.21.15.38:0/4091675695 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2a80179070 0x7f2a8016d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 >> 172.21.15.38:0/4091675695 conn(0x7f2a800f5df0 msgr2=0x7f2a800849e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:00.579 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 shutdown_connections 2023-11-06T13:42:00.580 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.573+0000 7f2a856ba700 1 -- 172.21.15.38:0/4091675695 wait complete. 2023-11-06T13:42:00.589 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-06T13:42:00.712 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.708+0000 7fc011de9700 1 Processor -- start 2023-11-06T13:42:00.713 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.708+0000 7fc011de9700 1 -- start start 2023-11-06T13:42:00.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.709+0000 7fc011de9700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc00c1756e0 0x7fc00c0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc011de9700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc00c182540 0x7fc00c182990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.715 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc011de9700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c1814b0 con 0x7fc00c180140 2023-11-06T13:42:00.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc011de9700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0c8c40 con 0x7fc00c1756e0 2023-11-06T13:42:00.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc011de9700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c182050 con 0x7fc00c182540 2023-11-06T13:42:00.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc00c1756e0 0x7fc00c0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.716 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7fc00c1756e0 0x7fc00c0c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53378/0 (socket says 172.21.15.38:53378) 2023-11-06T13:42:00.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 -- 172.21.15.38:0/846840184 learned_addr learned my addr 172.21.15.38:0/846840184 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:00.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00bfff700 1 --2- 172.21.15.38:0/846840184 >> v2:172.21.15.44:3300/0 conn(0x7fc00c182540 0x7fc00c182990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 -- 172.21.15.38:0/846840184 >> v2:172.21.15.44:3300/0 conn(0x7fc00c182540 msgr2=0x7fc00c182990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:00.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 --2- 172.21.15.38:0/846840184 >> v2:172.21.15.44:3300/0 conn(0x7fc00c182540 0x7fc00c182990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.717 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 -- 172.21.15.38:0/846840184 >> v1:172.21.15.44:6789/0 conn(0x7fc00c180140 legacy=0x7fc00c181940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 -- 172.21.15.38:0/846840184 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c1805c0 con 0x7fc00c1756e0 2023-11-06T13:42:00.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00b7fe700 1 --2- 172.21.15.38:0/846840184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c1756e0 0x7fc00c0c8750 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc00c064a40 tx=0x7fbffc0090f0).ready entity=mon.0 client_cookie=95dfa5f3c49439cf server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00a7fc700 1 -- 172.21.15.38:0/846840184 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00b600 con 0x7fc00c1756e0 2023-11-06T13:42:00.718 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00a7fc700 1 -- 172.21.15.38:0/846840184 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00b760 con 0x7fc00c1756e0 2023-11-06T13:42:00.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.710+0000 7fc00a7fc700 1 -- 172.21.15.38:0/846840184 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00bb00 con 0x7fc00c1756e0 2023-11-06T13:42:00.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 -- 172.21.15.38:0/846840184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c1756e0 msgr2=0x7fc00c0c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 --2- 172.21.15.38:0/846840184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c1756e0 0x7fc00c0c8750 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fc00c064a40 tx=0x7fbffc0090f0).stop 2023-11-06T13:42:00.719 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 -- 172.21.15.38:0/846840184 shutdown_connections 2023-11-06T13:42:00.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 --2- 172.21.15.38:0/846840184 >> v2:172.21.15.44:3300/0 conn(0x7fc00c182540 0x7fc00c182990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 --2- 172.21.15.38:0/846840184 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c1756e0 0x7fc00c0c8750 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 -- 172.21.15.38:0/846840184 >> 172.21.15.38:0/846840184 conn(0x7fc00c05eeb0 msgr2=0x7fc00c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:00.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 -- 172.21.15.38:0/846840184 shutdown_connections 2023-11-06T13:42:00.720 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.711+0000 7fc011de9700 1 -- 172.21.15.38:0/846840184 wait complete. 2023-11-06T13:42:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.712+0000 7fc011de9700 1 Processor -- start 2023-11-06T13:42:00.723 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.713+0000 7fc011de9700 1 -- start start 2023-11-06T13:42:00.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.713+0000 7fc011de9700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 0x7fc00c190820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.713+0000 7fc011de9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc00c182540 0x7fc00c0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc011de9700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc00c16c6f0 0x7fc00c0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc011de9700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1903d0 con 0x7fc00c180140 2023-11-06T13:42:00.724 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc011de9700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0cb850 con 0x7fc00c16c6f0 2023-11-06T13:42:00.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc011de9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1900f0 con 0x7fc00c182540 2023-11-06T13:42:00.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 0x7fc00c190820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 0x7fc00c190820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53386/0 (socket says 172.21.15.38:53386) 2023-11-06T13:42:00.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 -- 172.21.15.38:0/1108641174 learned_addr learned my addr 172.21.15.38:0/1108641174 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:00.725 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00affd700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc00c182540 0x7fc00c0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00bfff700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc00c16c6f0 0x7fc00c0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 -- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc00c182540 msgr2=0x7fc00c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc00c182540 0x7fc00c0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 -- 172.21.15.38:0/1108641174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc00c16c6f0 msgr2=0x7fc00c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.726 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc00c16c6f0 0x7fc00c0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 -- 172.21.15.38:0/1108641174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009370 con 0x7fc00c180140 2023-11-06T13:42:00.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00affd700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc00c182540 0x7fc00c0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:42:00.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00bfff700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc00c16c6f0 0x7fc00c0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:42:00.727 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc00b7fe700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 0x7fc00c190820 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc00c06af20 tx=0x7fbffc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00bec0 con 0x7fc00c180140 2023-11-06T13:42:00.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00b8d0 con 0x7fc00c180140 2023-11-06T13:42:00.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc024470 con 0x7fc00c180140 2023-11-06T13:42:00.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c0caf20 con 0x7fc00c180140 2023-11-06T13:42:00.728 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.714+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c0cb4e0 con 0x7fc00c180140 2023-11-06T13:42:00.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.715+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c06c580 con 0x7fc00c180140 2023-11-06T13:42:00.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.716+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7fbffc021070 con 0x7fc00c180140 2023-11-06T13:42:00.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.717+0000 7fbff37fe700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbff808cb40 0x7fbff808f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:00.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.717+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7fbffc0b39a0 con 0x7fc00c180140 2023-11-06T13:42:00.729 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.717+0000 7fc00affd700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbff808cb40 0x7fbff808f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:00.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.717+0000 7fc00affd700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbff808cb40 0x7fbff808f000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fc00c0cc750 tx=0x7fc000009040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:00.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.721+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7fbffc083f30 con 0x7fc00c180140 2023-11-06T13:42:00.898 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.895+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc00c0c73f0 con 0x7fc00c180140 2023-11-06T13:42:00.899 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.895+0000 7fbff37fe700 1 -- 172.21.15.38:0/1108641174 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbffc029070 con 0x7fc00c180140 2023-11-06T13:42:00.899 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:42:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbff808cb40 msgr2=0x7fbff808f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbff808cb40 0x7fbff808f000 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fc00c0cc750 tx=0x7fc000009040).stop 2023-11-06T13:42:00.901 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 msgr2=0x7fc00c190820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 0x7fc00c190820 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc00c06af20 tx=0x7fbffc017000).stop 2023-11-06T13:42:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 shutdown_connections 2023-11-06T13:42:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7fbff808cb40 0x7fbff808f000 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc00c16c6f0 0x7fc00c0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.902 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7fc00c180140 0x7fc00c190820 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 --2- 172.21.15.38:0/1108641174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc00c182540 0x7fc00c0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 >> 172.21.15.38:0/1108641174 conn(0x7fc00c1756e0 msgr2=0x7fc00c0f12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 shutdown_connections 2023-11-06T13:42:00.903 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:00.897+0000 7fc011de9700 1 -- 172.21.15.38:0/1108641174 wait complete. 2023-11-06T13:42:00.913 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-06T13:42:01.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.030+0000 7f9b7f59e700 1 Processor -- start 2023-11-06T13:42:01.034 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.030+0000 7f9b7f59e700 1 -- start start 2023-11-06T13:42:01.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.031+0000 7f9b7f59e700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9b80084bd0 0x7f9b80084ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.031+0000 7f9b7f59e700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8017d550 con 0x7f9b80175590 2023-11-06T13:42:01.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.031+0000 7f9b7f59e700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8017fad0 con 0x7f9b80175970 2023-11-06T13:42:01.037 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.031+0000 7f9b7f59e700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b80085ad0 con 0x7f9b80084bd0 2023-11-06T13:42:01.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.031+0000 7f9b7e59c700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f9b80175590 0x7f9b8017d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50540/0 (socket says 172.21.15.38:50540) 2023-11-06T13:42:01.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.031+0000 7f9b7e59c700 1 -- 172.21.15.38:0/3859771225 learned_addr learned my addr 172.21.15.38:0/3859771225 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:42:01.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7ed9d700 1 --2- 172.21.15.38:0/3859771225 >> v2:172.21.15.44:3300/0 conn(0x7f9b80084bd0 0x7f9b80084ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905980071 0 0) 0x7f9b8017d550 con 0x7f9b80175590 2023-11-06T13:42:01.038 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6c0033f0 con 0x7f9b80175590 2023-11-06T13:42:01.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57017500 0 0) 0x7f9b8017fad0 con 0x7f9b80175970 2023-11-06T13:42:01.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 --> v1:172.21.15.163:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8017d550 con 0x7f9b80175970 2023-11-06T13:42:01.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7ed9d700 1 -- 172.21.15.38:0/3859771225 >> v1:172.21.15.163:6789/0 conn(0x7f9b80175970 legacy=0x7f9b8017e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.039 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3953564439 0 0) 0x7f9b6c0033f0 con 0x7f9b80175590 2023-11-06T13:42:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7ed9d700 1 -- 172.21.15.38:0/3859771225 >> v1:172.21.15.38:6789/0 conn(0x7f9b80175590 legacy=0x7f9b8017d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7ed9d700 1 -- 172.21.15.38:0/3859771225 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8017c940 con 0x7f9b80084bd0 2023-11-06T13:42:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7ed9d700 1 --2- 172.21.15.38:0/3859771225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80084bd0 0x7f9b80084ff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9b70009e60 tx=0x7f9b70009780).ready entity=mon.1 client_cookie=5ff234872ce5eeaf server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.040 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 <== mon.1 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7000e070 con 0x7f9b80084bd0 2023-11-06T13:42:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 <== mon.1 v2:172.21.15.44:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7000b7a0 con 0x7f9b80084bd0 2023-11-06T13:42:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.032+0000 7f9b7d59a700 1 -- 172.21.15.38:0/3859771225 <== mon.1 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78001470 con 0x7f9b80084bd0 2023-11-06T13:42:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 -- 172.21.15.38:0/3859771225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80084bd0 msgr2=0x7f9b80084ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/3859771225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80084bd0 0x7f9b80084ff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9b70009e60 tx=0x7f9b70009780).stop 2023-11-06T13:42:01.041 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 -- 172.21.15.38:0/3859771225 shutdown_connections 2023-11-06T13:42:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/3859771225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80084bd0 0x7f9b80084ff0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 -- 172.21.15.38:0/3859771225 >> 172.21.15.38:0/3859771225 conn(0x7f9b800f5d10 msgr2=0x7f9b800f1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 -- 172.21.15.38:0/3859771225 shutdown_connections 2023-11-06T13:42:01.042 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.033+0000 7f9b7f59e700 1 -- 172.21.15.38:0/3859771225 wait complete. 2023-11-06T13:42:01.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.034+0000 7f9b7f59e700 1 Processor -- start 2023-11-06T13:42:01.045 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.034+0000 7f9b7f59e700 1 -- start start 2023-11-06T13:42:01.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7f59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b80084bd0 0x7f9b8016f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7f59e700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 0x7f9b8018fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7f59e700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80175970 0x7f9b80086da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.046 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7f59e700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800cc510 con 0x7f9b80175590 2023-11-06T13:42:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7f59e700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80085dd0 con 0x7f9b80175970 2023-11-06T13:42:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7f59e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80086910 con 0x7f9b80084bd0 2023-11-06T13:42:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7dd9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 0x7f9b8018fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.035+0000 7f9b7e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b80084bd0 0x7f9b8016f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.047 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 0x7f9b8018fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53400/0 (socket says 172.21.15.38:53400) 2023-11-06T13:42:01.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 -- 172.21.15.38:0/1714609194 learned_addr learned my addr 172.21.15.38:0/1714609194 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:01.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7ed9d700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80175970 0x7f9b80086da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 -- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b80084bd0 msgr2=0x7f9b8016f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b80084bd0 0x7f9b8016f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.048 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 -- 172.21.15.38:0/1714609194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80175970 msgr2=0x7f9b80086da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80175970 0x7f9b80086da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 -- 172.21.15.38:0/1714609194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70009a20 con 0x7f9b80175590 2023-11-06T13:42:01.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7dd9b700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 0x7f9b8018fbf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9b6800c4f0 tx=0x7f9b68007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68012400 con 0x7f9b80175590 2023-11-06T13:42:01.049 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68012580 con 0x7f9b80175590 2023-11-06T13:42:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8016f6b0 con 0x7f9b80175590 2023-11-06T13:42:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68012940 con 0x7f9b80175590 2023-11-06T13:42:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.036+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b80085fe0 con 0x7f9b80175590 2023-11-06T13:42:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.037+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b80086aa0 con 0x7f9b80175590 2023-11-06T13:42:01.050 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.038+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f9b6801b3b0 con 0x7f9b80175590 2023-11-06T13:42:01.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.039+0000 7f9b767fc700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9b6008cb40 0x7f9b6008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.039+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f9b680b12a0 con 0x7f9b80175590 2023-11-06T13:42:01.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.039+0000 7f9b7e59c700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9b6008cb40 0x7f9b6008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.051 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.039+0000 7f9b7e59c700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9b6008cb40 0x7f9b6008f000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9b780011e0 tx=0x7f9b78001980).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.052 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.043+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f9b68081830 con 0x7f9b80175590 2023-11-06T13:42:01.219 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.215+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b800f1220 con 0x7f9b80175590 2023-11-06T13:42:01.220 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.216+0000 7f9b767fc700 1 -- 172.21.15.38:0/1714609194 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b68017020 con 0x7f9b80175590 2023-11-06T13:42:01.220 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 64 2023-11-06T13:42:01.221 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9b6008cb40 msgr2=0x7f9b6008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9b6008cb40 0x7f9b6008f000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f9b780011e0 tx=0x7f9b78001980).stop 2023-11-06T13:42:01.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 msgr2=0x7f9b8018fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 0x7f9b8018fbf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9b6800c4f0 tx=0x7f9b68007c10).stop 2023-11-06T13:42:01.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 shutdown_connections 2023-11-06T13:42:01.222 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f9b6008cb40 0x7f9b6008f000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b80175970 0x7f9b80086da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9b80084bd0 0x7f9b8016f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 --2- 172.21.15.38:0/1714609194 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f9b80175590 0x7f9b8018fbf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.223 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 >> 172.21.15.38:0/1714609194 conn(0x7f9b800f5d10 msgr2=0x7f9b800f4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:01.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 shutdown_connections 2023-11-06T13:42:01.224 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.217+0000 7f9b7f59e700 1 -- 172.21.15.38:0/1714609194 wait complete. 2023-11-06T13:42:01.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-06T13:42:01.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.351+0000 7f18e6bd4700 1 Processor -- start 2023-11-06T13:42:01.355 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.351+0000 7f18e6bd4700 1 -- start start 2023-11-06T13:42:01.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e6bd4700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f18e0175a40 0x7f18e017f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e6bd4700 1 -- --> v1:172.21.15.38:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e017ddd0 con 0x7f18e017e970 2023-11-06T13:42:01.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e6bd4700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e0064780 con 0x7f18e017fb80 2023-11-06T13:42:01.359 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e6bd4700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00c4c20 con 0x7f18e0175a40 2023-11-06T13:42:01.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e5171700 1 --1- >> v1:172.21.15.38:6789/0 conn(0x7f18e017e970 0x7f18e0185840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.38:6789/0 says I am v1:172.21.15.38:50550/0 (socket says 172.21.15.38:50550) 2023-11-06T13:42:01.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e5171700 1 -- 172.21.15.38:0/2426372270 learned_addr learned my addr 172.21.15.38:0/2426372270 (peer_addr_for_me v1:172.21.15.38:0/0) 2023-11-06T13:42:01.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18e4970700 1 --2- 172.21.15.38:0/2426372270 >> v2:172.21.15.44:3300/0 conn(0x7f18e0175a40 0x7f18e017f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.352+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 <== mon.0 v1:172.21.15.38:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409585275 0 0) 0x7f18e017ddd0 con 0x7f18e017e970 2023-11-06T13:42:01.360 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 --> v1:172.21.15.38:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18cc0033f0 con 0x7f18e017e970 2023-11-06T13:42:01.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 <== mon.0 v1:172.21.15.38:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440875557 0 0) 0x7f18cc0033f0 con 0x7f18e017e970 2023-11-06T13:42:01.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 >> v2:172.21.15.44:3300/0 conn(0x7f18e0175a40 msgr2=0x7f18e017f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:01.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 --2- 172.21.15.38:0/2426372270 >> v2:172.21.15.44:3300/0 conn(0x7f18e0175a40 0x7f18e017f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.361 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 >> v1:172.21.15.44:6789/0 conn(0x7f18e017fb80 legacy=0x7f18e017e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 --> v1:172.21.15.38:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e017cee0 con 0x7f18e017e970 2023-11-06T13:42:01.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 <== mon.0 v1:172.21.15.38:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2023904329 0 0) 0x7f18d80017f0 con 0x7f18e017e970 2023-11-06T13:42:01.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 >> v1:172.21.15.38:6789/0 conn(0x7f18e017e970 legacy=0x7f18e0185840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc0038e0 0x7f18cc003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.362 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c4c20 con 0x7f18cc004690 2023-11-06T13:42:01.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc00bee0 con 0x7f18cc005000 2023-11-06T13:42:01.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc00c0a0 con 0x7f18cc0038e0 2023-11-06T13:42:01.363 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18e5171700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18e4970700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc0038e0 0x7f18cc003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 -- 172.21.15.38:0/2426372270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc0038e0 msgr2=0x7f18cc003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:01.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc0038e0 0x7f18cc003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.364 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 -- 172.21.15.38:0/2426372270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18cc005000 msgr2=0x7f18cc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:01.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18cc005000 0x7f18cc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 -- 172.21.15.38:0/2426372270 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0033f0 con 0x7f18cc004690 2023-11-06T13:42:01.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18e5171700 1 -- 172.21.15.38:0/2426372270 reap_dead start 2023-11-06T13:42:01.365 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.353+0000 7f18dffff700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f18c80017f0 tx=0x7f18c8007b90).ready entity=mon.0 client_cookie=527839825c2fc26a server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8007ea0 con 0x7f18cc004690 2023-11-06T13:42:01.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8012400 con 0x7f18cc004690 2023-11-06T13:42:01.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18df7fe700 1 -- 172.21.15.38:0/2426372270 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80127a0 con 0x7f18cc004690 2023-11-06T13:42:01.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 -- 172.21.15.38:0/2426372270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18cc004690 msgr2=0x7f18cc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.366 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f18c80017f0 tx=0x7f18c8007b90).stop 2023-11-06T13:42:01.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 -- 172.21.15.38:0/2426372270 shutdown_connections 2023-11-06T13:42:01.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/2426372270 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18cc004690 0x7f18cc004b10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 -- 172.21.15.38:0/2426372270 >> 172.21.15.38:0/2426372270 conn(0x7f18e006a970 msgr2=0x7f18e00f53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:01.367 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 -- 172.21.15.38:0/2426372270 shutdown_connections 2023-11-06T13:42:01.368 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.354+0000 7f18e6bd4700 1 -- 172.21.15.38:0/2426372270 wait complete. 2023-11-06T13:42:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.356+0000 7f18e6bd4700 1 Processor -- start 2023-11-06T13:42:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.356+0000 7f18e6bd4700 1 -- start start 2023-11-06T13:42:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e6bd4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc004690 0x7f18e00c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.371 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e6bd4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 0x7f18e01723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e6bd4700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18e01728c0 0x7f18e0190970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e6bd4700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01904e0 con 0x7f18e00c66e0 2023-11-06T13:42:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e6bd4700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0172d20 con 0x7f18e01728c0 2023-11-06T13:42:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e6bd4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0181430 con 0x7f18cc004690 2023-11-06T13:42:01.372 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 0x7f18e01723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 0x7f18e01723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53422/0 (socket says 172.21.15.38:53422) 2023-11-06T13:42:01.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 -- 172.21.15.38:0/1338080422 learned_addr learned my addr 172.21.15.38:0/1338080422 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:01.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e4970700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc004690 0x7f18e00c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.373 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e5171700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18e01728c0 0x7f18e0190970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 -- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc004690 msgr2=0x7f18e00c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc004690 0x7f18e00c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 -- 172.21.15.38:0/1338080422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18e01728c0 msgr2=0x7f18e0190970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18e01728c0 0x7f18e0190970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.374 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 -- 172.21.15.38:0/1338080422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0181710 con 0x7f18e00c66e0 2023-11-06T13:42:01.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e4970700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc004690 0x7f18e00c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-06T13:42:01.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18e5171700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18e01728c0 0x7f18e0190970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:42:01.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dffff700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 0x7f18e01723d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f18cc00beb0 tx=0x7f18c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.357+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8007ea0 con 0x7f18e00c66e0 2023-11-06T13:42:01.375 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.358+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c80068b0 con 0x7f18e00c66e0 2023-11-06T13:42:01.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.358+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e01819f0 con 0x7f18e00c66e0 2023-11-06T13:42:01.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.358+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8006c70 con 0x7f18e00c66e0 2023-11-06T13:42:01.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.358+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0190e60 con 0x7f18e00c66e0 2023-11-06T13:42:01.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.358+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0181c30 con 0x7f18e00c66e0 2023-11-06T13:42:01.376 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.359+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f18c8019070 con 0x7f18e00c66e0 2023-11-06T13:42:01.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.360+0000 7f18dcff9700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f18c008cb40 0x7f18c008f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.360+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f18c80b2e10 con 0x7f18e00c66e0 2023-11-06T13:42:01.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.360+0000 7f18e4970700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f18c008cb40 0x7f18c008f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.361+0000 7f18e4970700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f18c008cb40 0x7f18c008f000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f18d0009c60 tx=0x7f18d0008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.377 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.364+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f18e0181c30 con 0x7f18e00c66e0 2023-11-06T13:42:01.543 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.540+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f18e0190620 con 0x7f18e00c66e0 2023-11-06T13:42:01.544 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.540+0000 7f18dcff9700 1 -- 172.21.15.38:0/1338080422 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v33) v1 ==== 103+0+11 (secure 0 0 0) 0x7f18c80b4030 con 0x7f18e00c66e0 2023-11-06T13:42:01.545 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 32 2023-11-06T13:42:01.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f18c008cb40 msgr2=0x7f18c008f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.546 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f18c008cb40 0x7f18c008f000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f18d0009c60 tx=0x7f18d0008040).stop 2023-11-06T13:42:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 msgr2=0x7f18e01723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 0x7f18e01723d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f18cc00beb0 tx=0x7f18c8015000).stop 2023-11-06T13:42:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 shutdown_connections 2023-11-06T13:42:01.547 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f18c008cb40 0x7f18c008f000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18e01728c0 0x7f18e0190970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f18cc004690 0x7f18e00c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 --2- 172.21.15.38:0/1338080422 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f18e00c66e0 0x7f18e01723d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 >> 172.21.15.38:0/1338080422 conn(0x7f18e006a970 msgr2=0x7f18e017eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:01.548 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 shutdown_connections 2023-11-06T13:42:01.549 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.542+0000 7f18e6bd4700 1 -- 172.21.15.38:0/1338080422 wait complete. 2023-11-06T13:42:01.558 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-11-06T13:42:01.678 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.674+0000 7f1b0f158700 1 Processor -- start 2023-11-06T13:42:01.679 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.675+0000 7f1b0f158700 1 -- start start 2023-11-06T13:42:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0f158700 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1b08175890 0x7f1b08181130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0f158700 1 --2- >> v2:172.21.15.163:3300/0 conn(0x7f1b08181620 0x7f1b08181a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.681 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0f158700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1b08062770 0x7f1b08062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0f158700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b08180390 con 0x7f1b08062770 2023-11-06T13:42:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0f158700 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080ec070 con 0x7f1b08175890 2023-11-06T13:42:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0f158700 1 -- --> v2:172.21.15.163:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080ec350 con 0x7f1b08181620 2023-11-06T13:42:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1b08062770 0x7f1b08062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.682 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7f1b08062770 0x7f1b08062c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53436/0 (socket says 172.21.15.38:53436) 2023-11-06T13:42:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 -- 172.21.15.38:0/2290843699 learned_addr learned my addr 172.21.15.38:0/2290843699 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0cef4700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.44:3300/0 conn(0x7f1b08175890 0x7f1b08181130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b07fff700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.163:3300/0 conn(0x7f1b08181620 0x7f1b08181a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.683 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 -- 172.21.15.38:0/2290843699 >> v2:172.21.15.163:3300/0 conn(0x7f1b08181620 msgr2=0x7f1b08181a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.163:3300/0 conn(0x7f1b08181620 0x7f1b08181a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 -- 172.21.15.38:0/2290843699 >> v2:172.21.15.44:3300/0 conn(0x7f1b08175890 msgr2=0x7f1b08181130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.44:3300/0 conn(0x7f1b08175890 0x7f1b08181130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 -- 172.21.15.38:0/2290843699 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b08180650 con 0x7f1b08062770 2023-11-06T13:42:01.684 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0cef4700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.44:3300/0 conn(0x7f1b08175890 0x7f1b08181130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-11-06T13:42:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b0d6f5700 1 --2- 172.21.15.38:0/2290843699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b08062c00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f1b08085e90 tx=0x7f1af80090f0).ready entity=mon.0 client_cookie=1be44f79e4aac587 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b077fe700 1 -- 172.21.15.38:0/2290843699 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80058d0 con 0x7f1b08062770 2023-11-06T13:42:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b077fe700 1 -- 172.21.15.38:0/2290843699 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af8005a30 con 0x7f1b08062770 2023-11-06T13:42:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.676+0000 7f1b077fe700 1 -- 172.21.15.38:0/2290843699 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8005db0 con 0x7f1b08062770 2023-11-06T13:42:01.685 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 -- 172.21.15.38:0/2290843699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 msgr2=0x7f1b08062c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 --2- 172.21.15.38:0/2290843699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b08062c00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f1b08085e90 tx=0x7f1af80090f0).stop 2023-11-06T13:42:01.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 -- 172.21.15.38:0/2290843699 shutdown_connections 2023-11-06T13:42:01.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 --2- 172.21.15.38:0/2290843699 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b08062c00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.44:3300/0 conn(0x7f1b08175890 0x7f1b08181130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.686 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 --2- 172.21.15.38:0/2290843699 >> v2:172.21.15.163:3300/0 conn(0x7f1b08181620 0x7f1b08181a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 -- 172.21.15.38:0/2290843699 >> 172.21.15.38:0/2290843699 conn(0x7f1b080f2b00 msgr2=0x7f1b080eeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:01.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 -- 172.21.15.38:0/2290843699 shutdown_connections 2023-11-06T13:42:01.687 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.677+0000 7f1b0f158700 1 -- 172.21.15.38:0/2290843699 wait complete. 2023-11-06T13:42:01.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.678+0000 7f1b0f158700 1 Processor -- start 2023-11-06T13:42:01.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.679+0000 7f1b0f158700 1 -- start start 2023-11-06T13:42:01.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.679+0000 7f1b0f158700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b0817da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.690 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b08175890 0x7f1b08175dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08181620 0x7f1b08177f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0817df40 con 0x7f1b08062770 2023-11-06T13:42:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0817ecf0 con 0x7f1b08175890 2023-11-06T13:42:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0817e170 con 0x7f1b08181620 2023-11-06T13:42:01.691 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b0817da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b0817da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:53440/0 (socket says 172.21.15.38:53440) 2023-11-06T13:42:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 -- 172.21.15.38:0/3289155871 learned_addr learned my addr 172.21.15.38:0/3289155871 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0d6f5700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08181620 0x7f1b08177f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b07fff700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b08175890 0x7f1b08175dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.692 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 -- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08181620 msgr2=0x7f1b08177f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08181620 0x7f1b08177f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 -- 172.21.15.38:0/3289155871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b08175890 msgr2=0x7f1b08175dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b08175890 0x7f1b08175dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 -- 172.21.15.38:0/3289155871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8009350 con 0x7f1b08062770 2023-11-06T13:42:01.693 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0cef4700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b0817da50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f1b0000a400 tx=0x7f1b00007910).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000d650 con 0x7f1b08062770 2023-11-06T13:42:01.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000d7b0 con 0x7f1b08062770 2023-11-06T13:42:01.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0817e450 con 0x7f1b08062770 2023-11-06T13:42:01.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000db30 con 0x7f1b08062770 2023-11-06T13:42:01.694 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.680+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0817ea10 con 0x7f1b08062770 2023-11-06T13:42:01.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.681+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0806c580 con 0x7f1b08062770 2023-11-06T13:42:01.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.682+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7f1b00013070 con 0x7f1b08062770 2023-11-06T13:42:01.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.683+0000 7f1b04ff9700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1af408cb70 0x7f1af408f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:01.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.683+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7f1b000b2b00 con 0x7f1b08062770 2023-11-06T13:42:01.695 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.683+0000 7f1b07fff700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1af408cb70 0x7f1af408f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:01.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.683+0000 7f1b07fff700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1af408cb70 0x7f1af408f030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f1b080ef440 tx=0x7f1afc008040).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:01.696 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.687+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162528 (secure 0 0 0) 0x7f1b00083110 con 0x7f1b08062770 2023-11-06T13:42:01.917 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.914+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f1b08180930 con 0x7f1b08062770 2023-11-06T13:42:01.924 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.921+0000 7f1b04ff9700 1 -- 172.21.15.38:0/3289155871 <== mon.0 v2:172.21.15.38:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v6) v1 ==== 81+0+642556 (secure 0 0 0) 0x7f1b000b2e60 con 0x7f1b08062770 2023-11-06T13:42:01.933 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-11-06T13:42:01.933 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:42:01.933 INFO:teuthology.orchestra.run.smithi038.stdout: "epoch": 6, 2023-11-06T13:42:01.933 INFO:teuthology.orchestra.run.smithi038.stdout: "active_gid": 4103, 2023-11-06T13:42:01.934 INFO:teuthology.orchestra.run.smithi038.stdout: "active_name": "z", 2023-11-06T13:42:01.934 INFO:teuthology.orchestra.run.smithi038.stdout: "active_addrs": { 2023-11-06T13:42:01.934 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-11-06T13:42:01.934 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:01.934 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-11-06T13:42:01.935 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.163:6832", 2023-11-06T13:42:01.935 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 91073 2023-11-06T13:42:01.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.935 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:01.935 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v1", 2023-11-06T13:42:01.936 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.163:6833", 2023-11-06T13:42:01.936 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 91073 2023-11-06T13:42:01.936 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:01.936 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:01.936 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.937 INFO:teuthology.orchestra.run.smithi038.stdout: "active_addr": "172.21.15.163:6833/91073", 2023-11-06T13:42:01.937 INFO:teuthology.orchestra.run.smithi038.stdout: "active_change": "2023-11-06T13:27:27.241694+0000", 2023-11-06T13:42:01.937 INFO:teuthology.orchestra.run.smithi038.stdout: "active_mgr_features": 4540138314316775423, 2023-11-06T13:42:01.937 INFO:teuthology.orchestra.run.smithi038.stdout: "available": true, 2023-11-06T13:42:01.937 INFO:teuthology.orchestra.run.smithi038.stdout: "standbys": [ 2023-11-06T13:42:01.937 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:01.938 INFO:teuthology.orchestra.run.smithi038.stdout: "gid": 4104, 2023-11-06T13:42:01.938 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "x", 2023-11-06T13:42:01.938 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_features": 4540138314316775423, 2023-11-06T13:42:01.938 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2023-11-06T13:42:01.939 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:01.939 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2023-11-06T13:42:01.939 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:01.939 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:01.939 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:01.940 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:01.940 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:01.940 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:01.940 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.940 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.941 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:01.941 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.941 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.941 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.941 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2023-11-06T13:42:01.942 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.942 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.942 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.942 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.942 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:01.943 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.944 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.944 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:01.944 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:01.944 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:01.944 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:01.945 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:01.945 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:01.945 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:01.945 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:01.945 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:01.946 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.946 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.946 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.946 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.946 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:01.947 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:01.947 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:01.947 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.947 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.948 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:01.948 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.948 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.948 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.948 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:01.949 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.949 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.949 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.949 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:01.950 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:01.950 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.950 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.950 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.950 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:01.951 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.951 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.951 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:01.951 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:01.951 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:01.951 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:01.952 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:01.952 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:01.952 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:01.952 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:01.952 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.953 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:01.954 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:01.954 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:01.954 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.954 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.954 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:01.955 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.955 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.955 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.955 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:01.955 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.956 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.956 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.956 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2023-11-06T13:42:01.956 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2023-11-06T13:42:01.957 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.957 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.957 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.957 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:01.957 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.957 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.958 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.958 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to", 2023-11-06T13:42:01.958 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.958 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.958 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.959 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2023-11-06T13:42:01.959 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2023-11-06T13:42:01.959 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.959 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.960 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.960 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2023-11-06T13:42:01.960 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.960 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.960 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.961 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2023-11-06T13:42:01.961 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.961 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.961 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.961 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.962 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2023-11-06T13:42:01.962 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2023-11-06T13:42:01.962 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.962 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.962 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.963 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:01.963 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.963 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.963 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.963 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2023-11-06T13:42:01.964 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.964 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.964 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.964 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.964 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2023-11-06T13:42:01.965 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2023-11-06T13:42:01.965 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.965 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.965 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.965 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:01.965 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.966 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.966 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.966 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2023-11-06T13:42:01.966 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.966 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.967 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.967 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.967 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2023-11-06T13:42:01.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2023-11-06T13:42:01.967 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:01.968 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.968 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.968 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2023-11-06T13:42:01.968 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.968 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.969 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.969 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2023-11-06T13:42:01.969 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.969 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.969 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.970 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.970 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2023-11-06T13:42:01.970 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2023-11-06T13:42:01.970 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.970 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2023-11-06T13:42:01.972 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.972 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.972 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.972 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.973 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2023-11-06T13:42:01.973 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2023-11-06T13:42:01.973 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:01.973 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.973 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.974 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:01.974 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.974 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.974 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.974 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-06T13:42:01.975 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.975 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.975 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.975 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.975 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2023-11-06T13:42:01.975 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2023-11-06T13:42:01.976 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.976 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.976 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.976 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:01.976 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.977 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.977 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.977 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2023-11-06T13:42:01.977 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.977 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.978 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.978 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:01.978 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:01.978 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.978 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:01.979 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2023-11-06T13:42:01.979 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:01.979 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:01.979 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:01.979 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2023-11-06T13:42:01.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2023-11-06T13:42:01.980 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:01.980 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.980 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.980 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:01.981 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.981 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.981 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.981 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2023-11-06T13:42:01.981 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.982 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.982 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.982 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.982 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2023-11-06T13:42:01.982 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2023-11-06T13:42:01.982 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.983 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.983 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2023-11-06T13:42:01.983 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.983 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.984 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.984 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2023-11-06T13:42:01.984 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-06T13:42:01.984 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.984 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.985 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2023-11-06T13:42:01.985 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2023-11-06T13:42:01.985 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:01.985 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.986 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.986 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:01.986 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2023-11-06T13:42:01.986 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "7", 2023-11-06T13:42:01.986 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.987 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-06T13:42:01.987 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-11-06T13:42:01.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.987 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.987 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.988 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2023-11-06T13:42:01.988 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2023-11-06T13:42:01.988 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:01.988 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.988 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.988 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2023-11-06T13:42:01.989 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2023-11-06T13:42:01.989 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2023-11-06T13:42:01.989 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.989 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-06T13:42:01.989 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:01.990 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.990 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.990 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2023-11-06T13:42:01.990 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2023-11-06T13:42:01.991 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.991 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.991 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.991 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2023-11-06T13:42:01.991 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.992 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.992 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.992 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-06T13:42:01.992 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-06T13:42:01.992 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.993 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.993 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.993 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2023-11-06T13:42:01.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2023-11-06T13:42:01.993 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:01.993 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.994 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.994 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2023-11-06T13:42:01.994 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2023-11-06T13:42:01.994 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2023-11-06T13:42:01.994 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.995 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2023-11-06T13:42:01.995 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-06T13:42:01.995 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.995 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.995 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.996 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2023-11-06T13:42:01.996 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2023-11-06T13:42:01.996 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:01.996 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.996 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.997 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2400", 2023-11-06T13:42:01.997 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:01.997 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:01.997 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:01.997 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2023-11-06T13:42:01.998 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-06T13:42:01.998 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:01.998 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:01.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:01.998 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2023-11-06T13:42:01.999 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2023-11-06T13:42:01.999 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:01.999 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:01.999 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:01.999 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2023-11-06T13:42:02.000 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2023-11-06T13:42:02.000 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "7", 2023-11-06T13:42:02.000 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.000 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-06T13:42:02.000 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-11-06T13:42:02.001 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.001 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.001 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.001 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.001 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.002 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.002 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.002 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.002 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.002 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.003 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.003 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.003 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.003 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.003 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.004 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.004 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.004 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.004 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.004 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.005 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.005 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.005 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.005 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.005 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.005 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.006 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.006 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.006 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.006 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.007 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.007 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.007 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.007 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.007 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.008 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.008 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.008 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.009 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.009 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.009 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.009 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.009 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.009 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.010 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.010 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.010 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.010 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.011 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.012 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.012 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.012 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.012 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.013 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.013 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.013 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.013 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.013 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.014 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.014 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.014 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.014 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.014 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.014 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.015 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.015 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2023-11-06T13:42:02.015 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2023-11-06T13:42:02.015 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:02.015 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.016 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.016 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:02.016 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.016 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.016 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.017 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-06T13:42:02.017 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.017 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.017 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.017 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.017 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2023-11-06T13:42:02.018 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2023-11-06T13:42:02.018 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.018 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.018 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.018 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2023-11-06T13:42:02.019 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.019 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.019 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.019 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2023-11-06T13:42:02.019 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2023-11-06T13:42:02.020 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap" 2023-11-06T13:42:02.020 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.020 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2023-11-06T13:42:02.020 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.020 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.021 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.021 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.021 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2023-11-06T13:42:02.021 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2023-11-06T13:42:02.021 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.021 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.022 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.022 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.022 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.022 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.022 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.023 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-06T13:42:02.023 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.023 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.023 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.024 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:02.024 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:02.024 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.024 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.024 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.025 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:02.025 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.025 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.025 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.025 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-06T13:42:02.025 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.026 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.026 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.026 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2023-11-06T13:42:02.026 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2023-11-06T13:42:02.027 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.027 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.027 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.027 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:02.027 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2023-11-06T13:42:02.028 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.028 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.028 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-06T13:42:02.028 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-06T13:42:02.028 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.029 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.029 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2023-11-06T13:42:02.029 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2023-11-06T13:42:02.029 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:02.029 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.030 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.030 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.030 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.030 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.030 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.031 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-06T13:42:02.031 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.031 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.031 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.031 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.032 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.032 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.032 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.032 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2023-11-06T13:42:02.032 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.033 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.033 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.033 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2023-11-06T13:42:02.033 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2023-11-06T13:42:02.033 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.034 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.034 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.034 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.034 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.034 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.034 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.035 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-06T13:42:02.035 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-06T13:42:02.035 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.035 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.035 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.036 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2023-11-06T13:42:02.036 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2023-11-06T13:42:02.036 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.036 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.036 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.037 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:02.037 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.037 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.037 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.037 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-06T13:42:02.037 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.038 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.038 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.038 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.038 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2023-11-06T13:42:02.038 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2023-11-06T13:42:02.039 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:02.039 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.039 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.039 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2023-11-06T13:42:02.039 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.040 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.040 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.040 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-06T13:42:02.040 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.040 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.041 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.041 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.041 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2023-11-06T13:42:02.041 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2023-11-06T13:42:02.041 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.042 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.042 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.042 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.042 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.042 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.043 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.043 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-06T13:42:02.043 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.043 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.043 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2023-11-06T13:42:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2023-11-06T13:42:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.045 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.045 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.045 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.045 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.045 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.046 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-06T13:42:02.046 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.046 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.046 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.046 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.047 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2023-11-06T13:42:02.047 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2023-11-06T13:42:02.047 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.047 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.047 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.048 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.23.0", 2023-11-06T13:42:02.048 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.048 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.048 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.048 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2023-11-06T13:42:02.049 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2023-11-06T13:42:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-06T13:42:02.050 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.051 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.051 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.051 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2023-11-06T13:42:02.051 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.051 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.052 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.052 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.052 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2023-11-06T13:42:02.052 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2023-11-06T13:42:02.052 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.053 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.053 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.053 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph-grafana:8.3.5", 2023-11-06T13:42:02.053 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.053 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.055 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.055 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2023-11-06T13:42:02.055 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2023-11-06T13:42:02.055 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.055 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/library/haproxy:2.3", 2023-11-06T13:42:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2023-11-06T13:42:02.057 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.057 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.057 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.057 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.057 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2023-11-06T13:42:02.058 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2023-11-06T13:42:02.058 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.058 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.058 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.058 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/arcts/keepalived", 2023-11-06T13:42:02.059 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.059 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.059 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.059 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2023-11-06T13:42:02.060 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.060 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.060 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.060 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.060 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2023-11-06T13:42:02.060 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2023-11-06T13:42:02.061 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.061 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.061 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.061 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.3.1", 2023-11-06T13:42:02.061 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.062 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.062 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.062 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:02.062 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.062 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.063 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.063 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.063 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2023-11-06T13:42:02.063 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2023-11-06T13:42:02.063 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.064 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.064 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.064 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.33.4", 2023-11-06T13:42:02.064 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.064 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.065 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.065 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:02.065 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.065 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.065 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.066 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2023-11-06T13:42:02.066 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2023-11-06T13:42:02.066 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.066 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.067 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.067 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-06T13:42:02.067 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.067 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.067 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.068 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2023-11-06T13:42:02.068 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.068 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.068 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.068 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.069 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2023-11-06T13:42:02.069 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2023-11-06T13:42:02.069 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.069 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.069 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.070 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.070 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.070 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.070 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.070 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2023-11-06T13:42:02.071 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.071 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.071 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.071 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2023-11-06T13:42:02.072 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2023-11-06T13:42:02.072 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.072 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.072 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.072 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:02.073 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.073 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.073 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.073 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-06T13:42:02.073 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.074 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.074 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.074 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.074 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2023-11-06T13:42:02.075 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2023-11-06T13:42:02.075 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.075 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.075 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.075 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2023-11-06T13:42:02.076 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.076 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.076 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.076 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-06T13:42:02.076 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.077 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.077 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.077 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.077 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2023-11-06T13:42:02.077 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2023-11-06T13:42:02.078 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.078 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.078 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.078 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2023-11-06T13:42:02.078 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.079 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.079 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.079 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2023-11-06T13:42:02.079 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.079 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.079 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.080 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.080 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2023-11-06T13:42:02.080 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2023-11-06T13:42:02.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.080 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.081 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.081 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.081 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.081 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.081 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.082 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-06T13:42:02.082 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.082 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.082 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.083 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2023-11-06T13:42:02.083 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2023-11-06T13:42:02.083 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.083 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.083 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.084 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:02.084 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.084 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.084 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.084 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2023-11-06T13:42:02.085 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.085 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.085 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.085 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2023-11-06T13:42:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2023-11-06T13:42:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:02.086 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.087 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.087 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.087 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2023-11-06T13:42:02.087 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.087 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.088 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.088 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.088 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.088 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.089 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.089 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.089 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.089 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.089 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.090 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.090 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.090 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.090 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.090 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.091 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.091 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.091 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.091 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.091 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.091 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.092 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.092 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.092 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.093 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.093 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.093 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.093 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.093 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.094 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.094 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-06T13:42:02.094 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.094 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.094 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.095 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.095 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.095 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.095 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.096 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.096 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.096 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.096 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.096 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.096 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.097 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.097 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.097 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.097 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.097 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.098 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.098 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.098 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.098 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.098 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.099 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.099 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.099 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.099 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.099 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.100 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.100 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.100 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.100 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.101 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.101 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.101 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.101 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.101 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-06T13:42:02.102 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-06T13:42:02.102 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.102 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.102 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.102 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.103 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.103 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.103 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.103 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-06T13:42:02.103 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.104 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.104 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.104 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-06T13:42:02.104 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-06T13:42:02.105 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.105 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.105 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.105 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2023-11-06T13:42:02.105 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.106 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.106 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.106 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-06T13:42:02.106 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.106 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.107 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2023-11-06T13:42:02.107 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2023-11-06T13:42:02.107 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.108 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.108 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.108 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.108 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.108 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.109 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.109 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2023-11-06T13:42:02.109 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.109 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2023-11-06T13:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2023-11-06T13:42:02.110 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.111 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.111 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.111 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.111 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.111 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.112 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.112 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-06T13:42:02.112 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.112 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.112 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.113 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.113 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2023-11-06T13:42:02.113 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2023-11-06T13:42:02.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.113 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.114 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.114 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.114 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.114 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.114 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.115 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2023-11-06T13:42:02.115 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.115 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.115 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.116 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2023-11-06T13:42:02.116 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2023-11-06T13:42:02.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.116 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2023-11-06T13:42:02.117 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.117 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.117 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.117 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2023-11-06T13:42:02.117 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2023-11-06T13:42:02.118 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.118 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2023-11-06T13:42:02.118 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.118 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.118 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.119 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2023-11-06T13:42:02.119 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2023-11-06T13:42:02.119 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.119 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.120 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.120 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-06T13:42:02.120 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.120 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.120 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.120 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-06T13:42:02.121 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.121 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.121 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.121 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.121 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2023-11-06T13:42:02.122 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2023-11-06T13:42:02.122 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.122 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.122 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.122 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.123 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.123 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.123 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.123 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-06T13:42:02.123 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.123 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.124 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.124 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.124 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2023-11-06T13:42:02.124 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2023-11-06T13:42:02.124 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.125 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.125 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.125 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.125 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.125 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-06T13:42:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.126 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.127 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2023-11-06T13:42:02.127 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2023-11-06T13:42:02.127 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.127 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.127 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.128 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.128 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.128 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.128 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.128 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-06T13:42:02.129 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.129 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.129 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.129 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2023-11-06T13:42:02.130 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2023-11-06T13:42:02.130 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.130 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.130 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.130 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.131 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.131 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.131 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.131 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-06T13:42:02.131 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.132 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.132 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.132 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.132 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2023-11-06T13:42:02.132 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2023-11-06T13:42:02.133 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.133 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.133 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.133 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.133 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.133 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.134 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.134 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-06T13:42:02.134 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.134 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.134 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.135 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.135 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2023-11-06T13:42:02.135 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2023-11-06T13:42:02.135 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.135 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.136 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.136 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.136 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.136 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.136 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-06T13:42:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.137 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2023-11-06T13:42:02.138 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2023-11-06T13:42:02.138 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.138 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.138 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.138 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.139 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.139 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.139 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.139 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2023-11-06T13:42:02.139 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.140 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.140 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.140 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.140 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2023-11-06T13:42:02.140 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2023-11-06T13:42:02.140 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.141 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.141 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.141 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.141 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.141 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.142 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.142 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-06T13:42:02.142 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.142 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.142 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.143 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2023-11-06T13:42:02.143 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2023-11-06T13:42:02.143 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.143 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.144 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.144 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.144 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.144 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.145 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-06T13:42:02.145 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.145 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.145 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.145 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.145 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.146 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.146 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2023-11-06T13:42:02.146 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.146 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.147 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.147 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.147 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.147 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.147 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.148 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.148 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.148 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.148 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.148 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.149 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.149 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.149 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.149 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.149 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.150 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.150 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.150 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.150 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.150 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.151 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.151 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.151 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.151 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.151 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.152 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.152 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.152 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.152 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.152 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.153 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.153 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.153 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.153 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.153 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.153 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.154 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.154 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.154 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.154 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.154 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.155 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.155 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.155 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.155 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.155 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.156 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.156 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.156 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.156 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.156 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.157 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.157 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.157 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.157 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.157 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.158 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.158 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.158 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.158 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.159 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.160 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.160 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.160 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.160 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2023-11-06T13:42:02.161 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2023-11-06T13:42:02.161 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.161 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.161 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.161 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2023-11-06T13:42:02.162 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.162 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.162 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.162 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-06T13:42:02.162 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.163 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.163 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.163 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2023-11-06T13:42:02.163 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2023-11-06T13:42:02.164 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.164 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.164 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2023-11-06T13:42:02.164 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.164 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.165 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.165 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-06T13:42:02.165 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.165 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.165 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.166 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.166 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.166 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2023-11-06T13:42:02.167 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.167 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.167 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.167 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-06T13:42:02.167 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-06T13:42:02.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.168 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.168 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.168 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.168 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.168 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.169 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.169 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.169 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.169 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.169 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.170 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2023-11-06T13:42:02.170 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-06T13:42:02.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.174 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.174 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.174 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.174 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.175 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.175 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.175 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.175 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.175 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.176 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.176 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-06T13:42:02.176 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-06T13:42:02.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.177 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.177 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.177 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.177 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.178 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.178 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.178 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.178 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.178 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.179 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.179 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2023-11-06T13:42:02.179 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2023-11-06T13:42:02.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.180 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.180 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.180 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.180 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.180 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.181 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.181 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.181 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.181 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.181 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.182 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-06T13:42:02.182 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-06T13:42:02.182 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.183 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.183 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.183 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.183 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.183 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.184 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.184 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.184 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.184 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.184 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.185 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2023-11-06T13:42:02.185 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-06T13:42:02.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.185 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.186 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.186 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.186 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.186 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.187 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.188 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.188 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-06T13:42:02.188 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-06T13:42:02.188 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.188 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.189 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.189 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.189 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.189 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.189 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.190 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.190 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.190 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.190 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.190 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.191 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-06T13:42:02.191 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-06T13:42:02.191 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.191 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.191 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.192 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.192 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.192 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.192 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.192 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.193 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.193 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.193 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.193 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.193 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-06T13:42:02.194 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-06T13:42:02.194 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.194 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.194 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.194 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.195 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.195 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.195 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.195 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.195 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.196 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.196 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.196 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-06T13:42:02.196 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-06T13:42:02.197 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.197 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.197 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.197 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.197 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.198 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.198 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.198 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.198 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.198 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.199 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.199 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-06T13:42:02.199 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-06T13:42:02.199 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.200 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.200 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.200 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.200 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.200 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.201 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.201 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.201 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.201 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.201 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.202 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-06T13:42:02.202 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-06T13:42:02.202 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.202 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.203 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.203 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.203 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.203 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.203 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.205 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-06T13:42:02.205 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-06T13:42:02.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.205 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.205 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.206 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.206 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.206 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.206 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.207 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.207 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.207 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.207 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.208 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2023-11-06T13:42:02.208 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-06T13:42:02.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.208 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.209 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.209 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:02.209 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.209 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.209 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.210 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.210 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.210 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.210 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.210 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.211 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-06T13:42:02.211 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-06T13:42:02.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.211 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.211 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.212 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.212 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.212 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.212 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.212 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.213 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.213 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.213 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.213 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.213 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2023-11-06T13:42:02.214 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2023-11-06T13:42:02.214 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.214 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.214 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.214 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.215 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.215 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.215 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.215 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.215 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.216 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.216 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.216 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2023-11-06T13:42:02.216 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-06T13:42:02.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.217 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.217 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.217 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:02.217 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.218 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.218 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.218 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.218 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.218 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.219 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.219 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-06T13:42:02.219 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-06T13:42:02.219 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.220 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.220 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.220 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.220 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.220 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.221 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.221 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.221 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.221 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.221 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.222 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-06T13:42:02.222 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-06T13:42:02.222 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.222 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.223 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.223 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.223 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.223 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.223 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.224 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.224 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.224 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.224 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.225 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.225 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-06T13:42:02.225 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-06T13:42:02.225 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.225 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.225 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.226 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.226 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.226 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.226 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.227 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.227 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.227 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.227 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.227 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.228 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2023-11-06T13:42:02.228 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-06T13:42:02.228 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.228 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.229 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.229 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.229 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.229 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.229 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.229 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.230 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.230 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.230 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-06T13:42:02.231 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-06T13:42:02.231 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.231 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.231 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.231 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.232 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.232 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.232 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.232 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.232 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.233 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.233 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.233 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-06T13:42:02.233 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-06T13:42:02.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.234 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.234 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.234 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.234 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.235 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.235 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.235 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.235 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.235 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.236 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.236 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.236 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-06T13:42:02.236 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-06T13:42:02.236 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.237 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.237 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.237 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.237 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.237 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.238 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.238 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.238 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.238 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.239 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.239 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-06T13:42:02.239 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-06T13:42:02.239 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.240 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.240 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.240 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.240 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.240 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.240 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.241 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.241 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.241 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.241 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.242 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-06T13:42:02.242 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-06T13:42:02.242 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.242 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.242 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.243 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.243 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.243 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.243 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.243 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.244 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.244 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.245 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-06T13:42:02.245 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-06T13:42:02.245 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.245 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.245 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.246 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.246 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.246 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.246 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.246 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.247 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.247 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.247 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.247 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.247 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-06T13:42:02.248 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-06T13:42:02.248 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.248 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.248 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.248 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.249 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.249 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.249 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.249 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.249 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.250 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.250 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.250 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.250 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-06T13:42:02.250 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-06T13:42:02.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.251 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.251 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.251 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.251 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.252 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.252 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.252 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.252 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.252 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.253 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.253 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.253 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2023-11-06T13:42:02.253 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-06T13:42:02.253 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.254 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.254 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.254 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.254 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.254 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.255 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.255 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.255 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.255 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.255 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.256 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-06T13:42:02.256 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-06T13:42:02.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.256 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.257 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.257 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-06T13:42:02.257 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.257 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.257 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.258 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.258 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.258 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.258 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.259 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-06T13:42:02.259 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-06T13:42:02.259 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.259 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.259 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.260 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.260 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.260 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.260 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.260 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.261 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.261 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.261 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.261 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.261 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-06T13:42:02.262 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-06T13:42:02.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.262 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.262 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.262 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2023-11-06T13:42:02.263 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.263 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.263 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.263 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.263 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.264 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.264 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.264 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.264 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-06T13:42:02.264 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-06T13:42:02.265 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.265 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.265 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.265 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2023-11-06T13:42:02.265 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.266 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.266 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.266 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.266 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.266 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.267 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.267 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.267 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2023-11-06T13:42:02.267 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-06T13:42:02.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.268 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.268 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.268 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.268 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.268 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.269 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.269 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.269 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.269 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.269 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.270 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-06T13:42:02.270 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-06T13:42:02.270 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.270 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.271 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.271 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:02.271 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.271 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.271 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.272 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.272 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.272 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.272 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.273 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2023-11-06T13:42:02.273 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-06T13:42:02.273 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.273 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.273 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.274 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.274 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.274 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.274 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.274 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.275 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.275 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.275 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.275 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.275 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2023-11-06T13:42:02.276 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-06T13:42:02.276 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.276 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.276 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.276 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.277 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.277 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.277 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.277 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.277 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.278 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.278 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.278 INFO:teuthology.orchestra.run.smithi038.stdout: "UNSAFE_TLS_v1_2": { 2023-11-06T13:42:02.278 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-06T13:42:02.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.279 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.279 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.279 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.279 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.280 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.280 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.280 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.280 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.280 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.281 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.281 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-06T13:42:02.281 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-06T13:42:02.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.282 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.282 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.282 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:02.282 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.282 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.283 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.283 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.283 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.283 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.284 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-06T13:42:02.284 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-06T13:42:02.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.284 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.285 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.285 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.285 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.285 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.286 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.286 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.286 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.286 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.287 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-06T13:42:02.287 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-06T13:42:02.287 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.287 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.288 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.288 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:02.288 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.288 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.289 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.289 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.289 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.289 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.289 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.290 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2023-11-06T13:42:02.290 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2023-11-06T13:42:02.290 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.290 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.291 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.291 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.291 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.291 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.292 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.292 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.292 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.292 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.293 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2023-11-06T13:42:02.293 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2023-11-06T13:42:02.293 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.293 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.293 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.294 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.294 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.294 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.294 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.294 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.295 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.295 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.295 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.295 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2023-11-06T13:42:02.296 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2023-11-06T13:42:02.296 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.296 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.296 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.296 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.297 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.297 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.297 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.297 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2023-11-06T13:42:02.297 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.298 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.298 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.298 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2023-11-06T13:42:02.298 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2023-11-06T13:42:02.299 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.299 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.299 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.299 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2023-11-06T13:42:02.299 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.300 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.300 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.300 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.300 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.300 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.301 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.301 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2023-11-06T13:42:02.301 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2023-11-06T13:42:02.301 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.302 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.302 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.302 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.302 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.302 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.303 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.303 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.303 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.303 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.303 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.304 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.304 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.304 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.304 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.305 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.305 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.305 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.305 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.305 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.306 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.306 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.306 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.306 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.306 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.307 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.307 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.307 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.307 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.307 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.308 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.308 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.308 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.308 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.309 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.309 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.309 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.309 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.309 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.310 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.310 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.310 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.310 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.310 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.311 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.312 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.312 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.312 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.312 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.312 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.313 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.313 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.313 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.313 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.313 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.314 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.315 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.316 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.316 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.316 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.316 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.316 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.317 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.317 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.317 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.317 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.318 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2023-11-06T13:42:02.318 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2023-11-06T13:42:02.318 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.318 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.319 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.319 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.319 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.319 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.319 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.320 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2023-11-06T13:42:02.320 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.320 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.320 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.320 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2023-11-06T13:42:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2023-11-06T13:42:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.321 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.322 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.322 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.322 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.322 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.323 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.323 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.323 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.323 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:02.324 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:02.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.324 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.324 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.324 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2023-11-06T13:42:02.325 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.325 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.325 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.325 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.325 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.326 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.326 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.326 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.326 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:02.326 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:02.327 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.327 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.327 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.327 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2023-11-06T13:42:02.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.328 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.328 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.328 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.328 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.328 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.329 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.329 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.329 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2023-11-06T13:42:02.329 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2023-11-06T13:42:02.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.330 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.330 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.330 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.330 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.330 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.331 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.331 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.331 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.331 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.331 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.332 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.332 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2023-11-06T13:42:02.332 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2023-11-06T13:42:02.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.332 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.333 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.333 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2023-11-06T13:42:02.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.333 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.333 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.334 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.334 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.334 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.334 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.335 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2023-11-06T13:42:02.335 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2023-11-06T13:42:02.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.335 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.335 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.336 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2023-11-06T13:42:02.336 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.336 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.336 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.337 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.337 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2023-11-06T13:42:02.337 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.337 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.337 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.338 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.338 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.338 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2023-11-06T13:42:02.338 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2023-11-06T13:42:02.339 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.339 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.339 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.339 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2023-11-06T13:42:02.339 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2023-11-06T13:42:02.340 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2023-11-06T13:42:02.340 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.340 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.340 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.341 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.341 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2023-11-06T13:42:02.341 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2023-11-06T13:42:02.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.342 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.342 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.342 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.342 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.342 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.343 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.343 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.343 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.343 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.343 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.343 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.344 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2023-11-06T13:42:02.344 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.345 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.345 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.345 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2023-11-06T13:42:02.345 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2023-11-06T13:42:02.345 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.346 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.346 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.346 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.346 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.346 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.347 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.347 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2023-11-06T13:42:02.347 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.347 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.347 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.348 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.348 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.348 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.348 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.349 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.349 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.349 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.349 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.349 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.350 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.350 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.350 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.350 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.350 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.351 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.351 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.351 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.351 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.351 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.352 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.352 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.352 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.353 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.353 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.353 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.353 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.354 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.354 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.354 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.354 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.354 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.355 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.355 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.355 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.356 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.356 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.356 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.356 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.357 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.357 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.357 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.357 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.357 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.358 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.358 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.358 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.358 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.358 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.359 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.359 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.359 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.359 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.359 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.360 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.360 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.360 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.360 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.360 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.361 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.361 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.361 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.361 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.361 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.362 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.362 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2023-11-06T13:42:02.362 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2023-11-06T13:42:02.362 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.363 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.363 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.363 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2023-11-06T13:42:02.363 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.363 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.364 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.364 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-06T13:42:02.364 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.364 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.364 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.364 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.365 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2023-11-06T13:42:02.365 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2023-11-06T13:42:02.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.365 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.366 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.366 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2023-11-06T13:42:02.366 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.366 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.366 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.367 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-06T13:42:02.367 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.367 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.367 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.367 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.368 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2023-11-06T13:42:02.368 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2023-11-06T13:42:02.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.368 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.368 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.368 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2023-11-06T13:42:02.369 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.369 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.369 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.369 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2023-11-06T13:42:02.369 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.370 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.370 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.370 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2023-11-06T13:42:02.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2023-11-06T13:42:02.371 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.371 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.371 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.371 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2023-11-06T13:42:02.372 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.372 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.372 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.372 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-06T13:42:02.372 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.373 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.373 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.373 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.373 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2023-11-06T13:42:02.373 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2023-11-06T13:42:02.374 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.374 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.374 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.374 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.374 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.375 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.375 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.375 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-06T13:42:02.375 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.375 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:02.376 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.377 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.378 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.378 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2023-11-06T13:42:02.378 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.378 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.378 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.379 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.379 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2023-11-06T13:42:02.379 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2023-11-06T13:42:02.379 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.379 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.380 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.380 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2023-11-06T13:42:02.380 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.380 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.380 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.381 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-06T13:42:02.381 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.381 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.381 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.381 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.382 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.382 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.382 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.382 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2023-11-06T13:42:02.382 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.383 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.383 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.383 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.383 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.383 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.384 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.384 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.384 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.384 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.384 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.385 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.385 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.385 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.385 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.385 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.386 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.386 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.386 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.386 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.386 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.387 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.387 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.387 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.387 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.388 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.388 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.388 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.388 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.388 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.389 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.390 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.391 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.392 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.393 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.394 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.395 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.396 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2023-11-06T13:42:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2023-11-06T13:42:02.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2023-11-06T13:42:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.398 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.399 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2023-11-06T13:42:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2023-11-06T13:42:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.400 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.401 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.401 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2023-11-06T13:42:02.401 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.401 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.401 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.402 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.402 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.402 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.402 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.402 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.403 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:02.403 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:02.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.403 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.403 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.404 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:02.404 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.404 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.404 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.404 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.404 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.405 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.405 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.405 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.405 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.405 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.406 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.406 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2023-11-06T13:42:02.406 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2023-11-06T13:42:02.406 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2023-11-06T13:42:02.406 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.407 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2023-11-06T13:42:02.407 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2023-11-06T13:42:02.407 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.407 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.407 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.408 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2023-11-06T13:42:02.408 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.408 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.408 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.409 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.409 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.409 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.409 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.410 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2023-11-06T13:42:02.410 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2023-11-06T13:42:02.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.411 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2023-11-06T13:42:02.411 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.412 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.412 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2023-11-06T13:42:02.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2023-11-06T13:42:02.413 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.413 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.413 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.413 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.414 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.414 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.414 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.414 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.414 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.415 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.415 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.415 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.415 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:02.415 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:02.416 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.416 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.416 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.416 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2023-11-06T13:42:02.416 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.417 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.417 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.417 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.417 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.417 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.418 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.418 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.418 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.419 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.419 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.419 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.419 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.420 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.420 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.420 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.420 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.420 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.421 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.421 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.421 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.421 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.421 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.421 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.422 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.422 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.422 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.423 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.423 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.423 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.423 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.423 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.424 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.424 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.424 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.424 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.424 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.425 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.425 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.425 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.425 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.425 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.426 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.426 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.426 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.426 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.426 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.427 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.427 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.427 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.427 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.427 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.427 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.428 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.428 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.428 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.428 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.428 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.429 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.429 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.429 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.429 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.429 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.430 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.430 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.430 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.430 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.430 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.431 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.431 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.431 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.431 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.432 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.432 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.432 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2023-11-06T13:42:02.432 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2023-11-06T13:42:02.432 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.433 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.433 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.433 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.433 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.433 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.433 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.434 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.434 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.434 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.434 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.435 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.435 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2023-11-06T13:42:02.435 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2023-11-06T13:42:02.435 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.435 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.436 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.436 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2023-11-06T13:42:02.436 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.436 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.436 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.437 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.437 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.437 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.437 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.437 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.438 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2023-11-06T13:42:02.438 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2023-11-06T13:42:02.438 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.438 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.438 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.439 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2023-11-06T13:42:02.439 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.439 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.439 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.439 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.440 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.440 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.440 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.440 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.440 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2023-11-06T13:42:02.441 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2023-11-06T13:42:02.441 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.441 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.441 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.441 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:02.442 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.442 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.442 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.442 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.442 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.443 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.443 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.443 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.443 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2023-11-06T13:42:02.443 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2023-11-06T13:42:02.444 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.444 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.444 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.444 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.444 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.445 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.445 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.445 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.445 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.445 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.446 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.446 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2023-11-06T13:42:02.446 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2023-11-06T13:42:02.446 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.447 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.447 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.447 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2023-11-06T13:42:02.447 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.447 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.448 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.448 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.448 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.448 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.448 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.449 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.449 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.449 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.449 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2023-11-06T13:42:02.450 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.450 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.450 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.450 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.450 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.451 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.451 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.451 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.451 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.451 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.451 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.452 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.452 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.452 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.452 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.452 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.453 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.453 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.453 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.453 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.453 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.454 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.454 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.454 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.454 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.455 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.455 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.455 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.455 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.455 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.456 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.456 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.456 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.456 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.456 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.457 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.457 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.457 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.457 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.457 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.458 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.458 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.458 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.458 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.459 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.459 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.459 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.459 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.459 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.460 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.460 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.460 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.460 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.460 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.461 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.461 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.461 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.461 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.461 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.462 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.462 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.462 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.462 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.463 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.463 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.463 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.463 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.463 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.464 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.464 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.464 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.464 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.464 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.465 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.465 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.465 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2023-11-06T13:42:02.465 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.465 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.466 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.466 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.466 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.466 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.466 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.467 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.467 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.467 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.467 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.468 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.468 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.468 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.468 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.468 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.469 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.469 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.469 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.469 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.469 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.470 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.470 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.470 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.470 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.470 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.471 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.471 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.471 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.471 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.472 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.472 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.472 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.472 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.472 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.473 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.473 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.473 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.473 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.474 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.474 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.474 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.474 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.475 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.475 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.475 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.475 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.476 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.476 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.476 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.476 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.476 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.477 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.477 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.477 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.477 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.477 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.478 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.478 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.478 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.478 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.478 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.479 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.479 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.479 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.479 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.479 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.480 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.480 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.480 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.480 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.480 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.481 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.481 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2023-11-06T13:42:02.481 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.481 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.481 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.482 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2023-11-06T13:42:02.482 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2023-11-06T13:42:02.482 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.482 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.482 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.483 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2023-11-06T13:42:02.483 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.483 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.483 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.483 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2023-11-06T13:42:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.484 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.485 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.485 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.485 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.485 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.485 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.486 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.486 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.486 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.486 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.486 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.487 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.487 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.487 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.487 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.488 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.488 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.488 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.488 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.488 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.488 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.489 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.489 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.489 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.489 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.489 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.490 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.490 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.490 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.490 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.490 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.491 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.491 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.491 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.491 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.492 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.492 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.492 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.492 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.492 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.493 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.493 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.493 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.493 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.493 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.494 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.494 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.494 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.494 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.494 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.495 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.495 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.495 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.495 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.495 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.496 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.496 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.496 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.496 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.496 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.497 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.497 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.497 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.497 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.497 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.498 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.498 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.498 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.498 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2023-11-06T13:42:02.498 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2023-11-06T13:42:02.499 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.499 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.499 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.499 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.499 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.500 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.500 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.500 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2023-11-06T13:42:02.500 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.500 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.501 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.501 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2023-11-06T13:42:02.501 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2023-11-06T13:42:02.501 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.502 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.502 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.502 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2023-11-06T13:42:02.502 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.502 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.503 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.503 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2023-11-06T13:42:02.503 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.503 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.503 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.504 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2023-11-06T13:42:02.504 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2023-11-06T13:42:02.504 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.504 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.504 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.505 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2023-11-06T13:42:02.505 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.505 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.505 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.506 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2023-11-06T13:42:02.506 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.506 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.506 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.506 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2023-11-06T13:42:02.507 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2023-11-06T13:42:02.507 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.507 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.507 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.507 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.508 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.508 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.508 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.508 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2023-11-06T13:42:02.508 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.509 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.509 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.509 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.509 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2023-11-06T13:42:02.509 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2023-11-06T13:42:02.510 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.510 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.510 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.510 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2023-11-06T13:42:02.510 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.511 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.511 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.511 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-06T13:42:02.511 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.511 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.512 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.512 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.512 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.512 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.512 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.513 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2023-11-06T13:42:02.513 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.513 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.513 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.513 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.514 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.514 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.514 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.514 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.514 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.515 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.515 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.515 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.515 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.515 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.516 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.516 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.516 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.516 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.516 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.517 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.517 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.517 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.517 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.517 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.518 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.518 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.518 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.518 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.518 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.519 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.519 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.519 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.519 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.519 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.520 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.520 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.520 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.520 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.520 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.521 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.521 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.521 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.521 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.521 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.522 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.522 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.522 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.522 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.522 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.523 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.523 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.523 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.523 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.523 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.524 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.524 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.524 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.524 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.525 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.525 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.525 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.525 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.526 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.526 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.526 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.526 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.526 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.527 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.527 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.527 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.527 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.527 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.528 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.528 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2023-11-06T13:42:02.528 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.528 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.529 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.529 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.529 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.529 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.529 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.530 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.530 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.530 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.530 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.530 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.531 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.531 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.531 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.531 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.531 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.531 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.532 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.532 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.532 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.532 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.532 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.533 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.533 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.533 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.533 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.534 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.534 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.534 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.534 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.534 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.535 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.535 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.535 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.535 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.535 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.536 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.536 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.536 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.536 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.536 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.537 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.537 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.537 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.537 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.537 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.538 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.538 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.538 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.538 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.538 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.539 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.539 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.539 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.539 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.539 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.540 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.540 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.540 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.540 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.540 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.541 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.541 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.541 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.541 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.541 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.542 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.542 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.542 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.542 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.542 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.543 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.543 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.543 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.543 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.543 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2023-11-06T13:42:02.543 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.544 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.544 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.544 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.544 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.544 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.545 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.545 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.545 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.545 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.545 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.546 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.546 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.546 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.546 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.546 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.547 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.547 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.547 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.547 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.547 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.548 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.548 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.548 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.548 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.548 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.549 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.549 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.549 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.549 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.549 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.550 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.550 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.550 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.550 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.550 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.551 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.551 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.551 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.551 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.551 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.552 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.552 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.552 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.552 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.552 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.553 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.553 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.553 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.553 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.553 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.554 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.554 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.554 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.554 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.554 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.555 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.555 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.555 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.555 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.555 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.556 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.556 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.556 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.556 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.556 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.557 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.557 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.557 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.557 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.557 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.558 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.558 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.558 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.558 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.558 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.559 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2023-11-06T13:42:02.559 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.559 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.559 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.559 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.560 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.560 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.560 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.560 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.561 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.561 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.561 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.562 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.562 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.562 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.562 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.562 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.563 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.563 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.563 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.563 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.563 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.564 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.564 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.564 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.564 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.564 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.565 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.565 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.565 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.565 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.566 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.566 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.566 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.566 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.567 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.567 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.567 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.567 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.567 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.568 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.568 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.568 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.568 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.568 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.569 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.569 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.569 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.569 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.569 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.570 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.570 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.570 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.570 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.570 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.571 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.571 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.571 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.571 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.572 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.572 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.572 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.572 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.572 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.573 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.573 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.573 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.573 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.574 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2023-11-06T13:42:02.574 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2023-11-06T13:42:02.574 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.574 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.574 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.575 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.575 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.575 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.575 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.575 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2023-11-06T13:42:02.576 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2023-11-06T13:42:02.576 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2023-11-06T13:42:02.576 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.576 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2023-11-06T13:42:02.576 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.577 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.577 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.577 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.577 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.577 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.578 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.578 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2023-11-06T13:42:02.578 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.578 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.578 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.579 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.579 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.579 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.579 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.579 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.580 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.580 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.580 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.580 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.580 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.581 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.581 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.581 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.581 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.581 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.582 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.582 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.582 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.582 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.582 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.583 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.583 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.583 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.583 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.583 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.584 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.584 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.584 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.584 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.585 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.585 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.585 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.585 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.585 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.586 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.586 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.586 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.586 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.586 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.587 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.587 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.587 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.587 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.587 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.588 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.588 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.588 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.588 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.588 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.589 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.589 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.589 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.590 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.590 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.590 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.590 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.590 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.591 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.591 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.591 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.591 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.591 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.592 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.592 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.592 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.592 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.592 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.593 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.593 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.593 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2023-11-06T13:42:02.593 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.594 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.594 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.594 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.595 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.595 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.596 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.596 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.596 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.596 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.596 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.597 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.597 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.597 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.597 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.597 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.598 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.598 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.598 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.598 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.599 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.599 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.599 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.599 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.599 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.600 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.600 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.600 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.600 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.600 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.601 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.601 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.601 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.602 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.602 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.602 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.602 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.602 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.603 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.603 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.603 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.603 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.603 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.604 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.604 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.604 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.604 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.604 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.605 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.605 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.605 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.605 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.606 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.606 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.606 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.606 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.607 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.607 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.607 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.607 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.607 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.608 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.608 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.608 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.608 INFO:teuthology.orchestra.run.smithi038.stdout: "noautoscale": { 2023-11-06T13:42:02.608 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "noautoscale", 2023-11-06T13:42:02.609 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.609 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.609 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.609 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.609 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.610 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.610 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.610 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "global autoscale flag", 2023-11-06T13:42:02.610 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-11-06T13:42:02.610 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.611 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.611 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.611 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:02.611 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:02.611 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.612 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.612 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.612 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:02.612 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.612 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.613 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.613 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.613 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.613 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.613 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.614 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.614 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.614 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.614 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.615 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2023-11-06T13:42:02.615 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.615 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.615 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.615 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2023-11-06T13:42:02.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2023-11-06T13:42:02.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.616 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.616 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.617 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.617 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.617 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.618 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.618 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.618 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.618 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.619 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.620 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.620 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.620 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.620 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.620 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.621 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.621 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.621 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.621 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.621 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.622 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.622 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.622 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.623 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.623 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.624 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.624 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.624 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.624 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.625 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.625 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.625 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.625 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.625 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.626 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.626 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.626 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.626 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.627 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.627 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.627 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.627 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.627 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.628 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.628 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.628 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.628 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.628 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.629 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.629 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.629 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.629 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.629 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.630 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.630 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.630 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.630 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.631 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.631 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.631 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.631 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.631 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.631 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.632 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.632 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2023-11-06T13:42:02.632 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2023-11-06T13:42:02.632 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.633 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.633 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.633 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2023-11-06T13:42:02.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.633 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.634 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.634 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2023-11-06T13:42:02.634 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.634 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.634 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.635 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:02.635 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:02.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.635 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.636 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:02.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.636 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.637 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2023-11-06T13:42:02.637 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.637 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.637 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.637 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.638 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.638 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.638 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2023-11-06T13:42:02.638 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.639 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.639 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.639 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2023-11-06T13:42:02.639 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2023-11-06T13:42:02.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.640 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.640 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.640 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.640 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.640 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.641 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.641 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.641 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.641 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.641 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.642 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.642 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.642 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.642 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.643 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.643 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.643 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.643 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.644 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.644 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.644 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.644 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.644 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.645 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.645 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.645 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.645 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.645 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.646 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.646 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.646 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.646 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.646 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.647 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.647 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.647 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.647 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.647 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.648 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.648 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.648 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.648 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.648 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.649 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.649 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.649 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.649 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.649 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.650 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.650 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.650 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.650 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.650 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.651 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.651 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.651 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.651 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.651 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.652 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.653 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.653 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.653 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.653 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.654 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.654 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.654 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.654 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.654 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.655 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.655 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.655 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.655 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.655 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.656 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.656 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2023-11-06T13:42:02.656 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2023-11-06T13:42:02.656 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.656 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.657 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.657 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.657 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.657 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.657 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.658 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.658 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.658 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.658 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.658 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.659 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-06T13:42:02.659 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-06T13:42:02.659 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.659 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.659 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.660 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2023-11-06T13:42:02.660 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.660 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.660 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.660 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.661 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.661 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.661 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.661 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.661 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2023-11-06T13:42:02.662 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2023-11-06T13:42:02.662 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:02.662 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.662 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.662 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2023-11-06T13:42:02.663 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.663 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.663 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.663 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.663 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.664 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.664 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.664 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:02.664 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:02.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.665 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.665 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.665 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.665 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.666 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.666 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.666 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.666 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.666 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.667 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.667 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:02.667 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:02.667 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.668 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.668 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.668 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2023-11-06T13:42:02.668 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.668 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.669 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.669 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-06T13:42:02.669 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.669 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.670 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.670 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2023-11-06T13:42:02.670 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2023-11-06T13:42:02.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.670 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.671 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.671 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2023-11-06T13:42:02.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.671 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.671 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.672 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.672 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.672 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.672 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.673 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2023-11-06T13:42:02.673 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2023-11-06T13:42:02.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.673 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.673 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.674 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2023-11-06T13:42:02.674 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.674 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.674 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.674 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2023-11-06T13:42:02.675 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2023-11-06T13:42:02.675 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.675 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.675 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.675 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.676 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.676 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.676 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2023-11-06T13:42:02.676 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2023-11-06T13:42:02.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.677 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.677 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.677 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2023-11-06T13:42:02.677 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2023-11-06T13:42:02.677 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2023-11-06T13:42:02.678 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.678 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.678 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.678 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.678 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.679 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.679 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.679 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.679 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2023-11-06T13:42:02.680 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.680 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.680 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.680 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.680 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.680 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.681 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.681 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.681 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.681 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.682 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.682 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.682 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.682 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.682 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.683 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.683 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.683 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.683 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.683 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.684 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.684 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.684 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.684 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.684 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.685 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.685 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.685 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.685 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.685 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.686 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.686 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.686 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.686 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.687 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.687 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.687 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.687 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.687 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.688 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.688 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.688 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.688 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.688 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.689 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.689 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.689 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.689 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.689 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.690 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.690 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.690 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.690 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.690 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.691 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.691 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.691 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.691 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.691 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.692 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.692 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.692 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.692 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.693 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.693 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.693 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.694 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.694 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2023-11-06T13:42:02.694 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2023-11-06T13:42:02.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.695 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.695 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.695 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:02.695 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.696 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.696 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.696 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.696 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.697 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.697 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.697 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2023-11-06T13:42:02.697 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2023-11-06T13:42:02.697 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.698 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.698 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.698 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.698 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.698 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.699 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.699 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.699 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.699 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.700 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.700 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2023-11-06T13:42:02.700 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2023-11-06T13:42:02.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.700 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.701 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.701 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.701 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.701 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.701 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.702 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.702 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.702 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.703 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.703 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.703 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2023-11-06T13:42:02.703 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.704 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.704 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.704 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2023-11-06T13:42:02.704 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2023-11-06T13:42:02.704 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.705 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.705 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.705 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.705 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.706 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.706 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.706 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.706 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.706 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.707 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2023-11-06T13:42:02.707 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2023-11-06T13:42:02.707 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.707 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.708 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.708 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.708 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.708 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.708 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.709 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.709 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.709 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.709 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.709 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.710 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.710 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.710 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.710 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.710 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.711 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.711 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.711 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.711 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.711 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.712 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.712 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.712 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.712 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.712 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.712 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.713 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.713 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.713 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.713 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.713 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.714 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.714 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.714 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.714 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.715 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.715 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.715 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.715 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.716 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.716 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.716 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.716 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.717 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.717 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.717 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.718 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.718 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.718 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.718 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.718 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.719 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.719 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.719 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.719 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.719 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.720 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.720 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.720 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.720 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.720 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.721 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.721 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.721 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.721 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.722 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.722 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.722 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.722 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.722 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.723 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.723 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.723 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.723 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:02.724 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:02.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.724 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.724 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.724 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.725 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.725 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.725 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.725 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.725 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.726 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.726 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.726 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:02.726 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:02.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.727 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.727 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.727 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.727 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.728 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.728 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.728 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.728 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.728 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.729 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.729 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.729 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.729 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.729 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2023-11-06T13:42:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.730 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.731 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.731 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.731 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.731 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.731 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.732 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.732 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.732 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.732 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.732 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.733 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.733 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.733 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.733 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.733 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.734 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.734 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.734 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.734 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.735 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.735 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.735 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.736 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.736 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.736 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.736 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.736 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.737 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.737 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.737 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.737 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.738 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.738 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.738 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.738 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.738 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.739 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.740 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.740 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.740 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.740 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.740 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.740 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.741 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.741 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.741 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.741 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.741 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.742 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.742 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.742 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.742 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.742 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.743 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.743 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.743 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.743 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.743 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.744 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.744 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.744 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.744 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.744 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2023-11-06T13:42:02.745 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.745 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.745 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.745 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.745 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.746 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.746 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.746 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.747 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.747 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.747 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.747 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.747 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.747 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.748 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.748 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.748 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.748 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.748 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.749 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.749 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.749 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.749 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.749 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.750 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.750 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.750 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.750 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.751 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.751 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.751 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.751 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.751 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.752 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.752 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.752 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.752 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.752 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.753 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.753 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.753 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.753 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.753 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.754 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.754 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.754 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.754 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.754 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.755 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.755 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.755 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.755 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.755 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.756 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.756 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.756 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.756 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.756 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.757 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.757 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.757 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.757 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.757 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.757 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.758 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.758 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.758 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.758 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.759 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2023-11-06T13:42:02.759 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2023-11-06T13:42:02.759 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.759 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.760 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.760 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.760 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.760 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.760 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.761 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.761 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.761 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.761 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2023-11-06T13:42:02.762 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2023-11-06T13:42:02.762 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.762 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.762 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.762 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2023-11-06T13:42:02.763 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.763 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.763 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.763 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.763 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.764 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.764 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.764 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2023-11-06T13:42:02.764 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2023-11-06T13:42:02.765 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.765 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.765 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.765 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.765 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.766 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.766 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.766 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.766 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.766 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.766 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.767 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.767 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2023-11-06T13:42:02.767 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2023-11-06T13:42:02.767 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.767 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.768 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.768 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.768 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.768 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.768 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.769 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.769 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.769 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.769 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.769 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.770 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2023-11-06T13:42:02.770 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2023-11-06T13:42:02.770 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:02.770 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.770 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.771 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.771 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.771 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.771 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.771 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.772 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.772 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.772 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.772 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2023-11-06T13:42:02.773 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2023-11-06T13:42:02.773 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.773 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.773 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.773 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.774 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.774 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.774 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.774 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.774 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.775 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.775 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.775 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2023-11-06T13:42:02.775 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2023-11-06T13:42:02.775 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.776 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.776 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.776 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.776 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.776 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.777 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.777 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.777 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.777 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2023-11-06T13:42:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2023-11-06T13:42:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.778 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.779 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2023-11-06T13:42:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2023-11-06T13:42:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.781 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.782 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.783 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2023-11-06T13:42:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2023-11-06T13:42:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.784 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.785 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2023-11-06T13:42:02.786 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2023-11-06T13:42:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.787 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.788 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.789 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2023-11-06T13:42:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2023-11-06T13:42:02.790 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2023-11-06T13:42:02.791 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.791 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.791 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.791 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.791 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.792 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.792 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.792 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2023-11-06T13:42:02.792 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.792 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.793 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.793 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.793 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2023-11-06T13:42:02.793 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2023-11-06T13:42:02.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.794 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.794 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.794 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.794 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.795 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.795 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2023-11-06T13:42:02.795 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.795 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.795 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.796 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.796 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.796 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.796 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.797 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.797 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.797 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.797 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.797 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.798 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.798 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.798 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.798 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.798 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.799 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.799 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.799 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.799 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.799 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.799 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.800 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.800 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.800 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.800 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.800 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.801 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.801 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.801 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.801 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.801 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.802 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.802 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.802 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.802 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.803 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.803 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.803 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.803 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.803 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.804 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.805 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.805 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.805 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.805 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.805 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.806 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.806 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.806 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.806 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.806 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.807 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.807 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.807 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.807 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.808 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.808 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.808 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.808 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.808 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.808 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.809 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.809 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.809 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.809 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.810 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.810 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2023-11-06T13:42:02.810 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.810 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.811 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.812 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.812 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.812 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.812 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.812 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.813 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.813 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.813 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.813 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.813 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.814 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.814 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.814 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.814 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.814 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.815 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.815 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.815 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.815 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.816 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.816 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.816 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.816 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.816 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.817 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.817 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.817 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.817 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.818 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.818 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.818 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.819 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.819 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.819 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.819 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.819 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.820 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.820 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.820 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.820 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.820 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.821 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.821 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.821 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.821 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.821 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.822 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.822 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.825 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.826 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.826 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.826 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.827 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.827 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.827 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.827 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.828 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.828 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.828 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.828 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.828 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.829 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.829 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.829 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.830 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2023-11-06T13:42:02.830 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.830 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.830 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.831 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.831 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.831 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.831 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.832 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.832 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.832 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.832 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.833 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.833 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.833 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.833 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.834 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.834 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.834 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.834 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.834 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.835 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.835 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.835 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.836 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.836 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.836 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.837 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.837 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.837 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.837 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.838 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.838 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.838 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.838 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.839 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.839 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.839 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.839 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.840 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.840 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.840 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.841 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.841 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.841 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.841 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.842 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.842 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.842 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.843 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.843 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.843 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.843 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.844 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.844 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.844 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.844 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.845 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.845 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.845 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.845 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.846 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.846 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.846 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.846 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.846 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.847 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.847 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.847 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.847 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.848 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.848 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.848 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.848 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.848 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.849 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2023-11-06T13:42:02.849 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.849 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.849 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.850 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2023-11-06T13:42:02.850 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2023-11-06T13:42:02.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.850 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.850 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.851 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-06T13:42:02.851 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.851 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.851 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.852 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.852 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.852 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.852 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.852 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.853 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:02.853 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:02.853 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.853 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.854 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.854 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2023-11-06T13:42:02.854 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.854 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.855 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.855 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.855 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.855 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.855 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.856 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.856 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.856 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.856 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.857 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.857 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.857 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.857 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.858 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.858 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.858 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.858 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.858 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.859 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.859 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.859 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.859 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.860 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.860 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.860 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.860 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.861 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.861 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.861 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.861 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.862 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.862 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.862 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.862 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.863 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.863 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.863 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.863 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.863 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.864 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.864 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.864 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.864 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.865 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.865 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.865 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.865 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.866 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.866 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.866 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.866 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.867 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.867 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.867 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.867 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.867 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.868 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.868 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.868 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.868 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.869 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.869 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.869 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.869 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.869 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.870 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.870 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.870 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.870 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.871 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.871 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.871 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.872 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.872 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.872 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.872 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2023-11-06T13:42:02.873 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.873 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.873 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.873 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2023-11-06T13:42:02.874 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2023-11-06T13:42:02.874 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.874 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.874 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.875 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.875 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.875 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.875 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.875 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-06T13:42:02.876 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.876 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.876 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.876 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.877 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2023-11-06T13:42:02.877 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2023-11-06T13:42:02.877 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.877 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.877 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.878 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.878 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.878 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.878 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.879 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.879 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.879 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.879 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.880 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2023-11-06T13:42:02.880 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2023-11-06T13:42:02.880 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.880 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.881 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:02.881 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.881 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.881 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.882 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.882 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.882 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.882 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.882 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.883 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2023-11-06T13:42:02.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2023-11-06T13:42:02.883 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.883 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.884 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.884 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.884 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.884 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.884 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.885 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.885 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.885 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.885 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.886 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.886 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2023-11-06T13:42:02.886 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2023-11-06T13:42:02.886 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.887 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.887 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.887 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.887 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.888 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.888 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.888 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.888 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.888 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.889 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.889 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.889 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2023-11-06T13:42:02.889 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2023-11-06T13:42:02.889 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.890 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.890 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.890 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.890 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.891 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.891 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.891 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.891 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.891 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.892 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.892 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.892 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2023-11-06T13:42:02.892 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2023-11-06T13:42:02.893 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.893 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.893 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.893 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-06T13:42:02.894 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.894 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.894 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.894 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.894 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.895 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.895 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.895 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.895 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2023-11-06T13:42:02.896 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2023-11-06T13:42:02.896 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.896 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.896 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.896 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.897 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.897 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.897 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.897 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.898 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.898 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.898 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.898 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.899 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:02.899 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:02.899 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.899 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.899 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.900 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2023-11-06T13:42:02.900 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2023-11-06T13:42:02.900 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.900 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.901 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.901 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.901 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.901 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.902 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.902 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2023-11-06T13:42:02.902 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2023-11-06T13:42:02.902 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.902 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.903 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.903 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2023-11-06T13:42:02.903 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.903 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.904 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.904 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.904 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.904 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.905 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.905 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.905 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2023-11-06T13:42:02.905 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2023-11-06T13:42:02.905 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.906 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.906 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.906 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.906 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.907 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.907 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.907 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.907 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.907 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.908 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.908 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.908 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.908 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.908 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.909 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.909 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.909 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.909 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.910 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.910 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.910 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.910 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.910 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.911 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.911 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.911 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.911 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.912 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.912 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.912 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.912 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.913 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.913 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.913 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.913 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.913 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.914 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.914 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.914 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.914 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.915 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.915 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.915 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.915 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.916 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.916 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.916 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.916 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.917 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.917 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.917 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.918 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.918 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.918 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.918 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.919 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.919 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.919 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.919 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.920 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.920 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.920 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.920 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.921 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.921 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.921 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.921 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.922 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.922 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.922 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.922 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.923 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.923 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.923 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.923 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.924 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.924 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.924 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.924 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.924 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.925 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.925 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2023-11-06T13:42:02.925 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2023-11-06T13:42:02.925 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.926 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.926 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.926 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.926 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.927 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.927 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.927 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.927 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.927 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.928 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.928 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2023-11-06T13:42:02.928 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2023-11-06T13:42:02.928 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.929 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.929 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.929 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:02.929 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.930 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.930 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.930 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.930 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.930 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.931 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.931 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2023-11-06T13:42:02.931 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2023-11-06T13:42:02.932 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.932 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.932 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.932 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-06T13:42:02.933 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.933 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.933 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.933 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.934 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.934 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.934 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.934 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.935 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.935 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.935 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2023-11-06T13:42:02.935 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.936 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.936 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.936 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.936 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.937 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.937 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.937 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.937 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.938 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.938 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.938 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.938 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.938 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.939 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.939 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.939 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.939 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.940 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.940 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.940 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.940 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.940 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.941 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.941 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.941 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.941 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.942 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.942 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.942 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.942 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.943 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.943 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.943 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.943 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.943 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.944 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.944 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.944 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.945 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.945 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.945 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.945 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.945 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.946 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.946 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.946 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.946 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.947 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.947 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.947 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.947 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.948 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.948 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.948 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.948 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.948 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.949 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.949 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.949 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.949 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.949 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.950 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.950 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.950 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.950 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.951 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.951 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.951 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.951 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.951 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.952 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.952 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.952 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.952 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.953 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2023-11-06T13:42:02.953 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.953 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.953 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.953 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.954 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.954 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.954 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.954 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.954 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.955 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.955 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.955 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.955 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.956 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.956 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.956 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.956 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.956 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.957 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.957 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.957 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.957 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.957 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.958 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.958 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.958 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.958 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.959 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.959 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.959 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.959 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.960 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.960 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.960 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.960 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.960 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.961 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.961 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.961 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.961 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.961 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.962 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.962 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.962 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.962 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.963 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.963 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.963 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.963 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.963 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.964 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.964 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.964 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.964 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.965 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.965 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.965 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.965 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.965 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.966 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.966 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.966 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.966 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.966 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.967 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.967 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.967 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.967 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.967 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.968 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.968 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.968 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.968 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.969 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2023-11-06T13:42:02.969 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2023-11-06T13:42:02.969 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.969 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.970 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.970 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2023-11-06T13:42:02.970 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.970 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.970 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.971 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-06T13:42:02.971 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.971 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.971 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.972 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.972 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2023-11-06T13:42:02.972 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2023-11-06T13:42:02.972 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:02.972 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.973 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.973 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:02.973 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.973 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.973 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.974 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-06T13:42:02.974 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.974 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.975 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.975 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.975 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:02.975 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.975 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2023-11-06T13:42:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2023-11-06T13:42:02.976 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2023-11-06T13:42:02.977 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.977 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.977 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.977 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2023-11-06T13:42:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.978 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.979 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2023-11-06T13:42:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2023-11-06T13:42:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.980 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.981 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.982 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.983 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.984 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.985 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.986 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.987 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.988 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.989 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:02.990 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.991 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.992 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:02.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.994 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:02.995 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:02.996 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:02.997 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:02.998 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:02.999 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.000 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.001 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2023-11-06T13:42:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2023-11-06T13:42:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.002 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.003 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2023-11-06T13:42:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2023-11-06T13:42:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.005 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2023-11-06T13:42:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.006 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.007 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2023-11-06T13:42:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2023-11-06T13:42:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.008 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-06T13:42:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.009 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.010 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.011 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "gid": 4111, 2023-11-06T13:42:03.012 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "y", 2023-11-06T13:42:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "mgr_features": 4540138314316775423, 2023-11-06T13:42:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2023-11-06T13:42:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.013 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2023-11-06T13:42:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:03.014 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.015 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2023-11-06T13:42:03.016 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.017 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.018 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.019 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.020 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.021 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.022 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.023 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.024 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.025 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.026 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.027 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.028 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.029 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.030 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.030 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.030 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.030 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.033 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.033 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.034 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.034 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.034 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.035 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.035 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.035 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.035 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.036 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.036 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.036 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.036 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.036 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2023-11-06T13:42:03.037 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2023-11-06T13:42:03.037 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.037 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.037 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.038 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.039 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to", 2023-11-06T13:42:03.039 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.039 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.039 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.039 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.040 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2023-11-06T13:42:03.040 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2023-11-06T13:42:03.040 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.040 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.041 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.041 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2023-11-06T13:42:03.041 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.041 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.041 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.042 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2023-11-06T13:42:03.042 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.042 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.042 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.043 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.043 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2023-11-06T13:42:03.043 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2023-11-06T13:42:03.043 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.043 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.044 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.044 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.044 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.044 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.045 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.045 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2023-11-06T13:42:03.045 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.045 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.046 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.046 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.046 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2023-11-06T13:42:03.046 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2023-11-06T13:42:03.046 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.047 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.047 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.047 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.047 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.048 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.048 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.048 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2023-11-06T13:42:03.048 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.048 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.049 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.049 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2023-11-06T13:42:03.049 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2023-11-06T13:42:03.050 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.050 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.050 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.050 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2023-11-06T13:42:03.051 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.051 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.051 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.051 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2023-11-06T13:42:03.052 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.052 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.052 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.052 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.053 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2023-11-06T13:42:03.053 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2023-11-06T13:42:03.053 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.053 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.053 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.054 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.054 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.054 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.054 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.055 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2023-11-06T13:42:03.055 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.055 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.055 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.056 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.056 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2023-11-06T13:42:03.056 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2023-11-06T13:42:03.057 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.057 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.057 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.057 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.058 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.058 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.058 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.058 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-06T13:42:03.059 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.059 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.059 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.059 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.060 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2023-11-06T13:42:03.060 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2023-11-06T13:42:03.060 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.061 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.061 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.061 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.061 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.062 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.062 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.062 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2023-11-06T13:42:03.063 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.063 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.063 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.063 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.064 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.064 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.064 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.065 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2023-11-06T13:42:03.065 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.065 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.065 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.066 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2023-11-06T13:42:03.066 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2023-11-06T13:42:03.066 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.066 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.067 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.067 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.067 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.068 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.068 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.068 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2023-11-06T13:42:03.068 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.069 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.069 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.069 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2023-11-06T13:42:03.069 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2023-11-06T13:42:03.070 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.070 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.070 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.071 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2023-11-06T13:42:03.071 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.071 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.071 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.072 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2023-11-06T13:42:03.072 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-06T13:42:03.072 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.072 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.073 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.073 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2023-11-06T13:42:03.073 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2023-11-06T13:42:03.073 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:03.073 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.074 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.074 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:03.074 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2023-11-06T13:42:03.074 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "7", 2023-11-06T13:42:03.075 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.075 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-06T13:42:03.075 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-11-06T13:42:03.075 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.075 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.076 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.076 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2023-11-06T13:42:03.076 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2023-11-06T13:42:03.076 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:03.077 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.077 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.077 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2023-11-06T13:42:03.077 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2023-11-06T13:42:03.078 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2023-11-06T13:42:03.078 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.078 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-06T13:42:03.078 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.079 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.079 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.079 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.079 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2023-11-06T13:42:03.080 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2023-11-06T13:42:03.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.080 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.080 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.081 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2023-11-06T13:42:03.081 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.081 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.081 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.082 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-06T13:42:03.082 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-06T13:42:03.082 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.082 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.082 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.083 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2023-11-06T13:42:03.083 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2023-11-06T13:42:03.083 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:03.083 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.084 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.084 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2023-11-06T13:42:03.084 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2023-11-06T13:42:03.084 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2023-11-06T13:42:03.085 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.085 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2023-11-06T13:42:03.085 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-06T13:42:03.085 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.086 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.086 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2023-11-06T13:42:03.086 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2023-11-06T13:42:03.086 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.087 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.087 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.087 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2400", 2023-11-06T13:42:03.087 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.087 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.088 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.088 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2023-11-06T13:42:03.088 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-06T13:42:03.088 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.088 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.089 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.089 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2023-11-06T13:42:03.089 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2023-11-06T13:42:03.089 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:03.090 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.090 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.090 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2023-11-06T13:42:03.090 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2023-11-06T13:42:03.090 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "7", 2023-11-06T13:42:03.091 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.091 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-06T13:42:03.091 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-11-06T13:42:03.092 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.092 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.092 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.093 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.093 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.093 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.093 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.094 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.094 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.094 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.095 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.095 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.095 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.095 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.096 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.096 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.096 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.096 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.097 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.097 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.097 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.097 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.098 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.098 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.098 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.099 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.099 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.099 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.099 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.100 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.100 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.101 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.101 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.101 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.102 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.102 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.102 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.102 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.103 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.103 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.103 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.104 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.104 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.104 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.104 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.105 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.105 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.105 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.105 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.106 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.106 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.106 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.106 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.107 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.107 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.108 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.108 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.108 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.109 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.109 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.109 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.110 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.110 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.110 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.110 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.111 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.111 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.111 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2023-11-06T13:42:03.111 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2023-11-06T13:42:03.112 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:03.112 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.112 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.113 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:03.113 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.113 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.113 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.114 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-06T13:42:03.114 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.114 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.114 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.114 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.115 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2023-11-06T13:42:03.115 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2023-11-06T13:42:03.115 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.115 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2023-11-06T13:42:03.116 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.116 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.116 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.117 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2023-11-06T13:42:03.117 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2023-11-06T13:42:03.117 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap" 2023-11-06T13:42:03.117 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.118 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2023-11-06T13:42:03.118 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.118 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.118 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.119 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2023-11-06T13:42:03.119 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2023-11-06T13:42:03.119 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.119 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.120 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.120 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.120 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.120 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.120 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.121 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-06T13:42:03.121 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.121 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.121 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.122 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.122 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:03.122 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:03.122 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.123 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.123 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.123 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:03.123 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.123 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.124 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.124 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-06T13:42:03.124 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.124 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.125 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.125 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.125 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2023-11-06T13:42:03.125 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2023-11-06T13:42:03.126 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.126 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.126 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.126 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:03.126 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2023-11-06T13:42:03.127 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.127 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.127 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-06T13:42:03.127 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-06T13:42:03.128 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.128 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.128 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.128 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2023-11-06T13:42:03.129 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2023-11-06T13:42:03.129 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:03.129 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.129 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.130 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.130 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.130 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.131 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.131 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-06T13:42:03.131 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.131 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.132 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.132 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.132 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.132 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.133 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.133 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2023-11-06T13:42:03.133 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.134 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.134 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.134 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2023-11-06T13:42:03.134 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2023-11-06T13:42:03.135 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.135 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.135 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.136 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.136 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.136 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.136 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.137 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-06T13:42:03.137 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-06T13:42:03.137 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.138 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.138 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.138 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2023-11-06T13:42:03.139 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2023-11-06T13:42:03.139 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.139 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.139 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.140 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:03.140 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.140 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.141 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.141 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-06T13:42:03.141 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.141 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.142 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.142 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.142 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2023-11-06T13:42:03.143 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2023-11-06T13:42:03.143 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:03.143 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.144 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.144 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2023-11-06T13:42:03.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.144 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.145 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.145 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-06T13:42:03.145 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.145 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.146 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.146 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2023-11-06T13:42:03.146 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2023-11-06T13:42:03.147 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.147 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.147 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.147 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.148 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.148 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.148 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.148 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-06T13:42:03.148 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.149 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.149 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.149 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2023-11-06T13:42:03.150 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2023-11-06T13:42:03.150 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.150 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.150 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.151 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.151 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.151 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.151 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-06T13:42:03.151 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.152 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.152 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.152 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2023-11-06T13:42:03.153 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2023-11-06T13:42:03.153 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.153 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.153 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.154 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.23.0", 2023-11-06T13:42:03.154 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.154 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.154 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.155 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:03.155 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.155 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.156 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2023-11-06T13:42:03.156 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2023-11-06T13:42:03.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.157 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.157 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.157 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-06T13:42:03.157 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.158 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.158 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.158 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2023-11-06T13:42:03.158 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.159 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.159 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.159 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.159 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2023-11-06T13:42:03.159 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2023-11-06T13:42:03.160 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.160 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.160 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.160 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph-grafana:8.3.5", 2023-11-06T13:42:03.161 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.161 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.161 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.161 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:03.162 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.162 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.162 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2023-11-06T13:42:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2023-11-06T13:42:03.163 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/library/haproxy:2.3", 2023-11-06T13:42:03.164 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.165 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2023-11-06T13:42:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.167 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2023-11-06T13:42:03.167 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2023-11-06T13:42:03.167 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.167 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.168 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.168 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/arcts/keepalived", 2023-11-06T13:42:03.168 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.169 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.169 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.169 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2023-11-06T13:42:03.169 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.170 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.170 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.171 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2023-11-06T13:42:03.171 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2023-11-06T13:42:03.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.171 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.172 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.172 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.3.1", 2023-11-06T13:42:03.172 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.173 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.173 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.173 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:03.173 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.174 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.174 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.174 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.175 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2023-11-06T13:42:03.175 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2023-11-06T13:42:03.175 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.175 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.175 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.176 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.33.4", 2023-11-06T13:42:03.176 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.176 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.177 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.177 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:03.177 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.178 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.178 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.178 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.178 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2023-11-06T13:42:03.179 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2023-11-06T13:42:03.179 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.179 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.179 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.180 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-06T13:42:03.180 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.180 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.181 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.181 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2023-11-06T13:42:03.181 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.181 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.182 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.182 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.182 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2023-11-06T13:42:03.182 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2023-11-06T13:42:03.183 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.183 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.183 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.183 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.184 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.184 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.184 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.184 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2023-11-06T13:42:03.185 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.185 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.185 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.185 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.186 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2023-11-06T13:42:03.186 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2023-11-06T13:42:03.186 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.186 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.187 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.187 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:03.187 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.187 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.188 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.188 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-06T13:42:03.188 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.189 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.189 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2023-11-06T13:42:03.189 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2023-11-06T13:42:03.190 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.190 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.190 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.190 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2023-11-06T13:42:03.190 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.191 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.191 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.191 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-06T13:42:03.191 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.192 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.192 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.192 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2023-11-06T13:42:03.193 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2023-11-06T13:42:03.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.193 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.193 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.194 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2023-11-06T13:42:03.194 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.194 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.194 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.195 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2023-11-06T13:42:03.195 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.195 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.195 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.196 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.196 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2023-11-06T13:42:03.196 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2023-11-06T13:42:03.196 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.197 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.197 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.197 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.197 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.198 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.198 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.198 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-06T13:42:03.199 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.199 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.199 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.200 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.200 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2023-11-06T13:42:03.200 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2023-11-06T13:42:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.201 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.202 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.203 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2023-11-06T13:42:03.203 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.203 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.204 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.204 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.204 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2023-11-06T13:42:03.204 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2023-11-06T13:42:03.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.205 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.205 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.206 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:03.206 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.206 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.206 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.207 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2023-11-06T13:42:03.207 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.207 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.208 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.208 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.208 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.209 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.209 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.209 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.210 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.210 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.210 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.211 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.211 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.211 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.212 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.212 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.212 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.212 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.213 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.213 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.213 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.214 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.214 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.214 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.214 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.215 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.215 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.215 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.215 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.216 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.216 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.216 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.216 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.217 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-06T13:42:03.217 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.217 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.217 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.217 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.218 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.218 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.218 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.218 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.219 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.219 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.219 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.219 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.220 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.220 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.220 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.220 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.221 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.221 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.221 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.221 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.222 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.222 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.222 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.222 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.223 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.223 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.223 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.223 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.224 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.224 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.224 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.224 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.225 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.225 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.225 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.225 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.225 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.226 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-06T13:42:03.226 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-06T13:42:03.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.227 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.227 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.227 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.227 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.228 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.228 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.228 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-06T13:42:03.228 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.229 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.229 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.229 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.229 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-06T13:42:03.230 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-06T13:42:03.230 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.230 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.230 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.231 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2023-11-06T13:42:03.231 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.231 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.231 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.232 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-06T13:42:03.232 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.232 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.232 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.233 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2023-11-06T13:42:03.233 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2023-11-06T13:42:03.234 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.234 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.234 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.234 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.235 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.235 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.237 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.237 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2023-11-06T13:42:03.238 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.238 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.238 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.239 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.239 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2023-11-06T13:42:03.239 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2023-11-06T13:42:03.239 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.240 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.240 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.240 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.241 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.241 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.241 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.241 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-06T13:42:03.242 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.242 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.242 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.243 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2023-11-06T13:42:03.243 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2023-11-06T13:42:03.243 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.244 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.244 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.244 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.244 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.245 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.245 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.245 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2023-11-06T13:42:03.245 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.246 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.246 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.246 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.246 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2023-11-06T13:42:03.247 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2023-11-06T13:42:03.247 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.247 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.248 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.248 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2023-11-06T13:42:03.248 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.248 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.249 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.249 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2023-11-06T13:42:03.249 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2023-11-06T13:42:03.249 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.250 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2023-11-06T13:42:03.250 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.250 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.251 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.251 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2023-11-06T13:42:03.251 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2023-11-06T13:42:03.252 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.252 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.252 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.253 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-06T13:42:03.253 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.253 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.253 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.254 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-06T13:42:03.254 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.254 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.255 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.255 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2023-11-06T13:42:03.256 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2023-11-06T13:42:03.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.256 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.256 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.257 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.257 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.257 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.257 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.258 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-06T13:42:03.258 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.258 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.258 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.259 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.259 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2023-11-06T13:42:03.259 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2023-11-06T13:42:03.260 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.260 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.260 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.260 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.261 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.261 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.261 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.261 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-06T13:42:03.261 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.262 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.262 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.263 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2023-11-06T13:42:03.263 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2023-11-06T13:42:03.263 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.263 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.264 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.264 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.264 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.264 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.264 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.265 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-06T13:42:03.265 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.265 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.265 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.266 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.266 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2023-11-06T13:42:03.266 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2023-11-06T13:42:03.266 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.267 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.267 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.267 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.267 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.267 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.268 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.268 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-06T13:42:03.268 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.268 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.269 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.269 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.269 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2023-11-06T13:42:03.269 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2023-11-06T13:42:03.270 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.270 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.270 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.270 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.270 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.271 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.271 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.271 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-06T13:42:03.271 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.272 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.272 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.272 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2023-11-06T13:42:03.272 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2023-11-06T13:42:03.273 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.273 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.273 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.274 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.274 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.274 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.274 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.275 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-06T13:42:03.275 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.275 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.275 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.276 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2023-11-06T13:42:03.276 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2023-11-06T13:42:03.276 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.277 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.277 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.277 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.277 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.278 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.278 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.278 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2023-11-06T13:42:03.279 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.279 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.279 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.279 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.280 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2023-11-06T13:42:03.280 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2023-11-06T13:42:03.280 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.281 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.281 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.281 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.281 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.282 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.282 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.282 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-06T13:42:03.283 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.283 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.284 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2023-11-06T13:42:03.284 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2023-11-06T13:42:03.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.285 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.285 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.285 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.286 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.286 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.286 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-06T13:42:03.287 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.287 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.287 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.287 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.288 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.288 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.289 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2023-11-06T13:42:03.289 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.289 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.289 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.290 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.290 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.290 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.291 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.291 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.291 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.292 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.292 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.292 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.292 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.292 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.293 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.293 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.293 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.293 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.294 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.294 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.294 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.294 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.295 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.295 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.295 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.295 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.296 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.296 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.296 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.296 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.296 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.297 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.297 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.297 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.297 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.298 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.298 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.298 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.298 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.299 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.299 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.299 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.299 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.300 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.300 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.300 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.300 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.300 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.301 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.301 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.301 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.301 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.302 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.302 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.302 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.303 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.303 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.303 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.304 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.304 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.304 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.304 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.304 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.305 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.305 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.305 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.305 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.306 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2023-11-06T13:42:03.306 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2023-11-06T13:42:03.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.307 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.307 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.307 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2023-11-06T13:42:03.307 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.307 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.308 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.308 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-06T13:42:03.308 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.308 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.308 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.309 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2023-11-06T13:42:03.309 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2023-11-06T13:42:03.310 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.310 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.310 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.310 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2023-11-06T13:42:03.311 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.311 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.311 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.312 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-06T13:42:03.312 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.312 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.312 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.313 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.313 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.314 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2023-11-06T13:42:03.314 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.314 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.315 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.315 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-06T13:42:03.315 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-06T13:42:03.315 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.316 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.316 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.316 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.317 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.317 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.317 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.318 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.318 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.318 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.319 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.319 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2023-11-06T13:42:03.319 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-06T13:42:03.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.320 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.320 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.321 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.321 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.321 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.322 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.322 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.322 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.322 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.323 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.323 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.323 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-06T13:42:03.323 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-06T13:42:03.324 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.324 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.324 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.325 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.325 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.325 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.326 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.326 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.326 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.326 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.327 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.327 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2023-11-06T13:42:03.327 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2023-11-06T13:42:03.328 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.328 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.328 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.328 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.328 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.329 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.329 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.329 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.329 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.330 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.330 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.330 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.330 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-06T13:42:03.331 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-06T13:42:03.331 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.331 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.331 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.331 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.332 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.332 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.332 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.332 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.333 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.333 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.333 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.333 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.333 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2023-11-06T13:42:03.334 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-06T13:42:03.334 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.334 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.334 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.335 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.335 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.335 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.335 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.336 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.336 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.336 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.336 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.336 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.337 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-06T13:42:03.337 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-06T13:42:03.337 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.337 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.338 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.338 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.338 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.338 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.339 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.339 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.339 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.339 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.340 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-06T13:42:03.340 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-06T13:42:03.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.340 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.341 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.341 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.341 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.341 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.341 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.342 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.342 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.342 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.342 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.343 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.343 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-06T13:42:03.343 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-06T13:42:03.343 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.343 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.344 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.344 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.344 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.344 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.345 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.345 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.345 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.345 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.346 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.346 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.346 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-06T13:42:03.346 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-06T13:42:03.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.347 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.347 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.348 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.348 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.348 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.348 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.349 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.349 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.349 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.350 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.350 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.350 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-06T13:42:03.350 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-06T13:42:03.351 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.351 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.351 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.351 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.352 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.352 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.352 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.353 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.353 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.353 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.353 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.354 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.354 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-06T13:42:03.354 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-06T13:42:03.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.355 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.355 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.355 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.356 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.356 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.356 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.357 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.357 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.357 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.358 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.358 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-06T13:42:03.358 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-06T13:42:03.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.359 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.359 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.360 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.360 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.360 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.360 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.361 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.361 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.361 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.361 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.361 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.362 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2023-11-06T13:42:03.362 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-06T13:42:03.362 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.362 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.363 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.363 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:03.363 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.363 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.363 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.364 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.364 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.364 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.364 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.365 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.365 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-06T13:42:03.365 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-06T13:42:03.365 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.365 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.366 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.366 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.366 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.366 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.366 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.367 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.367 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.367 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.367 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.368 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.368 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2023-11-06T13:42:03.368 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2023-11-06T13:42:03.368 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.368 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.369 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.369 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.369 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.369 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.370 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.370 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.370 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.370 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.371 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.371 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.371 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2023-11-06T13:42:03.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-06T13:42:03.372 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.372 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.372 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.372 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:03.372 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.373 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.373 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.373 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.373 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.374 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.374 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.374 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-06T13:42:03.375 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-06T13:42:03.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.375 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.375 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.376 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.376 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.376 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.376 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.377 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.377 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.377 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.377 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.378 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-06T13:42:03.378 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-06T13:42:03.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.379 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.379 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.379 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.379 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.380 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.380 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.380 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.380 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.381 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.381 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.381 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.382 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-06T13:42:03.382 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-06T13:42:03.382 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.382 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.383 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.383 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.383 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.384 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.384 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.384 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.384 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.385 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.385 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.385 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.385 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2023-11-06T13:42:03.386 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-06T13:42:03.386 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.386 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.387 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.387 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.387 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.387 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.388 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.388 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.388 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.389 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.389 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.389 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.390 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-06T13:42:03.390 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-06T13:42:03.390 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.390 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.391 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.391 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.391 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.392 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.392 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.392 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.392 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.393 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.393 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-06T13:42:03.393 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-06T13:42:03.394 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.394 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.394 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.394 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.394 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.395 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.395 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.395 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.395 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.396 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.396 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.396 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-06T13:42:03.396 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-06T13:42:03.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.397 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.397 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.398 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.398 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.398 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.398 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.398 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.399 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.399 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.399 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.399 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.400 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-06T13:42:03.400 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-06T13:42:03.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.400 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.401 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.401 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.401 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.401 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.402 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.402 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.402 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.402 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.403 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.403 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.403 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-06T13:42:03.403 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-06T13:42:03.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.404 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.404 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.404 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.404 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.404 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.405 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.405 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.405 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.405 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.406 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.406 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-06T13:42:03.406 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-06T13:42:03.406 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.407 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.407 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.407 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.407 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.407 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.408 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.408 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.408 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.408 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.409 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.409 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-06T13:42:03.409 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-06T13:42:03.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.411 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.411 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.412 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-06T13:42:03.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-06T13:42:03.413 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.413 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.413 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.413 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.414 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.414 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.414 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.414 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.415 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.415 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.415 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.415 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.415 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2023-11-06T13:42:03.416 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-06T13:42:03.416 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.416 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.416 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.416 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.417 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.417 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.417 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.417 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.418 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.418 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.419 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-06T13:42:03.419 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-06T13:42:03.419 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.420 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.420 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-06T13:42:03.420 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.421 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.421 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.421 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.421 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.422 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.422 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.422 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-06T13:42:03.423 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-06T13:42:03.423 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.423 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.423 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.424 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.424 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.424 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.424 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.425 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.425 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.425 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.425 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.426 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-06T13:42:03.426 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-06T13:42:03.426 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.427 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.427 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.427 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2023-11-06T13:42:03.427 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.428 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.428 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.428 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.428 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.429 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.429 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.429 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.429 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-06T13:42:03.430 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-06T13:42:03.430 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.430 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.431 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.431 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2023-11-06T13:42:03.431 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.431 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.432 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.432 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.432 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.432 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.432 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.433 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2023-11-06T13:42:03.433 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-06T13:42:03.433 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.434 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.434 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.434 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.434 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.434 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.435 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.435 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.435 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.435 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.436 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.436 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.436 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-06T13:42:03.436 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-06T13:42:03.437 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.437 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.437 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.437 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:03.438 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.438 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.438 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.438 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.441 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.441 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.442 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.442 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.442 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2023-11-06T13:42:03.442 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-06T13:42:03.442 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.443 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.443 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.443 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.443 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.444 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.444 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.444 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.444 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.445 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.445 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.445 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.445 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2023-11-06T13:42:03.445 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-06T13:42:03.446 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.446 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.446 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.446 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.447 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.447 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.447 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.447 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.448 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.448 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.448 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.448 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.449 INFO:teuthology.orchestra.run.smithi038.stdout: "UNSAFE_TLS_v1_2": { 2023-11-06T13:42:03.449 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-06T13:42:03.449 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.449 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.450 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.450 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.450 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.450 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.451 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.451 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.451 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.451 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.451 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.452 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-06T13:42:03.452 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-06T13:42:03.452 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.453 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.453 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.453 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:03.453 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.454 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.454 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.454 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.454 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.455 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.455 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.455 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-06T13:42:03.456 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-06T13:42:03.456 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.456 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.456 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.456 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.457 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.457 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.457 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.457 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.458 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.458 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.458 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.458 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-06T13:42:03.459 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-06T13:42:03.459 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.459 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.459 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.460 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:03.460 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.460 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.460 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.461 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.461 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.461 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.461 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.462 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.462 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2023-11-06T13:42:03.462 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2023-11-06T13:42:03.462 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.463 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.463 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.463 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.463 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.464 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.464 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.464 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.464 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.464 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.465 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.465 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.465 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2023-11-06T13:42:03.465 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2023-11-06T13:42:03.466 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.466 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.466 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.466 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.467 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.467 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.467 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.467 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.467 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.468 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.468 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.468 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.468 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2023-11-06T13:42:03.468 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2023-11-06T13:42:03.469 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.469 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.469 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.469 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.469 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.470 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.470 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.470 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2023-11-06T13:42:03.470 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.471 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.471 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.471 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.471 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2023-11-06T13:42:03.472 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2023-11-06T13:42:03.472 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.472 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.472 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.472 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2023-11-06T13:42:03.473 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.473 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.473 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.473 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.474 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.474 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.474 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.475 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.475 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2023-11-06T13:42:03.475 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2023-11-06T13:42:03.475 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.476 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.476 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.476 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.477 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.477 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.477 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.477 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.478 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.478 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.478 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.479 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.479 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.480 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.480 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.480 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.480 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.481 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.481 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.481 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.482 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.482 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.482 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.483 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.483 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.483 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.484 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.484 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.484 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.484 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.485 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.485 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.485 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.486 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.486 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.486 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.487 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.487 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.487 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.488 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.488 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.488 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.489 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.489 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.489 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.490 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.490 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.491 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.492 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.493 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.493 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.493 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.494 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.494 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.494 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.495 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.495 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.495 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.495 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.496 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.496 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.496 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.497 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.497 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.497 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.497 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.498 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.498 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.498 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.498 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.499 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.499 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.499 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.499 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.500 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2023-11-06T13:42:03.500 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2023-11-06T13:42:03.500 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.500 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.500 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.501 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.501 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.501 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.501 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.502 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2023-11-06T13:42:03.502 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.502 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.502 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.502 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.503 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2023-11-06T13:42:03.503 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2023-11-06T13:42:03.503 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.503 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.503 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.504 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.504 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.504 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.504 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.505 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.505 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.505 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.505 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.506 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:03.506 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:03.506 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.506 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.507 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.507 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2023-11-06T13:42:03.507 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.507 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.507 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.508 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.508 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.508 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.508 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.508 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.509 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:03.509 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:03.509 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.509 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.510 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.510 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2023-11-06T13:42:03.510 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.510 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.511 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.511 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.511 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.511 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.512 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.512 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.512 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2023-11-06T13:42:03.513 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2023-11-06T13:42:03.513 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.513 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.513 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.514 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.514 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.514 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.514 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.515 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.515 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.515 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.515 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.516 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.516 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2023-11-06T13:42:03.516 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2023-11-06T13:42:03.516 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.516 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.517 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.517 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2023-11-06T13:42:03.517 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.517 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.518 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.518 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.518 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.518 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.519 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.519 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.519 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2023-11-06T13:42:03.519 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2023-11-06T13:42:03.519 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.520 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.520 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.520 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2023-11-06T13:42:03.520 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.521 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.521 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.521 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.521 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2023-11-06T13:42:03.522 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.522 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.522 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.522 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.522 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.523 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.523 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2023-11-06T13:42:03.523 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2023-11-06T13:42:03.523 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.524 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.524 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.524 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2023-11-06T13:42:03.524 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2023-11-06T13:42:03.525 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2023-11-06T13:42:03.525 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.525 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.525 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.525 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.526 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.526 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.526 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2023-11-06T13:42:03.526 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2023-11-06T13:42:03.527 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.527 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.527 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.527 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.528 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.528 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.528 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.528 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.529 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.529 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.529 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.529 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.529 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.530 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.530 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.530 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2023-11-06T13:42:03.530 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.531 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.531 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.531 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2023-11-06T13:42:03.531 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2023-11-06T13:42:03.531 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.532 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.532 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.532 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.532 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.533 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.533 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.533 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2023-11-06T13:42:03.533 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.534 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.534 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.534 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.534 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.534 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.535 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.535 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.535 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.535 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.536 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.536 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.536 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.536 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.536 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.537 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.537 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.537 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.537 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.537 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.538 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.538 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.538 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.538 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.539 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.539 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.539 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.539 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.539 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.540 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.540 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.540 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.540 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.540 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.541 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.541 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.541 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.541 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.542 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.542 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.542 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.542 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.543 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.543 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.543 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.543 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.543 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.544 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.545 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.546 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.547 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.548 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.549 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2023-11-06T13:42:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2023-11-06T13:42:03.550 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2023-11-06T13:42:03.551 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-06T13:42:03.552 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.553 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.553 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.553 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.553 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2023-11-06T13:42:03.554 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2023-11-06T13:42:03.554 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.554 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.554 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.554 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2023-11-06T13:42:03.555 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.555 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.555 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.555 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-06T13:42:03.556 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.556 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.556 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.556 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.556 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2023-11-06T13:42:03.557 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2023-11-06T13:42:03.557 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.557 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.557 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.557 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2023-11-06T13:42:03.558 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.558 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.558 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.558 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2023-11-06T13:42:03.559 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.559 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.559 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.559 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.560 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2023-11-06T13:42:03.560 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2023-11-06T13:42:03.560 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.560 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.560 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.561 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2023-11-06T13:42:03.561 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.561 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-06T13:42:03.562 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.562 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.562 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.563 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2023-11-06T13:42:03.563 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2023-11-06T13:42:03.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.563 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.563 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.564 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.564 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.564 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.564 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.564 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-06T13:42:03.565 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.565 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.565 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.566 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.566 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:03.566 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:03.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.567 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.567 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.567 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:03.567 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.568 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.568 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.568 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2023-11-06T13:42:03.568 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.569 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.569 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.569 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.570 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2023-11-06T13:42:03.570 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2023-11-06T13:42:03.570 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.570 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.571 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.571 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2023-11-06T13:42:03.571 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.571 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.572 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.572 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-06T13:42:03.572 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.572 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.573 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.573 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.573 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.573 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.574 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.574 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2023-11-06T13:42:03.574 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.574 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.574 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.575 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.575 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.575 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.575 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.576 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.576 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.576 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.576 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.577 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.577 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.577 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.577 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.578 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.578 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.578 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.578 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.579 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.579 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.579 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.579 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.579 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.580 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.580 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.580 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.580 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.580 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.581 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.581 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.581 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.581 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.581 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.582 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.582 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.582 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.582 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.583 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.583 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.583 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.583 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.583 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.584 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.584 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.584 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.584 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.585 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.585 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.585 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.585 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.585 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.586 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.586 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.586 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.586 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.586 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.587 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.587 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.587 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.587 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.587 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.588 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.588 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.588 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.589 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.589 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.589 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.589 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.590 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.590 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.590 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2023-11-06T13:42:03.591 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2023-11-06T13:42:03.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.591 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.591 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.592 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2023-11-06T13:42:03.592 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.592 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.592 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.592 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.593 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.593 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.593 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.593 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.594 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2023-11-06T13:42:03.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2023-11-06T13:42:03.594 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.594 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.594 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2023-11-06T13:42:03.595 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.595 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.595 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.596 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.596 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.596 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.596 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.597 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:03.597 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:03.597 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.598 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.598 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.598 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:03.598 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.599 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.599 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.599 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.599 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.600 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.600 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.600 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.600 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.601 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.601 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2023-11-06T13:42:03.601 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2023-11-06T13:42:03.602 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2023-11-06T13:42:03.602 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.602 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2023-11-06T13:42:03.602 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2023-11-06T13:42:03.603 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.603 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.603 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.603 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2023-11-06T13:42:03.604 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.604 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.604 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.604 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.605 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.605 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.605 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.605 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.606 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2023-11-06T13:42:03.606 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2023-11-06T13:42:03.606 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.607 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.607 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.607 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2023-11-06T13:42:03.608 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.608 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.608 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.609 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.609 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.609 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.609 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2023-11-06T13:42:03.610 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2023-11-06T13:42:03.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.610 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.610 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.611 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:03.611 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.611 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.611 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.611 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.612 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.612 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.612 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.612 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:03.613 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:03.613 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.613 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.613 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.613 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2023-11-06T13:42:03.614 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.614 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.614 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.614 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.615 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.615 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.615 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.615 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.615 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.616 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.616 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.616 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.617 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.617 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.617 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.617 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.618 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.618 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.618 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.619 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.619 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.619 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.619 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.619 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.620 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.620 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.620 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.620 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.621 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.621 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.621 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.621 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.622 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.622 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.622 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.623 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.623 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.623 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.623 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.624 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.624 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.624 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.624 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.624 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.625 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.625 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.625 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.625 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.626 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.626 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.626 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.626 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.627 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.627 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.627 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.627 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.627 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.628 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.628 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.628 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.628 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.629 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.629 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.629 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.629 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.630 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.630 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.630 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.630 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.631 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.631 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.631 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.631 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2023-11-06T13:42:03.631 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2023-11-06T13:42:03.632 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.632 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.632 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.632 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:03.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.633 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.633 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.633 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.634 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.634 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.634 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.634 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.634 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2023-11-06T13:42:03.635 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2023-11-06T13:42:03.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.635 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.635 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.636 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2023-11-06T13:42:03.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.636 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.636 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.637 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.637 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.637 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.637 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.637 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.638 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2023-11-06T13:42:03.638 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2023-11-06T13:42:03.638 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.638 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.639 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.639 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2023-11-06T13:42:03.639 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.639 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.640 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.640 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.640 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.640 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.640 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.641 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2023-11-06T13:42:03.641 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2023-11-06T13:42:03.641 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:03.642 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.643 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.643 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.643 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.643 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.644 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.644 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.644 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2023-11-06T13:42:03.645 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2023-11-06T13:42:03.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.645 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.645 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.646 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:03.646 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.646 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.646 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.647 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.647 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.647 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.647 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.648 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.648 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2023-11-06T13:42:03.648 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2023-11-06T13:42:03.649 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.649 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.649 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.649 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2023-11-06T13:42:03.650 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.650 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.650 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.650 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.651 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.651 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.651 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.652 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.652 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.652 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.653 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2023-11-06T13:42:03.653 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.653 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.654 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.654 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.654 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.655 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.655 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.655 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.656 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.656 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.656 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.657 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.657 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.657 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.658 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.658 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.658 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.659 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.659 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.659 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.660 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.660 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.660 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.661 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.661 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.661 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.662 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.662 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.662 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.663 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.663 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.663 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.664 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.664 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.664 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.665 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.665 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.665 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.665 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.666 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.666 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.666 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.666 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.666 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.667 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.667 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.667 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.667 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.667 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.668 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.668 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.668 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.668 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.669 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.669 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.669 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.670 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.670 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.670 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.671 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.671 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.671 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.671 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.671 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.672 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.672 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.673 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.673 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2023-11-06T13:42:03.673 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.673 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.673 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.674 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.674 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.674 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.674 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.675 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.675 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.675 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.675 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.675 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.676 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.676 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.676 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.676 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.676 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.677 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.677 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.677 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.677 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.678 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.678 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.678 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.678 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.678 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.679 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.679 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.679 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.679 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.680 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.680 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.680 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.680 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.681 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.681 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.681 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.681 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.682 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.682 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.682 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.682 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.682 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.683 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.683 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.683 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.683 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.684 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.684 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.684 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.684 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.684 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.685 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.685 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.685 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.685 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.685 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.686 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.686 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.686 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.686 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.687 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.687 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.687 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.687 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.688 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.688 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.688 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.688 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.688 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.689 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.689 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.690 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.690 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.690 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.690 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2023-11-06T13:42:03.691 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.691 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.691 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.691 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2023-11-06T13:42:03.691 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2023-11-06T13:42:03.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.692 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.692 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.692 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2023-11-06T13:42:03.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.693 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.694 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2023-11-06T13:42:03.694 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.694 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.694 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.695 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.695 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.695 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.696 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.696 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.696 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.696 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.696 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.697 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.697 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.697 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.697 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.698 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.698 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.698 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.698 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.698 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.699 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.699 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.699 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.699 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.700 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.700 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.700 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.700 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.701 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.701 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.701 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.701 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.701 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.702 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.702 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.702 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.702 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.703 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.703 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.703 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.703 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.703 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.704 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.704 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.704 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.704 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.705 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.705 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.705 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.705 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.705 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.706 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.706 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.706 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.706 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.707 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.707 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.707 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.707 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.707 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.708 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.708 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.708 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.708 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.709 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.709 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.709 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.710 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2023-11-06T13:42:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2023-11-06T13:42:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.711 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.712 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.712 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.712 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.712 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.713 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2023-11-06T13:42:03.713 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.713 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.713 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.714 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.714 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2023-11-06T13:42:03.714 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2023-11-06T13:42:03.714 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.714 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.715 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.715 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2023-11-06T13:42:03.715 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.715 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.716 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.716 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2023-11-06T13:42:03.716 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.716 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.716 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.717 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.717 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2023-11-06T13:42:03.717 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2023-11-06T13:42:03.717 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.718 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.718 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.718 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2023-11-06T13:42:03.718 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.719 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.719 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.719 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2023-11-06T13:42:03.719 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.720 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.720 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.720 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.720 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2023-11-06T13:42:03.721 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2023-11-06T13:42:03.721 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.721 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.721 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.722 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.722 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.722 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.722 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.723 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2023-11-06T13:42:03.723 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.723 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.723 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.724 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.724 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2023-11-06T13:42:03.724 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2023-11-06T13:42:03.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.725 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.725 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.725 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2023-11-06T13:42:03.725 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.725 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.726 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.726 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-06T13:42:03.726 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.726 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.727 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.727 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.727 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.727 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.727 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.728 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2023-11-06T13:42:03.728 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.728 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.728 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.728 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.729 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.729 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.729 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.729 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.730 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.730 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.730 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.731 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.731 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.731 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.731 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.732 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.732 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.732 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.732 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.733 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.733 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.733 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.733 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.734 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.734 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.734 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.735 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.735 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.735 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.736 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.736 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.736 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.736 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.737 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.737 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.737 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.737 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.737 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.738 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.738 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.738 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.738 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.739 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.739 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.739 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.739 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.740 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.740 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.740 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.740 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.741 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.741 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.741 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.741 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.741 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.742 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.742 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.743 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.743 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.743 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.743 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.743 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.744 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.744 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.744 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.744 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.744 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.745 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.745 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.745 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.745 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.746 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2023-11-06T13:42:03.746 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.746 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.746 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.746 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.747 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.747 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.747 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.747 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.748 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.748 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.748 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.748 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.749 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.749 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.749 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.749 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.749 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.750 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.750 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.750 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.750 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.751 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.751 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.751 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.752 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.752 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.752 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.752 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.753 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.753 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.753 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.753 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.754 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.754 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.754 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.755 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.756 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.757 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.758 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.759 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.760 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.761 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.762 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2023-11-06T13:42:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.763 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.764 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.765 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.766 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.767 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.768 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.769 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.770 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.771 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.772 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.773 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.774 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.775 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.776 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.777 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.778 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.779 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.780 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2023-11-06T13:42:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.782 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.783 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.784 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.785 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.786 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.787 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.788 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.789 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.790 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.791 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.792 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.793 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.794 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.795 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.796 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2023-11-06T13:42:03.797 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2023-11-06T13:42:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.798 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2023-11-06T13:42:03.799 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2023-11-06T13:42:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2023-11-06T13:42:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2023-11-06T13:42:03.800 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.801 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2023-11-06T13:42:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.802 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.803 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.805 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.806 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.807 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.808 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.809 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.811 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.812 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.813 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.814 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.815 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.816 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.817 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.818 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2023-11-06T13:42:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.819 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.820 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.821 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.822 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.823 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.824 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.825 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.826 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.827 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.828 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.829 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.830 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.831 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.832 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.832 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.832 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.833 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.833 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.833 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.833 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.834 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.834 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.834 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.834 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.834 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.835 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.835 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.835 INFO:teuthology.orchestra.run.smithi038.stdout: "noautoscale": { 2023-11-06T13:42:03.835 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "noautoscale", 2023-11-06T13:42:03.836 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.836 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.836 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.836 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.836 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.837 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.837 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.837 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "global autoscale flag", 2023-11-06T13:42:03.837 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-11-06T13:42:03.838 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.838 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.838 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.838 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:03.838 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:03.839 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.839 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.839 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.839 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:03.840 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.840 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.840 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.840 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.840 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.841 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.841 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.841 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.841 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.842 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.842 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.842 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2023-11-06T13:42:03.842 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.842 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.843 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.843 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2023-11-06T13:42:03.843 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2023-11-06T13:42:03.843 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.844 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.844 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.844 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.844 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.844 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.845 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.845 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.845 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.845 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.845 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.846 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.846 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.849 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.849 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.850 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.850 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.850 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.850 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.850 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.851 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.851 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.851 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.851 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.852 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.852 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.852 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.852 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.852 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.853 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.853 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.853 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.853 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.854 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.854 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.854 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.854 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.854 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.855 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.855 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.855 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.855 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.856 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.856 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.856 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.856 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.856 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.857 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.857 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.857 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.857 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.857 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.858 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.858 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.858 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.858 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.859 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.859 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.859 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.859 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.859 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.860 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.860 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.860 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.860 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.860 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.861 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.861 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.861 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.861 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.862 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.862 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.862 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.862 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.863 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.863 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.863 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.863 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.863 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.864 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.864 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2023-11-06T13:42:03.864 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2023-11-06T13:42:03.865 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.865 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.865 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.865 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2023-11-06T13:42:03.866 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.866 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.866 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.866 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2023-11-06T13:42:03.866 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.867 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.867 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.867 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:03.868 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:03.868 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:03.868 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.868 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.869 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:03.869 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.869 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.869 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.869 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2023-11-06T13:42:03.870 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.870 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.870 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.870 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.871 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.871 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.871 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.871 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2023-11-06T13:42:03.871 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.872 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.872 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.872 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2023-11-06T13:42:03.872 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2023-11-06T13:42:03.873 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.873 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.873 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.873 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.873 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.874 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.874 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.874 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.874 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.875 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.875 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.875 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.875 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.875 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.876 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.876 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.876 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.876 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.876 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.877 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.877 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.877 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.877 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.877 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.878 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.878 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.878 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.878 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.879 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.879 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.879 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.879 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.879 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.880 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.880 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.880 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.880 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.881 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.881 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.881 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.882 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.882 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.882 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.882 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.882 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.883 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.883 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.883 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.884 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.884 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.884 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.884 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.884 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.885 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.885 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.885 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.885 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.885 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.886 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.886 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.886 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.886 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.887 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.887 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.887 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.887 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.888 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.888 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.888 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.888 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.888 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.889 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.889 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.889 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.890 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.890 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.890 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.890 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.890 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.891 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2023-11-06T13:42:03.891 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2023-11-06T13:42:03.891 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.891 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.892 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.892 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.892 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.892 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.892 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.893 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.893 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.893 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.893 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.894 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.894 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-06T13:42:03.894 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-06T13:42:03.894 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.894 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.895 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.895 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2023-11-06T13:42:03.895 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.895 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.896 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.896 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.896 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.896 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.896 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.897 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.897 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2023-11-06T13:42:03.897 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2023-11-06T13:42:03.897 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:03.898 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.898 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.898 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2023-11-06T13:42:03.898 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.898 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.899 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.899 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.899 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.899 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.900 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.900 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.900 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:03.900 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:03.900 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.901 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.901 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.901 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.901 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.902 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.902 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.902 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.902 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.902 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.903 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.903 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.903 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:03.903 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:03.904 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.904 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.904 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.904 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2023-11-06T13:42:03.905 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.905 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.905 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.905 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-06T13:42:03.905 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.906 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.906 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.906 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.906 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2023-11-06T13:42:03.906 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2023-11-06T13:42:03.907 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.907 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.907 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.907 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2023-11-06T13:42:03.908 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.908 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.908 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.908 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.908 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.909 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.909 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.909 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2023-11-06T13:42:03.909 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2023-11-06T13:42:03.910 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.910 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.910 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.910 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2023-11-06T13:42:03.911 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.911 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.911 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.911 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2023-11-06T13:42:03.912 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2023-11-06T13:42:03.912 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.912 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.912 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.912 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.913 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.913 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.913 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2023-11-06T13:42:03.913 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2023-11-06T13:42:03.913 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.914 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.914 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.914 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2023-11-06T13:42:03.914 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2023-11-06T13:42:03.915 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2023-11-06T13:42:03.915 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.915 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.915 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.915 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.916 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.916 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.917 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.917 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2023-11-06T13:42:03.917 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.917 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.917 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.918 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.918 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.918 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.918 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.919 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.919 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.919 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.919 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.919 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.920 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.920 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.920 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.920 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.920 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.921 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.921 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.921 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.922 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.922 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.922 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.922 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.922 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.923 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.923 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.923 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.924 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.924 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.924 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.924 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.925 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.926 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.926 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.926 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.926 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.926 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.927 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.927 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.927 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.927 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.928 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.928 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.928 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.928 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.929 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.929 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.929 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.929 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.930 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.930 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.930 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.930 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.931 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.931 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.931 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.931 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.932 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.932 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.932 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.932 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.933 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.933 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.933 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.933 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.933 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.934 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.934 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.934 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2023-11-06T13:42:03.935 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2023-11-06T13:42:03.935 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:03.935 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.935 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.935 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:03.936 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.936 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.936 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.936 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.937 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.937 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.937 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.937 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.937 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2023-11-06T13:42:03.938 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2023-11-06T13:42:03.938 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.938 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.938 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.939 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.939 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.939 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.939 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.939 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.940 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.940 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.940 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.940 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.940 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2023-11-06T13:42:03.941 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2023-11-06T13:42:03.941 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.941 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.941 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.942 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.942 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.942 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.942 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.942 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.943 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.943 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.943 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.943 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.943 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.944 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.944 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2023-11-06T13:42:03.944 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.945 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.945 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.945 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2023-11-06T13:42:03.945 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2023-11-06T13:42:03.945 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.946 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.946 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.946 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:03.946 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.947 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.947 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.947 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.947 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.947 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.948 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.948 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.948 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2023-11-06T13:42:03.948 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2023-11-06T13:42:03.948 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.949 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.949 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.949 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.949 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.950 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.950 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.950 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.950 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.950 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.951 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.951 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.951 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.951 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.952 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.952 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.952 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.952 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.953 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.953 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.953 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.953 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.954 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.954 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.954 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.954 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.954 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.955 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.955 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.955 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.955 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.956 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.956 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.956 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.957 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.957 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.957 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.957 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.958 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.958 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.958 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.958 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.958 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.959 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.959 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.959 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.959 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.959 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.960 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.960 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.960 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.960 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.961 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.961 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.961 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.961 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.962 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.962 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.962 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.962 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.962 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.963 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.963 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.963 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.963 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.964 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.964 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.964 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.964 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.965 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.965 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.965 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.965 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.965 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.966 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.966 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.966 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.966 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.967 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.967 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.967 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.967 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:03.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:03.968 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.968 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.968 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.968 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.969 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.969 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.969 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.969 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.969 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.970 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.970 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.970 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.970 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:03.970 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:03.971 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.971 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.971 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:03.971 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.972 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.972 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.972 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.972 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.972 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.973 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.973 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.973 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.973 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.974 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.974 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.974 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2023-11-06T13:42:03.974 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.974 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.975 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.975 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.975 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.975 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.976 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.976 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.976 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.976 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.976 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.977 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.977 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.977 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.977 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.978 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.978 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.978 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.978 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.978 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.979 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.979 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.979 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.979 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.980 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.980 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.980 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.980 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.981 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.981 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.981 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.981 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.981 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.982 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.982 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.982 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.982 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.983 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.983 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:03.983 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:03.983 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.984 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.984 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:03.984 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.985 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.985 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.985 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.985 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.985 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.986 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.986 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.986 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.986 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.987 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.987 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.987 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.987 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.987 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:03.988 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:03.988 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.988 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.988 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.989 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.989 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.989 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.989 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.989 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.990 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.990 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.990 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.990 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.991 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:03.991 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.991 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:03.991 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2023-11-06T13:42:03.991 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:03.992 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:03.992 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:03.992 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:03.992 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:03.992 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:03.993 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.993 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.993 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:03.993 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.993 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.994 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:03.994 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:03.994 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:03.994 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:03.995 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:03.995 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:03.995 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:03.995 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:03.995 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.996 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.996 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.996 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.996 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:03.997 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:03.997 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:03.997 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:03.997 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:03.997 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:03.998 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:03.998 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:03.998 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:03.998 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:03.999 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:03.999 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:03.999 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:03.999 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:03.999 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.000 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.000 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.000 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.000 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.001 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.001 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.001 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.001 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.001 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.002 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.002 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.002 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.002 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.002 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.003 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.003 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.003 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.003 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.004 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.004 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.004 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.004 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.005 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.005 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.005 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.005 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.006 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.006 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.006 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.006 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.006 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.007 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.007 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.007 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.007 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2023-11-06T13:42:04.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2023-11-06T13:42:04.008 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.008 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.008 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.008 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.009 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.009 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.009 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.009 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.009 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.010 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.010 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.010 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.010 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2023-11-06T13:42:04.011 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2023-11-06T13:42:04.011 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.011 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.011 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.011 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2023-11-06T13:42:04.012 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.012 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.012 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.012 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.013 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.013 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.013 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.013 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.013 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2023-11-06T13:42:04.014 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2023-11-06T13:42:04.014 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.014 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.014 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.014 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.015 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.015 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.015 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.015 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.016 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.016 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.016 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.016 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.017 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2023-11-06T13:42:04.017 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2023-11-06T13:42:04.017 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.017 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.018 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.018 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.018 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.018 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.019 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.019 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.019 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.019 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.019 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.020 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.020 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2023-11-06T13:42:04.020 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2023-11-06T13:42:04.020 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:04.021 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.021 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.021 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.021 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.022 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.022 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.022 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.022 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.023 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.023 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.023 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2023-11-06T13:42:04.023 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2023-11-06T13:42:04.024 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.024 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.024 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.024 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.024 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.025 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.025 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.025 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.025 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.026 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.026 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.026 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2023-11-06T13:42:04.026 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2023-11-06T13:42:04.027 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.027 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.027 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.027 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.028 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.028 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.028 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.028 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.029 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.029 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.029 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.029 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2023-11-06T13:42:04.030 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2023-11-06T13:42:04.030 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.030 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.030 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.030 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.031 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.031 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.031 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.031 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.032 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.032 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.032 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.032 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.033 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2023-11-06T13:42:04.033 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2023-11-06T13:42:04.033 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.033 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.033 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.034 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.034 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.034 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.034 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.034 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.035 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.035 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.035 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.035 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.036 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2023-11-06T13:42:04.036 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2023-11-06T13:42:04.036 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.036 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.036 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.037 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.037 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.037 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.037 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.038 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.038 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.038 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.038 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.038 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.039 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2023-11-06T13:42:04.039 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2023-11-06T13:42:04.039 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.039 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.040 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.040 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.040 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.040 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.040 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.041 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.041 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.041 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.041 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.041 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.042 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.042 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.042 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.042 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2023-11-06T13:42:04.043 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.043 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.043 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.043 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2023-11-06T13:42:04.043 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2023-11-06T13:42:04.044 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.044 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.044 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.044 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.045 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.045 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.045 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.045 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2023-11-06T13:42:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.046 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2023-11-06T13:42:04.047 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2023-11-06T13:42:04.047 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.047 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.047 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.048 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.048 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.048 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.048 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.048 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2023-11-06T13:42:04.049 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.049 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.049 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.049 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.050 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.050 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.050 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.050 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.051 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.051 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.051 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.051 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.051 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.052 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.052 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.052 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.052 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.052 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.053 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.053 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.053 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.053 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.054 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.054 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.054 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.054 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.054 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.055 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.055 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.055 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.055 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.055 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.056 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.056 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.056 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.056 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.057 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.057 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.057 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.057 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.057 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.058 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.058 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.058 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.058 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.058 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.059 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.059 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.059 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.059 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.060 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.060 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.060 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.060 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.061 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.061 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.061 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.061 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.061 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.062 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.062 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.062 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.062 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.063 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.063 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.063 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.063 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.063 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.064 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.064 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.064 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.064 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.065 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.065 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.065 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.065 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.065 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2023-11-06T13:42:04.066 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.066 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.066 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.066 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.067 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.067 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.067 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.067 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.068 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.068 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.068 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.068 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.069 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.069 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.069 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.069 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.069 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.070 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.071 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.071 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.071 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.071 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.072 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.072 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.072 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.072 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.073 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.073 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.073 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.073 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.073 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.074 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.074 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.074 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.074 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.075 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.075 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.075 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.075 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.075 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.076 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.076 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.076 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.076 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.077 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.078 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.079 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.079 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.079 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.079 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.080 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.080 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.080 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.080 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.081 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.081 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.081 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.081 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.081 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.082 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.082 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.082 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.082 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.083 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.083 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.083 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2023-11-06T13:42:04.083 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.083 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.084 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.084 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.084 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.084 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.084 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.085 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.085 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.085 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.085 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.085 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.086 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.086 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.086 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.086 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.087 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.087 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.087 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.087 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.087 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.088 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.088 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.088 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.089 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.089 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.089 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.089 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.089 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.090 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.090 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.090 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.090 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.091 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.091 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.091 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.091 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.091 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.092 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.092 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.092 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.092 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.093 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.093 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.093 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.093 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.093 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.094 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.094 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.094 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.094 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.095 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.095 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.095 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.095 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.095 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.096 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.096 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.096 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.096 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.097 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.097 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.097 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.097 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.097 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.098 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.098 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.098 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.098 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.099 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.099 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.099 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.099 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.100 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.100 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.100 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2023-11-06T13:42:04.100 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.100 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.101 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.101 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2023-11-06T13:42:04.101 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2023-11-06T13:42:04.101 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-06T13:42:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.102 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.103 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.104 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.104 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:04.104 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:04.104 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.105 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.105 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.105 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2023-11-06T13:42:04.105 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.105 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.106 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.106 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.106 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.106 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.107 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.107 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.107 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.107 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.108 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.108 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.108 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.108 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.108 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.109 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.109 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.109 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.109 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.110 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.110 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.110 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.110 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.111 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.111 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.111 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.111 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.112 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.112 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.112 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.113 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.113 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.113 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.113 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.114 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.115 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.116 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.116 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.117 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.117 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.117 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.117 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.118 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.118 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.118 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.118 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.118 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.119 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.119 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.119 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.119 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.120 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.120 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.120 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.120 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.120 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.121 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.121 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.121 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.121 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.121 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.122 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.122 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.122 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.122 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.122 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.123 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.123 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.123 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.124 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2023-11-06T13:42:04.124 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.124 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.124 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.124 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2023-11-06T13:42:04.125 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2023-11-06T13:42:04.125 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.125 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.125 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.126 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.126 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.126 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.126 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.126 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-06T13:42:04.127 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.127 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.127 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.127 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.128 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2023-11-06T13:42:04.128 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2023-11-06T13:42:04.128 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.128 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.128 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.129 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.129 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.129 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.129 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.130 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.130 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.130 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.130 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.130 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.131 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2023-11-06T13:42:04.131 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2023-11-06T13:42:04.131 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.131 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.132 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.132 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.132 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.132 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.133 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.133 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.133 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.133 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.133 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.134 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.134 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2023-11-06T13:42:04.134 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2023-11-06T13:42:04.134 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.135 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.135 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.135 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.135 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.135 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.136 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.136 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.136 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.136 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.137 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.137 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.137 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2023-11-06T13:42:04.137 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2023-11-06T13:42:04.137 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.138 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.138 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.138 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.138 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.139 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.139 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.139 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.139 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.139 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.140 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.140 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.140 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2023-11-06T13:42:04.140 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2023-11-06T13:42:04.140 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.141 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.141 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.141 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.141 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.142 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.142 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.142 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.142 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.142 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.143 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.143 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.143 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2023-11-06T13:42:04.143 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2023-11-06T13:42:04.143 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.144 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.144 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.144 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-06T13:42:04.144 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.145 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.145 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.145 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.145 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.145 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.146 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.146 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.146 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2023-11-06T13:42:04.146 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2023-11-06T13:42:04.146 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.147 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.147 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.147 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.147 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.148 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.148 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.148 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.148 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.148 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.149 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.149 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.149 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:04.149 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:04.150 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.150 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.150 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.150 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2023-11-06T13:42:04.150 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2023-11-06T13:42:04.151 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.151 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.151 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.151 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.151 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.152 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.152 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2023-11-06T13:42:04.152 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2023-11-06T13:42:04.153 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.153 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.153 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.153 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2023-11-06T13:42:04.153 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.154 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.154 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.154 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.154 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2023-11-06T13:42:04.155 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2023-11-06T13:42:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.156 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.157 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.157 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.157 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.157 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.158 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.158 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.158 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.158 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.158 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.159 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.159 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.159 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.159 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.159 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.160 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.160 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.160 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.160 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.161 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.161 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.161 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.161 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.161 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.162 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.162 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.162 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.162 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.163 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.163 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.163 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.163 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.163 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.164 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.164 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.164 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.164 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.164 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.165 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.165 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.165 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.165 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.166 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.166 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.166 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.166 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.166 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.167 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.167 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.167 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.167 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.168 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.168 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.168 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.168 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.168 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.169 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.169 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.169 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.169 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.170 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.171 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.171 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.171 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.171 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.172 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.172 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.172 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.172 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.172 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.173 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.173 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.173 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.173 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.173 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2023-11-06T13:42:04.174 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2023-11-06T13:42:04.174 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.174 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.174 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.175 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.175 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.175 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.175 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.175 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.176 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.176 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.176 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.177 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2023-11-06T13:42:04.177 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2023-11-06T13:42:04.177 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.177 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.177 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.178 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.178 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.178 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.178 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.178 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.179 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.179 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.179 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.180 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2023-11-06T13:42:04.180 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2023-11-06T13:42:04.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.180 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.180 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.181 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-06T13:42:04.181 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.181 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.181 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.181 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.182 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.182 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.182 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.183 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2023-11-06T13:42:04.183 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.184 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.184 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.184 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.184 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.184 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.185 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.185 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.185 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.185 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.186 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.186 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.186 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.186 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.186 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.189 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.190 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.190 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.190 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.190 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.191 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.191 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.191 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.191 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.192 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.192 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.192 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.192 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.192 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.193 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.193 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.193 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.193 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.194 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.194 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.194 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.194 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.195 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.195 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.195 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.195 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.195 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.196 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.196 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.196 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.196 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.197 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.197 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.197 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.197 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.197 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.198 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.198 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.198 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.198 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.199 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.199 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.199 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.199 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.199 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.200 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.200 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.200 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.200 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.201 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.201 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.201 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.201 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.201 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.202 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.202 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.202 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.202 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.203 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.203 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.203 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.203 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2023-11-06T13:42:04.203 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.204 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.204 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.204 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.204 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.205 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.205 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.205 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.205 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.205 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.206 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.206 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.206 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.206 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.207 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.207 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.207 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.207 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.207 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.208 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.208 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.208 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.208 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.209 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.209 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.209 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.209 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.209 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.210 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.210 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.210 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.210 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.211 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.211 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.211 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.211 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.212 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.212 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.212 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.212 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.212 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.213 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.213 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.213 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.213 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.213 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.214 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.214 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.214 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.214 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.215 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.215 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.215 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.215 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.215 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.216 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.216 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.216 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.216 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.216 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.217 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.217 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.217 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.217 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.218 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.218 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.218 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.218 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.218 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.219 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.219 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.219 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.219 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2023-11-06T13:42:04.220 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2023-11-06T13:42:04.220 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.220 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.220 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.221 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2023-11-06T13:42:04.221 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.221 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.221 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.221 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-06T13:42:04.222 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.222 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.222 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.222 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2023-11-06T13:42:04.223 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2023-11-06T13:42:04.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.223 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.223 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.224 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:04.224 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.224 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.224 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.224 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-06T13:42:04.225 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.225 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.225 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.225 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.226 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.226 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.226 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.226 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2023-11-06T13:42:04.226 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.227 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.227 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.227 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2023-11-06T13:42:04.227 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2023-11-06T13:42:04.228 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.228 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.228 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.228 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2023-11-06T13:42:04.228 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.229 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.229 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.229 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.229 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.229 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.230 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.230 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.230 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2023-11-06T13:42:04.230 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2023-11-06T13:42:04.230 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.231 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.231 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.231 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.231 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.232 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.232 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.232 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.232 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.232 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.233 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.233 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.233 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:04.233 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:04.233 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.234 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.234 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.234 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:04.234 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.235 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.235 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.235 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.235 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.236 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.236 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.236 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.236 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.236 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.237 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.237 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.237 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.237 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.238 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.238 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.238 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.238 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.238 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.239 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.239 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.239 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.239 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.239 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.240 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.240 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.240 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.240 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.241 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.241 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.241 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.241 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.242 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.242 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.242 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.242 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.242 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.243 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.243 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.243 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.243 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.244 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.244 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.244 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.244 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.245 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.245 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.245 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.245 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.245 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.246 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.246 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.246 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.247 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.247 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.247 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.247 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.247 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.248 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.248 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.248 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.248 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.248 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.249 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.249 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.249 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.249 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.250 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.250 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.250 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.250 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.250 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.251 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.251 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.251 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.252 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2023-11-06T13:42:04.252 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2023-11-06T13:42:04.252 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.252 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.252 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.253 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.253 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.253 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.253 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.254 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.254 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.254 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.254 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.255 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.255 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2023-11-06T13:42:04.255 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2023-11-06T13:42:04.255 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.255 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.256 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.256 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2023-11-06T13:42:04.256 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.256 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.256 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.257 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.257 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.257 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.257 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.258 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.258 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2023-11-06T13:42:04.258 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2023-11-06T13:42:04.258 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.259 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.259 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.259 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-06T13:42:04.259 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.259 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.260 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.260 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.260 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.260 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.261 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.261 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.261 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.261 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.262 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:04.262 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.262 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.262 INFO:teuthology.orchestra.run.smithi038.stdout: "modules": [ 2023-11-06T13:42:04.263 INFO:teuthology.orchestra.run.smithi038.stdout: "iostat", 2023-11-06T13:42:04.263 INFO:teuthology.orchestra.run.smithi038.stdout: "nfs", 2023-11-06T13:42:04.263 INFO:teuthology.orchestra.run.smithi038.stdout: "restful" 2023-11-06T13:42:04.263 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.264 INFO:teuthology.orchestra.run.smithi038.stdout: "available_modules": [ 2023-11-06T13:42:04.264 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.264 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "alerts", 2023-11-06T13:42:04.264 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.265 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.265 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.265 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:04.265 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:04.266 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.266 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.266 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.266 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:04.267 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.267 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.267 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.267 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "How frequently to reexamine health status", 2023-11-06T13:42:04.268 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.268 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.268 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.268 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.268 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.269 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.269 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.269 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.269 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.270 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.270 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.270 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.270 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.270 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.271 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.271 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.271 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.271 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.272 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.272 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.272 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.272 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.273 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.273 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.273 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.273 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.273 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.274 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.274 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.274 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.274 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.274 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.275 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.275 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.275 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.275 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.276 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.276 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.276 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.276 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.277 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.277 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.277 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.277 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.278 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.278 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.278 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.278 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.279 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.279 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.279 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.279 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.279 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.280 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.280 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.280 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.280 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.281 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.281 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.281 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.281 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.281 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.282 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.282 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.282 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.282 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.283 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.283 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.283 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.283 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.283 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.284 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.284 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_destination": { 2023-11-06T13:42:04.284 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_destination", 2023-11-06T13:42:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.286 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.286 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.286 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email address to send alerts to", 2023-11-06T13:42:04.286 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.287 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.287 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.287 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.287 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_from_name": { 2023-11-06T13:42:04.287 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_from_name", 2023-11-06T13:42:04.288 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.288 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.288 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.288 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "Ceph", 2023-11-06T13:42:04.288 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.289 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.289 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.289 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Email From: name", 2023-11-06T13:42:04.289 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.289 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.290 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.290 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_host": { 2023-11-06T13:42:04.290 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_host", 2023-11-06T13:42:04.291 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.291 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.291 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.291 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.291 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.292 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.292 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.292 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP server", 2023-11-06T13:42:04.292 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.293 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.293 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.293 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.293 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_password": { 2023-11-06T13:42:04.293 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_password", 2023-11-06T13:42:04.294 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.294 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.294 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.294 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.295 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.295 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.295 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.295 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Password to authenticate with", 2023-11-06T13:42:04.295 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.296 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.296 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.296 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_port": { 2023-11-06T13:42:04.297 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_port", 2023-11-06T13:42:04.297 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.297 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.297 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.297 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "465", 2023-11-06T13:42:04.298 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.298 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.298 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.298 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP port", 2023-11-06T13:42:04.299 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.299 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.299 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.299 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.299 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_sender": { 2023-11-06T13:42:04.300 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_sender", 2023-11-06T13:42:04.300 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.300 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.300 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.300 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.301 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.301 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.301 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.301 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SMTP envelope sender", 2023-11-06T13:42:04.301 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.302 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.302 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.302 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_ssl": { 2023-11-06T13:42:04.303 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_ssl", 2023-11-06T13:42:04.303 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.303 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.303 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.304 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.304 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.304 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.304 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.304 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-06T13:42:04.305 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.305 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.305 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.305 INFO:teuthology.orchestra.run.smithi038.stdout: "smtp_user": { 2023-11-06T13:42:04.306 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "smtp_user", 2023-11-06T13:42:04.306 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.306 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.306 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.306 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.307 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.307 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.307 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.307 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "User to authenticate as", 2023-11-06T13:42:04.308 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.308 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.308 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.308 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.308 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.309 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.309 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "balancer", 2023-11-06T13:42:04.309 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.309 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.310 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.310 INFO:teuthology.orchestra.run.smithi038.stdout: "active": { 2023-11-06T13:42:04.310 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "active", 2023-11-06T13:42:04.310 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.311 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.311 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.311 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.311 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.312 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.312 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.312 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically balance PGs across cluster", 2023-11-06T13:42:04.312 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.312 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.313 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.313 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.313 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_time": { 2023-11-06T13:42:04.313 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_time", 2023-11-06T13:42:04.313 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.314 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.314 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.314 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0000", 2023-11-06T13:42:04.314 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.315 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.315 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.315 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "beginning time of day to automatically balance", 2023-11-06T13:42:04.315 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-06T13:42:04.315 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.316 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.316 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.316 INFO:teuthology.orchestra.run.smithi038.stdout: "begin_weekday": { 2023-11-06T13:42:04.316 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "begin_weekday", 2023-11-06T13:42:04.317 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:04.317 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.317 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.317 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:04.317 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2023-11-06T13:42:04.318 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "7", 2023-11-06T13:42:04.318 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.318 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-06T13:42:04.318 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-11-06T13:42:04.319 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.319 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.319 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.319 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_max_iterations": { 2023-11-06T13:42:04.319 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_max_iterations", 2023-11-06T13:42:04.320 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:04.320 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.320 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.320 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "25", 2023-11-06T13:42:04.320 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2023-11-06T13:42:04.321 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "250", 2023-11-06T13:42:04.321 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.321 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-06T13:42:04.321 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.322 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.322 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.322 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.322 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_metrics": { 2023-11-06T13:42:04.322 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_metrics", 2023-11-06T13:42:04.323 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.323 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.323 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.323 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "pgs,objects,bytes", 2023-11-06T13:42:04.323 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.324 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.324 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.324 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-06T13:42:04.324 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-06T13:42:04.325 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.325 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.325 INFO:teuthology.orchestra.run.smithi038.stdout: "crush_compat_step": { 2023-11-06T13:42:04.325 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crush_compat_step", 2023-11-06T13:42:04.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:04.326 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.326 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.326 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.5", 2023-11-06T13:42:04.326 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0.001", 2023-11-06T13:42:04.327 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "0.999", 2023-11-06T13:42:04.327 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.327 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "aggressiveness of optimization", 2023-11-06T13:42:04.327 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-06T13:42:04.328 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.328 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.328 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.328 INFO:teuthology.orchestra.run.smithi038.stdout: "end_time": { 2023-11-06T13:42:04.328 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_time", 2023-11-06T13:42:04.329 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.329 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.329 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.329 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2400", 2023-11-06T13:42:04.329 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.330 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.330 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.330 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ending time of day to automatically balance", 2023-11-06T13:42:04.330 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-06T13:42:04.331 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.331 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.331 INFO:teuthology.orchestra.run.smithi038.stdout: "end_weekday": { 2023-11-06T13:42:04.331 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "end_weekday", 2023-11-06T13:42:04.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:04.332 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.332 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.332 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7", 2023-11-06T13:42:04.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "0", 2023-11-06T13:42:04.333 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "7", 2023-11-06T13:42:04.333 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.333 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-06T13:42:04.334 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-11-06T13:42:04.334 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.334 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.334 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.334 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.335 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.335 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.335 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.335 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.336 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.336 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.336 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.336 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.337 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.337 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.337 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.337 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.337 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.338 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.338 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.338 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.338 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.338 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.339 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.339 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.339 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.340 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.340 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.340 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.340 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.340 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.341 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.341 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.341 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.341 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.341 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.342 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.342 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.342 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.342 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.342 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.343 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.343 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.343 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.343 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.344 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.344 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.344 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.344 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.345 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.345 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.345 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.345 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.345 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.346 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.346 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.346 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.346 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.347 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.347 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.347 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.347 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.347 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.348 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.348 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.348 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.348 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.348 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.349 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.349 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.349 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.349 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.349 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.350 INFO:teuthology.orchestra.run.smithi038.stdout: "min_score": { 2023-11-06T13:42:04.350 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_score", 2023-11-06T13:42:04.350 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:04.350 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.351 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.351 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:04.351 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.351 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.352 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.352 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-06T13:42:04.352 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.352 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.352 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.353 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.353 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2023-11-06T13:42:04.353 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2023-11-06T13:42:04.353 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.354 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.354 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.354 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "upmap", 2023-11-06T13:42:04.354 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.354 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.355 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.355 INFO:teuthology.orchestra.run.smithi038.stdout: "crush-compat", 2023-11-06T13:42:04.355 INFO:teuthology.orchestra.run.smithi038.stdout: "none", 2023-11-06T13:42:04.355 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap" 2023-11-06T13:42:04.356 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.356 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Balancer mode", 2023-11-06T13:42:04.356 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.356 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.356 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.357 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.357 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_ids": { 2023-11-06T13:42:04.357 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_ids", 2023-11-06T13:42:04.357 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.358 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.358 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.358 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.358 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.359 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.359 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.359 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-06T13:42:04.359 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.359 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.360 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.360 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.360 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:04.360 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:04.361 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.361 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.361 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.361 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:04.361 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.362 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.362 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.362 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-06T13:42:04.362 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.363 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.363 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.363 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.363 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_deviation": { 2023-11-06T13:42:04.363 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_deviation", 2023-11-06T13:42:04.364 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.364 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.364 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.364 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:04.364 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "1", 2023-11-06T13:42:04.365 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.365 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.365 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-06T13:42:04.365 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-06T13:42:04.366 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.366 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.366 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.366 INFO:teuthology.orchestra.run.smithi038.stdout: "upmap_max_optimizations": { 2023-11-06T13:42:04.366 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "upmap_max_optimizations", 2023-11-06T13:42:04.367 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "uint", 2023-11-06T13:42:04.367 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.367 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.367 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:04.367 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.368 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.368 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.368 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-06T13:42:04.368 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.369 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.369 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.369 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.369 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.370 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.370 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.370 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cephadm", 2023-11-06T13:42:04.370 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.370 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.371 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.371 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_ptrace": { 2023-11-06T13:42:04.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_ptrace", 2023-11-06T13:42:04.371 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.372 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.372 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.372 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.372 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.373 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.373 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.373 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-06T13:42:04.373 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-06T13:42:04.373 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.374 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.374 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_interval": { 2023-11-06T13:42:04.374 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_interval", 2023-11-06T13:42:04.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.375 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.375 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.375 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:04.376 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.376 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.376 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.376 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-06T13:42:04.377 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.377 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.377 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.377 INFO:teuthology.orchestra.run.smithi038.stdout: "autotune_memory_target_ratio": { 2023-11-06T13:42:04.378 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "autotune_memory_target_ratio", 2023-11-06T13:42:04.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:04.378 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.378 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.379 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0.7", 2023-11-06T13:42:04.379 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.379 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.379 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.380 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-06T13:42:04.380 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.380 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.380 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.381 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.381 INFO:teuthology.orchestra.run.smithi038.stdout: "config_checks_enabled": { 2023-11-06T13:42:04.381 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_checks_enabled", 2023-11-06T13:42:04.381 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.381 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.382 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.382 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.382 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.382 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.383 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.383 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-06T13:42:04.383 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.383 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.383 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.384 INFO:teuthology.orchestra.run.smithi038.stdout: "config_dashboard": { 2023-11-06T13:42:04.384 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "config_dashboard", 2023-11-06T13:42:04.384 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.385 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.385 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.385 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.385 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.385 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.386 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.386 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-06T13:42:04.386 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.386 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.387 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.387 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.387 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_alertmanager": { 2023-11-06T13:42:04.387 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_alertmanager", 2023-11-06T13:42:04.387 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.388 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.388 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.388 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.23.0", 2023-11-06T13:42:04.388 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.389 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.389 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.389 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:04.389 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.389 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.390 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.390 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.390 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_base": { 2023-11-06T13:42:04.390 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_base", 2023-11-06T13:42:04.391 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.391 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.391 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.391 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-06T13:42:04.391 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.392 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.392 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.392 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Container image name, without the tag", 2023-11-06T13:42:04.392 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.393 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.393 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.393 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.393 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_grafana": { 2023-11-06T13:42:04.393 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_grafana", 2023-11-06T13:42:04.394 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.394 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.394 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.394 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/ceph/ceph-grafana:8.3.5", 2023-11-06T13:42:04.395 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.395 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.395 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.395 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:04.395 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.396 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.396 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.396 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.396 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_haproxy": { 2023-11-06T13:42:04.397 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_haproxy", 2023-11-06T13:42:04.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.397 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.397 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.398 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/library/haproxy:2.3", 2023-11-06T13:42:04.398 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.398 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.398 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.398 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "HAproxy container image", 2023-11-06T13:42:04.399 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.399 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.399 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.399 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.400 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_keepalived": { 2023-11-06T13:42:04.400 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_keepalived", 2023-11-06T13:42:04.400 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.400 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.401 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.401 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/arcts/keepalived", 2023-11-06T13:42:04.401 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.401 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.402 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.402 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Keepalived container image", 2023-11-06T13:42:04.402 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.402 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.402 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.403 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.403 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_node_exporter": { 2023-11-06T13:42:04.403 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_node_exporter", 2023-11-06T13:42:04.403 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.404 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.404 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.404 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.3.1", 2023-11-06T13:42:04.404 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.404 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.405 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.405 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:04.405 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.405 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.406 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.406 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.406 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_prometheus": { 2023-11-06T13:42:04.406 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_prometheus", 2023-11-06T13:42:04.407 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.407 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.407 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.407 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "quay.io/prometheus/prometheus:v2.33.4", 2023-11-06T13:42:04.407 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.408 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.408 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.408 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Prometheus container image", 2023-11-06T13:42:04.408 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.409 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.409 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.409 INFO:teuthology.orchestra.run.smithi038.stdout: "container_image_snmp_gateway": { 2023-11-06T13:42:04.409 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_image_snmp_gateway", 2023-11-06T13:42:04.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-06T13:42:04.410 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "SNMP Gateway container image", 2023-11-06T13:42:04.411 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.412 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.412 INFO:teuthology.orchestra.run.smithi038.stdout: "container_init": { 2023-11-06T13:42:04.412 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "container_init", 2023-11-06T13:42:04.413 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.413 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.413 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.413 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.413 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.414 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.414 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.414 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Run podman/docker with `--init`", 2023-11-06T13:42:04.414 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.415 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.415 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.415 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.415 INFO:teuthology.orchestra.run.smithi038.stdout: "daemon_cache_timeout": { 2023-11-06T13:42:04.415 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "daemon_cache_timeout", 2023-11-06T13:42:04.416 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.416 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.416 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.416 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:04.416 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.417 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.417 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.417 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-06T13:42:04.417 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.418 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.418 INFO:teuthology.orchestra.run.smithi038.stdout: "default_registry": { 2023-11-06T13:42:04.418 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "default_registry", 2023-11-06T13:42:04.419 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.419 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.419 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "docker.io", 2023-11-06T13:42:04.419 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.420 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.420 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.420 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-06T13:42:04.420 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.421 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.421 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.421 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.421 INFO:teuthology.orchestra.run.smithi038.stdout: "device_cache_timeout": { 2023-11-06T13:42:04.421 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_cache_timeout", 2023-11-06T13:42:04.422 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.422 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.422 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.422 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1800", 2023-11-06T13:42:04.423 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.423 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.423 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.423 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache device inventory", 2023-11-06T13:42:04.423 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.424 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.424 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.424 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.424 INFO:teuthology.orchestra.run.smithi038.stdout: "device_enhanced_scan": { 2023-11-06T13:42:04.424 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_enhanced_scan", 2023-11-06T13:42:04.425 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.425 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.425 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.425 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.426 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.426 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.426 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.426 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-06T13:42:04.426 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.427 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.427 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.427 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.427 INFO:teuthology.orchestra.run.smithi038.stdout: "facts_cache_timeout": { 2023-11-06T13:42:04.427 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "facts_cache_timeout", 2023-11-06T13:42:04.428 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.428 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.428 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.428 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:04.429 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.429 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.429 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.429 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "seconds to cache host facts data", 2023-11-06T13:42:04.429 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.430 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.430 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.430 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.430 INFO:teuthology.orchestra.run.smithi038.stdout: "host_check_interval": { 2023-11-06T13:42:04.431 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "host_check_interval", 2023-11-06T13:42:04.431 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.431 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.431 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.431 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:04.432 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.432 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.432 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.432 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to perform a host check", 2023-11-06T13:42:04.432 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.433 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.433 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.433 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.433 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.434 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.434 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.434 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.434 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.435 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.435 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.435 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.435 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.435 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.436 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.436 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.436 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.436 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.437 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.437 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.437 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.437 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.437 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.438 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.438 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.438 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.438 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.439 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.439 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.439 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.439 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.440 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.440 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.440 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.440 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-06T13:42:04.440 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.441 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.441 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.441 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.441 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.442 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.442 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.442 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.442 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.442 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.443 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.443 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.443 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.443 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.444 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.444 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.444 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.444 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.445 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.445 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.445 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.445 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.445 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.446 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.446 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.446 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.447 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.447 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.447 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.447 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.447 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.448 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.448 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.448 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.448 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.449 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.449 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.449 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-06T13:42:04.449 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-06T13:42:04.450 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.450 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.450 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.450 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.451 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.451 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.451 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.451 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-06T13:42:04.452 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.452 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.452 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.453 INFO:teuthology.orchestra.run.smithi038.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-06T13:42:04.453 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-06T13:42:04.453 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.453 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.453 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.454 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "*", 2023-11-06T13:42:04.454 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.454 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.454 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.455 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-06T13:42:04.455 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.455 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.455 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.455 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.456 INFO:teuthology.orchestra.run.smithi038.stdout: "max_count_per_host": { 2023-11-06T13:42:04.456 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_count_per_host", 2023-11-06T13:42:04.456 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.456 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.456 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.457 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:04.457 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.457 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.457 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.458 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of daemons per service per host", 2023-11-06T13:42:04.458 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.458 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.458 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.458 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.459 INFO:teuthology.orchestra.run.smithi038.stdout: "max_osd_draining_count": { 2023-11-06T13:42:04.459 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_osd_draining_count", 2023-11-06T13:42:04.459 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.459 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.459 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.461 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:04.461 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.461 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.462 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.462 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-06T13:42:04.462 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.462 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.463 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.463 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.463 INFO:teuthology.orchestra.run.smithi038.stdout: "migration_current": { 2023-11-06T13:42:04.463 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "migration_current", 2023-11-06T13:42:04.463 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.464 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.464 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.464 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.464 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.464 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.465 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.465 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "internal - do not modify", 2023-11-06T13:42:04.465 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.465 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.466 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.466 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.466 INFO:teuthology.orchestra.run.smithi038.stdout: "mode": { 2023-11-06T13:42:04.466 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mode", 2023-11-06T13:42:04.466 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.467 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.467 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.467 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "root", 2023-11-06T13:42:04.467 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm-package", 2023-11-06T13:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout: "root" 2023-11-06T13:42:04.468 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.469 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "mode for remote execution of cephadm", 2023-11-06T13:42:04.469 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.469 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.469 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.469 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.470 INFO:teuthology.orchestra.run.smithi038.stdout: "prometheus_alerts_path": { 2023-11-06T13:42:04.470 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus_alerts_path", 2023-11-06T13:42:04.470 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.470 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.471 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.471 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-06T13:42:04.471 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.471 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.471 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.472 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-06T13:42:04.472 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.472 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.472 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.473 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.473 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_insecure": { 2023-11-06T13:42:04.473 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_insecure", 2023-11-06T13:42:04.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.473 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.474 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.474 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.474 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.474 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.475 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.475 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-06T13:42:04.475 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.475 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.475 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.476 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.476 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_password": { 2023-11-06T13:42:04.476 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_password", 2023-11-06T13:42:04.476 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.477 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.477 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.477 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.477 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.477 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.478 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.478 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-06T13:42:04.478 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.478 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.479 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.479 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.479 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_url": { 2023-11-06T13:42:04.479 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_url", 2023-11-06T13:42:04.479 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.480 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.480 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.480 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.480 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.481 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.481 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.481 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-06T13:42:04.481 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.481 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.482 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.482 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.482 INFO:teuthology.orchestra.run.smithi038.stdout: "registry_username": { 2023-11-06T13:42:04.482 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "registry_username", 2023-11-06T13:42:04.483 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.483 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.483 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.483 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.483 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.484 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.484 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.484 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-06T13:42:04.484 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.485 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.485 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.485 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.485 INFO:teuthology.orchestra.run.smithi038.stdout: "ssh_config_file": { 2023-11-06T13:42:04.485 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssh_config_file", 2023-11-06T13:42:04.486 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.486 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.486 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.486 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.487 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.487 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.487 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.487 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-06T13:42:04.487 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.488 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.488 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.488 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.488 INFO:teuthology.orchestra.run.smithi038.stdout: "use_repo_digest": { 2023-11-06T13:42:04.489 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "use_repo_digest", 2023-11-06T13:42:04.489 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.489 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.489 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.489 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.490 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.490 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.490 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.490 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-06T13:42:04.491 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.491 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.491 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.491 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.491 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_failed_host_check": { 2023-11-06T13:42:04.492 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_failed_host_check", 2023-11-06T13:42:04.492 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.492 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.492 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.492 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.493 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.493 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.493 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.493 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if the host check fails", 2023-11-06T13:42:04.494 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.494 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.494 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.494 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.494 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_daemons": { 2023-11-06T13:42:04.495 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_daemons", 2023-11-06T13:42:04.495 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.495 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.495 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.495 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.496 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.496 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.496 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.496 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-06T13:42:04.497 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.497 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.497 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.497 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.497 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_on_stray_hosts": { 2023-11-06T13:42:04.498 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_on_stray_hosts", 2023-11-06T13:42:04.498 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.498 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.498 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.498 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.499 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.499 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.499 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.499 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-06T13:42:04.499 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.500 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.500 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.500 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.500 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.501 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.501 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.501 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crash", 2023-11-06T13:42:04.501 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.501 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.502 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.502 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.502 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.502 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.503 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.503 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.503 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.503 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.503 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.504 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.504 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.504 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.504 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.505 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.505 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.505 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.505 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.506 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.506 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.506 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.506 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.507 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.507 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.507 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.507 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.507 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.508 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.508 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.508 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.508 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.509 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.509 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.509 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.509 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.509 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.510 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.511 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.511 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.511 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.511 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.512 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.512 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.512 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.512 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.512 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.513 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.513 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.513 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.513 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.514 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.514 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.514 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.514 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.515 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.515 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.515 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.515 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.515 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.516 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.516 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.516 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.516 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.516 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.517 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.517 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.517 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.517 INFO:teuthology.orchestra.run.smithi038.stdout: "retain_interval": { 2023-11-06T13:42:04.517 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retain_interval", 2023-11-06T13:42:04.518 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.518 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.518 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.518 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "31536000", 2023-11-06T13:42:04.519 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.519 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.519 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.519 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-06T13:42:04.519 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.520 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.520 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.520 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.520 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_recent_interval": { 2023-11-06T13:42:04.521 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_recent_interval", 2023-11-06T13:42:04.521 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.521 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.521 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.522 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1209600", 2023-11-06T13:42:04.522 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.522 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.522 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.522 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-06T13:42:04.523 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.523 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.523 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.523 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.524 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.524 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.524 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.524 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dashboard", 2023-11-06T13:42:04.524 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.525 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.525 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.525 INFO:teuthology.orchestra.run.smithi038.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-06T13:42:04.525 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-06T13:42:04.525 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.526 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.526 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.526 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:04.526 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.527 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.527 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.527 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.527 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.527 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.528 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.528 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.528 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_HOST": { 2023-11-06T13:42:04.528 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-06T13:42:04.528 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.529 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.529 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.529 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.529 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.530 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.530 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.530 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.530 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.530 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.531 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.531 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.531 INFO:teuthology.orchestra.run.smithi038.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-06T13:42:04.531 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-06T13:42:04.531 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.532 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.532 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.532 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.532 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.533 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.533 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.533 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.533 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.534 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.534 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.534 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.534 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_ENABLED": { 2023-11-06T13:42:04.534 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_ENABLED", 2023-11-06T13:42:04.535 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.535 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.535 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.535 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.536 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.536 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.536 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.536 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.536 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.537 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.537 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.537 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.537 INFO:teuthology.orchestra.run.smithi038.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-06T13:42:04.538 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-06T13:42:04.538 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.538 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.538 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.538 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.539 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.540 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.540 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.540 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.540 INFO:teuthology.orchestra.run.smithi038.stdout: "ENABLE_BROWSABLE_API": { 2023-11-06T13:42:04.541 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-06T13:42:04.541 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.541 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.541 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.541 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.542 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.542 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.542 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.542 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.543 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.543 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.543 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.543 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.544 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-06T13:42:04.544 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-06T13:42:04.544 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.544 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.544 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.545 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.545 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.545 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.545 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.546 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.546 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.546 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.546 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.546 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.547 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-06T13:42:04.547 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-06T13:42:04.547 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.547 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.548 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.548 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.548 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.548 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.548 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.549 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.549 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.549 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.549 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.550 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.550 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-06T13:42:04.550 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-06T13:42:04.550 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.551 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.551 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.551 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.551 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.551 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.552 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.552 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.552 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.552 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.552 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.553 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.553 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-06T13:42:04.553 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-06T13:42:04.553 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.554 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.554 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.554 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.554 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.554 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.555 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.555 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.555 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.555 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.556 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.556 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.556 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-06T13:42:04.556 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-06T13:42:04.556 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.557 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.557 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.557 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.557 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.557 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.558 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.558 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.558 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.558 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.559 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.559 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.559 INFO:teuthology.orchestra.run.smithi038.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-06T13:42:04.559 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-06T13:42:04.560 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.560 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.560 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.560 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.560 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.561 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.561 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.561 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.561 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.562 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.562 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.562 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.562 INFO:teuthology.orchestra.run.smithi038.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-06T13:42:04.562 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-06T13:42:04.563 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.563 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.563 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.563 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.563 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.564 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.564 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.564 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.564 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.564 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.565 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.565 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.565 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_PASSWORD": { 2023-11-06T13:42:04.565 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-06T13:42:04.566 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.566 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.566 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.566 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:04.567 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.567 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.567 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.567 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.567 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.568 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.568 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.568 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.568 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-06T13:42:04.569 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-06T13:42:04.569 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.569 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.569 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.569 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.570 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.570 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.570 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.570 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.571 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.571 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.571 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.571 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.572 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_URL": { 2023-11-06T13:42:04.572 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_URL", 2023-11-06T13:42:04.572 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.572 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.573 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.573 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.573 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.573 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.574 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.574 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.574 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.574 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.575 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.575 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.575 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_API_USERNAME": { 2023-11-06T13:42:04.575 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-06T13:42:04.575 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.576 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.576 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.576 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:04.576 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.577 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.577 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.577 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.577 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.578 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.578 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.578 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.578 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-06T13:42:04.579 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-06T13:42:04.579 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.579 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.579 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.580 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.580 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.580 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.580 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.580 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.581 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.581 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.581 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.581 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.582 INFO:teuthology.orchestra.run.smithi038.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-06T13:42:04.582 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-06T13:42:04.582 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.582 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.582 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.583 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.583 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.583 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.583 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.584 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.584 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.584 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.584 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.584 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-06T13:42:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-06T13:42:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.585 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.586 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.586 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.586 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.586 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.587 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.587 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.587 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.587 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.587 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.588 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_HOST": { 2023-11-06T13:42:04.588 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-06T13:42:04.588 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.588 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.589 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.589 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.589 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.589 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.590 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.590 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.590 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.590 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.591 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.591 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.591 INFO:teuthology.orchestra.run.smithi038.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-06T13:42:04.591 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-06T13:42:04.591 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.592 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.592 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.592 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.592 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.592 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.593 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.593 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.593 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.593 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.594 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.594 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.594 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-06T13:42:04.594 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-06T13:42:04.595 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.595 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.595 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.595 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.596 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.596 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.596 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.596 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.596 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.597 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.597 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.597 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.597 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-06T13:42:04.598 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-06T13:42:04.598 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.598 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.598 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.598 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.599 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.599 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.599 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.599 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.600 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.600 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.600 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.600 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.600 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-06T13:42:04.601 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-06T13:42:04.601 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.601 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.601 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.601 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.602 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.602 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.602 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.602 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.603 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.603 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.603 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.603 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.603 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-06T13:42:04.604 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-06T13:42:04.604 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.604 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.604 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.605 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.605 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.605 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.605 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.605 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.606 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.606 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.606 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.606 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.607 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-06T13:42:04.607 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-06T13:42:04.607 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.607 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.608 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.608 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.608 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.608 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.608 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.609 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.609 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.609 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.609 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.609 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.610 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-06T13:42:04.610 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-06T13:42:04.610 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.610 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.611 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.611 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.611 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.611 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.612 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.612 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.612 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.612 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.612 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.613 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.613 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-06T13:42:04.613 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-06T13:42:04.613 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.614 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.614 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.614 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.614 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.615 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.615 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.615 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.615 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.615 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.616 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.616 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.616 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_ENABLED": { 2023-11-06T13:42:04.616 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-06T13:42:04.616 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.617 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.617 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.617 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.617 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.618 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.618 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.618 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.618 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.618 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.619 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.619 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.619 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-06T13:42:04.619 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-06T13:42:04.620 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.620 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.620 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.620 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-06T13:42:04.621 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.621 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.621 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.621 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.622 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.622 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.622 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.622 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.623 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-06T13:42:04.623 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-06T13:42:04.623 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.623 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.623 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.624 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.625 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.625 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.625 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.625 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.626 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.626 INFO:teuthology.orchestra.run.smithi038.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-06T13:42:04.626 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-06T13:42:04.626 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.626 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.627 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.627 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8", 2023-11-06T13:42:04.627 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.627 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.627 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.628 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.628 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.628 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.628 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.629 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.629 INFO:teuthology.orchestra.run.smithi038.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-06T13:42:04.629 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-06T13:42:04.629 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.629 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.630 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.630 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "45", 2023-11-06T13:42:04.630 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.630 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.631 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.631 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.631 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.631 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.631 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.632 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.632 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ACCESS_KEY": { 2023-11-06T13:42:04.632 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-06T13:42:04.632 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.633 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.633 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.633 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.633 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.633 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.634 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.634 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.634 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.634 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.635 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.635 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.635 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-06T13:42:04.635 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-06T13:42:04.635 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.636 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.636 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.636 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "admin", 2023-11-06T13:42:04.636 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.637 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.637 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.637 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.637 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.637 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.638 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.638 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.638 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SECRET_KEY": { 2023-11-06T13:42:04.638 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-06T13:42:04.639 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.639 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.639 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.639 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.639 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.640 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.640 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.640 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.640 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.640 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.641 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.641 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.641 INFO:teuthology.orchestra.run.smithi038.stdout: "RGW_API_SSL_VERIFY": { 2023-11-06T13:42:04.641 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-06T13:42:04.642 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.642 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.642 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.642 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.642 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.643 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.643 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.643 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.643 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.644 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.644 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.644 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.644 INFO:teuthology.orchestra.run.smithi038.stdout: "UNSAFE_TLS_v1_2": { 2023-11-06T13:42:04.644 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-06T13:42:04.645 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.645 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.645 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.645 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.646 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.646 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.646 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.646 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.647 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.647 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.647 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.647 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.647 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-06T13:42:04.648 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-06T13:42:04.648 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.648 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.648 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.649 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:04.649 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.649 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.649 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.649 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.650 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.650 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.650 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.650 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.651 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-06T13:42:04.651 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-06T13:42:04.651 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.651 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.651 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.652 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:04.652 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.652 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.652 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.653 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.653 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.653 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.653 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.653 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-06T13:42:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-06T13:42:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.654 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.655 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:04.655 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.655 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.655 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.656 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.656 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.656 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.656 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.657 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.657 INFO:teuthology.orchestra.run.smithi038.stdout: "cross_origin_url": { 2023-11-06T13:42:04.657 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cross_origin_url", 2023-11-06T13:42:04.657 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.657 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.658 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.658 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.658 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.658 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.659 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.659 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.659 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.659 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.659 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.660 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.660 INFO:teuthology.orchestra.run.smithi038.stdout: "crt_file": { 2023-11-06T13:42:04.660 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "crt_file", 2023-11-06T13:42:04.660 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.661 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.661 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.661 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.661 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.661 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.662 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.662 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.662 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.665 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.665 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.666 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.666 INFO:teuthology.orchestra.run.smithi038.stdout: "debug": { 2023-11-06T13:42:04.666 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "debug", 2023-11-06T13:42:04.666 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.667 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.667 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.667 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.667 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.668 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.668 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.668 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Enable/disable debug options", 2023-11-06T13:42:04.668 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.669 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.669 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.669 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.669 INFO:teuthology.orchestra.run.smithi038.stdout: "jwt_token_ttl": { 2023-11-06T13:42:04.669 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "jwt_token_ttl", 2023-11-06T13:42:04.670 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.670 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.670 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.670 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "28800", 2023-11-06T13:42:04.670 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.671 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.671 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.671 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.671 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.671 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.672 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.672 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.672 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2023-11-06T13:42:04.672 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2023-11-06T13:42:04.673 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.673 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.673 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.673 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.673 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.674 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.674 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.674 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.674 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.675 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.675 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.675 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.675 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.676 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.676 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.676 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.676 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.677 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.677 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.677 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.677 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.677 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.678 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.678 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.678 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.678 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.679 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.679 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.679 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.679 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.679 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.680 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.680 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.680 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.680 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.681 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.681 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.681 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.681 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.682 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.682 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.682 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.682 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.683 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.683 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.683 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.683 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.684 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.684 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.684 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.684 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.685 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.685 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.685 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.685 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.686 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.686 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.686 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.686 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.686 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.687 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.687 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.687 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.687 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.688 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.688 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.688 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.688 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.689 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.689 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.689 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.689 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.689 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.690 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.690 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.690 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.690 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.691 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.691 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.691 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.691 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.692 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.692 INFO:teuthology.orchestra.run.smithi038.stdout: "motd": { 2023-11-06T13:42:04.692 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "motd", 2023-11-06T13:42:04.692 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.693 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.693 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.693 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.693 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.693 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.694 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.694 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "The message of the day", 2023-11-06T13:42:04.694 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.694 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.695 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.695 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.695 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect_resolve_ip_addr": { 2023-11-06T13:42:04.695 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "redirect_resolve_ip_addr", 2023-11-06T13:42:04.695 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.696 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.696 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.696 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.696 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.697 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.697 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.697 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.697 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.697 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.698 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.698 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.698 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:04.698 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:04.699 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.699 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.699 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.699 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "::", 2023-11-06T13:42:04.699 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.700 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.700 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.700 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.700 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.700 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.701 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.701 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.701 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:04.701 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:04.702 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.702 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.702 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.702 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8080", 2023-11-06T13:42:04.702 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.703 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.703 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.703 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.703 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.704 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.704 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.704 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.704 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2023-11-06T13:42:04.705 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2023-11-06T13:42:04.705 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.705 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.705 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.706 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.706 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.706 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.706 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.707 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.707 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.707 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.707 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.708 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.708 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl_server_port": { 2023-11-06T13:42:04.708 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl_server_port", 2023-11-06T13:42:04.708 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.709 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.709 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.709 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8443", 2023-11-06T13:42:04.709 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.710 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.710 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.710 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.710 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.711 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.711 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.711 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.711 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2023-11-06T13:42:04.712 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2023-11-06T13:42:04.712 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.712 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.712 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.712 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "redirect", 2023-11-06T13:42:04.713 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.713 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.713 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.713 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.714 INFO:teuthology.orchestra.run.smithi038.stdout: "redirect" 2023-11-06T13:42:04.714 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.714 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.714 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.714 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.715 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.715 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.715 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2023-11-06T13:42:04.715 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2023-11-06T13:42:04.716 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.716 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.716 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.716 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2023-11-06T13:42:04.716 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2023-11-06T13:42:04.717 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2023-11-06T13:42:04.717 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.717 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.717 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.718 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.718 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.718 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.718 INFO:teuthology.orchestra.run.smithi038.stdout: "url_prefix": { 2023-11-06T13:42:04.718 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url_prefix", 2023-11-06T13:42:04.719 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.719 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.719 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.719 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.720 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.720 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.720 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.720 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.720 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.721 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.721 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.721 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.721 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.722 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.722 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.722 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "devicehealth", 2023-11-06T13:42:04.722 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.723 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.723 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.723 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_monitoring": { 2023-11-06T13:42:04.723 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_monitoring", 2023-11-06T13:42:04.724 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.724 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.724 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.724 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.724 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.725 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.725 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.725 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "monitor device health metrics", 2023-11-06T13:42:04.725 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.726 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.726 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.726 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.726 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.727 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.727 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.727 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.727 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.728 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.728 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.728 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.728 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.728 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.729 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.729 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.729 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.729 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.730 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.730 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.730 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.730 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.731 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.731 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.731 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.731 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.731 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.732 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.732 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.732 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.732 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.732 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.732 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.733 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.733 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.733 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.733 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.734 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.734 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.734 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.734 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.735 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.735 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.735 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.735 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.735 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.736 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.736 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.736 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.736 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.737 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.737 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.737 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.737 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.737 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.738 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.738 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.738 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.738 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.739 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.739 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.739 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.739 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.740 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.740 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.740 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.740 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.740 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.741 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.741 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.741 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.741 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.742 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.742 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.742 INFO:teuthology.orchestra.run.smithi038.stdout: "mark_out_threshold": { 2023-11-06T13:42:04.742 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mark_out_threshold", 2023-11-06T13:42:04.742 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.743 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.743 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.743 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "2419200", 2023-11-06T13:42:04.743 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.744 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.744 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.744 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-06T13:42:04.744 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.744 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.745 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.745 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.745 INFO:teuthology.orchestra.run.smithi038.stdout: "pool_name": { 2023-11-06T13:42:04.745 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pool_name", 2023-11-06T13:42:04.746 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.746 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.746 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.746 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "device_health_metrics", 2023-11-06T13:42:04.747 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.747 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.747 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.747 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-06T13:42:04.747 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.748 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.748 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.748 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.748 INFO:teuthology.orchestra.run.smithi038.stdout: "retention_period": { 2023-11-06T13:42:04.749 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "retention_period", 2023-11-06T13:42:04.749 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.749 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.749 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.750 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15552000", 2023-11-06T13:42:04.750 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.750 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.750 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.750 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long to retain device health metrics", 2023-11-06T13:42:04.751 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.751 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.751 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.751 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.752 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_frequency": { 2023-11-06T13:42:04.752 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_frequency", 2023-11-06T13:42:04.752 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.752 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.753 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.753 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2023-11-06T13:42:04.753 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.753 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.753 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.754 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-06T13:42:04.754 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.754 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.754 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.755 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.755 INFO:teuthology.orchestra.run.smithi038.stdout: "self_heal": { 2023-11-06T13:42:04.755 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "self_heal", 2023-11-06T13:42:04.755 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.756 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.756 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.756 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:04.756 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.756 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.757 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.757 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-06T13:42:04.757 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.757 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.758 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.758 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.758 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:04.758 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:04.758 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.759 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.759 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.759 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:04.759 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.759 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.760 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.760 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how frequently to wake up and check device health", 2023-11-06T13:42:04.760 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.760 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.761 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.761 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.761 INFO:teuthology.orchestra.run.smithi038.stdout: "warn_threshold": { 2023-11-06T13:42:04.761 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "warn_threshold", 2023-11-06T13:42:04.761 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:04.762 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.762 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.762 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "7257600", 2023-11-06T13:42:04.762 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.762 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.763 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.763 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-06T13:42:04.763 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.763 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.764 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.764 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.764 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.764 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.764 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.765 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "diskprediction_local", 2023-11-06T13:42:04.765 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.765 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.765 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.765 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.766 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.766 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.766 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.766 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.767 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.767 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.767 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.767 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.767 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.768 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.768 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.768 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.768 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.769 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.769 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.769 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.769 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.769 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.770 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.770 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.770 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.770 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.771 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.771 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.771 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.771 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.771 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.772 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.772 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.772 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.772 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.773 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.773 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.773 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.773 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.774 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.774 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.774 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.774 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.774 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.775 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.775 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.775 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.775 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.776 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.776 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.776 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.776 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.776 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.777 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.777 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.777 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.777 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.777 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.778 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.778 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.778 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.778 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.779 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.779 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.779 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.779 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.779 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.780 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.780 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.780 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.780 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.781 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.781 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.781 INFO:teuthology.orchestra.run.smithi038.stdout: "predict_interval": { 2023-11-06T13:42:04.781 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predict_interval", 2023-11-06T13:42:04.782 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.782 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.782 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.782 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "86400", 2023-11-06T13:42:04.783 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.783 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.783 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.783 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.784 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.784 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.784 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.784 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.785 INFO:teuthology.orchestra.run.smithi038.stdout: "predictor_model": { 2023-11-06T13:42:04.785 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "predictor_model", 2023-11-06T13:42:04.785 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.785 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.785 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.786 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "prophetstor", 2023-11-06T13:42:04.786 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.786 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.786 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.787 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.787 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.787 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.787 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.788 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.788 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:04.788 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:04.788 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.788 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.789 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.789 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "600", 2023-11-06T13:42:04.789 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.789 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.789 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.790 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.790 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.790 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.790 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.791 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.791 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.791 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.791 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.792 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "influx", 2023-11-06T13:42:04.792 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": false, 2023-11-06T13:42:04.792 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "influxdb python module not found", 2023-11-06T13:42:04.792 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.792 INFO:teuthology.orchestra.run.smithi038.stdout: "batch_size": { 2023-11-06T13:42:04.793 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "batch_size", 2023-11-06T13:42:04.793 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.793 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.793 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.794 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5000", 2023-11-06T13:42:04.794 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.794 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.794 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.795 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.795 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.795 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.795 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.795 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.796 INFO:teuthology.orchestra.run.smithi038.stdout: "database": { 2023-11-06T13:42:04.796 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "database", 2023-11-06T13:42:04.796 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.796 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.796 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.797 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "ceph", 2023-11-06T13:42:04.797 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.797 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.797 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.798 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.798 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.798 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.798 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.799 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.799 INFO:teuthology.orchestra.run.smithi038.stdout: "hostname": { 2023-11-06T13:42:04.799 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "hostname", 2023-11-06T13:42:04.799 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.800 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.800 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.800 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.800 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.800 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.801 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.801 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.801 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.801 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.802 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.802 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.802 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:04.802 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:04.802 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.803 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.803 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.803 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "30", 2023-11-06T13:42:04.803 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.804 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.804 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.804 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.804 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.804 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.805 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.805 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.805 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.805 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.806 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.806 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.806 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.806 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.806 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.807 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.807 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.807 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.807 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.808 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.808 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.808 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.808 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.809 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.809 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.809 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.809 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.809 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.810 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.810 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.810 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.810 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.811 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.812 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.812 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.812 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.812 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.813 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.813 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.813 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.813 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.813 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.814 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.814 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.814 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.814 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.815 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.815 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.815 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.815 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.815 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.816 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.816 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.816 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.816 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.816 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.817 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.817 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.817 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.817 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.817 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.818 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.818 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.818 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.818 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.819 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.819 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.819 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.819 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.820 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.820 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.820 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.820 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.821 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.821 INFO:teuthology.orchestra.run.smithi038.stdout: "password": { 2023-11-06T13:42:04.821 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "password", 2023-11-06T13:42:04.821 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.821 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.822 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.822 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.822 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.822 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.822 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.823 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.823 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.823 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.823 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.824 INFO:teuthology.orchestra.run.smithi038.stdout: "port": { 2023-11-06T13:42:04.824 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "port", 2023-11-06T13:42:04.824 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.824 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.825 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.825 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "8086", 2023-11-06T13:42:04.825 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.825 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.825 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.826 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.826 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.826 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.826 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.827 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.827 INFO:teuthology.orchestra.run.smithi038.stdout: "ssl": { 2023-11-06T13:42:04.827 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "ssl", 2023-11-06T13:42:04.827 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.827 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.828 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.828 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "false", 2023-11-06T13:42:04.828 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.828 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.829 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.829 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.829 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.829 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.830 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.830 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.830 INFO:teuthology.orchestra.run.smithi038.stdout: "threads": { 2023-11-06T13:42:04.830 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "threads", 2023-11-06T13:42:04.830 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.831 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.831 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.831 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:04.831 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.831 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.832 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.832 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.832 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.832 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.833 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.833 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.833 INFO:teuthology.orchestra.run.smithi038.stdout: "username": { 2023-11-06T13:42:04.833 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "username", 2023-11-06T13:42:04.833 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.834 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.834 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.834 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:04.834 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.835 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.835 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.835 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.836 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.836 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.836 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.836 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.836 INFO:teuthology.orchestra.run.smithi038.stdout: "verify_ssl": { 2023-11-06T13:42:04.837 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "verify_ssl", 2023-11-06T13:42:04.837 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.837 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.837 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:04.838 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "true", 2023-11-06T13:42:04.838 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.838 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.838 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.839 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.839 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.839 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.839 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.839 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.840 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.840 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.840 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.841 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "insights", 2023-11-06T13:42:04.841 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.841 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.841 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.842 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.842 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.842 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.842 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.843 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.843 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.843 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.843 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.844 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.844 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.844 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.844 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.844 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.845 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.845 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.845 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.845 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.846 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.846 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.846 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.846 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.846 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.847 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.847 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.847 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.847 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.848 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.848 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.848 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.848 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.848 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.849 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.850 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.851 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.851 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.851 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.851 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.851 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.852 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.852 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.852 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.852 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.853 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.853 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.853 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.853 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.853 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.854 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.854 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.854 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.854 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.855 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.855 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.855 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.855 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.856 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.856 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.856 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.856 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.857 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.857 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.857 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.857 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.858 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.858 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.858 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.858 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "iostat", 2023-11-06T13:42:04.859 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.859 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.859 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.859 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.859 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.860 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.860 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.860 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.860 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.860 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.861 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.861 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.861 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.861 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.862 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.862 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.862 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.862 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.863 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.863 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.863 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.863 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.863 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.864 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.864 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.864 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.864 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.865 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.865 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.865 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.865 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.866 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.866 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.866 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.866 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.867 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.867 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.867 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.869 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.869 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.870 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.870 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.870 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.871 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.871 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.871 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.871 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.871 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.872 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.872 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.872 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.872 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.873 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.873 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.873 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.873 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.873 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.874 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.874 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.874 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.874 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.875 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.875 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.875 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.875 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.876 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.876 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.876 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.876 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.877 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.877 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.877 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.877 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.878 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.878 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.878 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.878 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "localpool", 2023-11-06T13:42:04.879 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.879 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.879 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.880 INFO:teuthology.orchestra.run.smithi038.stdout: "failure_domain": { 2023-11-06T13:42:04.880 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "failure_domain", 2023-11-06T13:42:04.880 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.880 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.881 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.881 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "host", 2023-11-06T13:42:04.881 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.881 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.882 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.882 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "failure domain for any created local pool", 2023-11-06T13:42:04.882 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.882 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.883 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.883 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.883 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.883 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.884 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.884 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.884 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.884 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.884 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.885 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.885 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.885 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.885 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.886 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.886 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.886 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.886 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.887 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.887 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.887 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.887 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.888 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.888 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.888 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.888 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.888 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.889 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.889 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.889 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.889 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.890 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.890 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.890 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.890 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.890 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.891 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.891 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.891 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.891 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.892 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.892 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.892 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.892 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.892 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.893 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.893 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.893 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.893 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.894 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.894 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.894 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.894 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.895 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.895 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.895 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.895 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.895 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.896 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.896 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.896 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.896 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.897 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.897 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.897 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.897 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.897 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.898 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.898 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.898 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.898 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.899 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.899 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.899 INFO:teuthology.orchestra.run.smithi038.stdout: "min_size": { 2023-11-06T13:42:04.899 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "min_size", 2023-11-06T13:42:04.900 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.900 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.900 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.900 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.900 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.901 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.901 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.901 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default min_size for any created local pool", 2023-11-06T13:42:04.901 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.902 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.902 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.902 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.902 INFO:teuthology.orchestra.run.smithi038.stdout: "num_rep": { 2023-11-06T13:42:04.903 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "num_rep", 2023-11-06T13:42:04.903 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.903 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.903 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.904 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "3", 2023-11-06T13:42:04.904 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.904 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.904 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.905 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default replica count for any created local pool", 2023-11-06T13:42:04.905 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.905 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.905 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.905 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.906 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_num": { 2023-11-06T13:42:04.906 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_num", 2023-11-06T13:42:04.906 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:04.906 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.907 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.907 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "128", 2023-11-06T13:42:04.907 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.907 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.907 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.908 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "default pg_num for any created local pool", 2023-11-06T13:42:04.908 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.908 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.908 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.909 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.909 INFO:teuthology.orchestra.run.smithi038.stdout: "prefix": { 2023-11-06T13:42:04.909 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prefix", 2023-11-06T13:42:04.909 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.910 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.910 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.910 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.910 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.910 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.911 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.911 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "name prefix for any created local pool", 2023-11-06T13:42:04.911 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.911 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.912 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.912 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.912 INFO:teuthology.orchestra.run.smithi038.stdout: "subtree": { 2023-11-06T13:42:04.912 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "subtree", 2023-11-06T13:42:04.913 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.913 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.913 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.913 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "rack", 2023-11-06T13:42:04.914 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.914 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.914 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.914 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-06T13:42:04.915 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.915 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.915 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.915 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.916 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.916 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.916 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.916 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mds_autoscaler", 2023-11-06T13:42:04.916 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.917 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.917 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.917 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.918 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.918 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.919 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.919 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.919 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.920 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.920 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.921 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.921 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.921 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.922 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.922 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.922 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.923 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.924 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.929 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.930 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.931 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.932 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.933 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.934 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.935 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.935 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.935 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.936 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.936 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.936 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.936 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.937 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.937 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.937 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.937 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.938 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.938 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.938 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.938 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirroring", 2023-11-06T13:42:04.939 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.939 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.939 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.939 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.940 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.940 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.940 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.940 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.940 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.941 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.941 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.941 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.941 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.942 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.942 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.942 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.942 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.942 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.943 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.943 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.943 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.943 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.944 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.944 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.944 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.944 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.945 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.945 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.945 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.945 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.946 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.946 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.946 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.946 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.947 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.947 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.947 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.947 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.947 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.948 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.948 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.948 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.948 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.949 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.949 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.949 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.950 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.950 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.950 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.950 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.951 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.951 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.951 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.951 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.951 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.952 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.952 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.952 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.952 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.953 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.953 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.953 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.953 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.954 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.954 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.954 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.954 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.955 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.955 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.955 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.955 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.956 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.956 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.956 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.956 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.956 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.957 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "nfs", 2023-11-06T13:42:04.957 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.957 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.957 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.958 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.958 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.958 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.958 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.959 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.959 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.959 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.960 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.960 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.960 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.961 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.961 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.961 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.962 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.962 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.962 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.962 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.963 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.963 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.963 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.964 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.964 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.964 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.964 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.965 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.965 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.965 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.965 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.966 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.966 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.966 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.966 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.966 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.967 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.967 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.967 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.967 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.968 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.968 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.968 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.968 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.969 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.969 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.969 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.969 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.970 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.970 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.970 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.970 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.971 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.971 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.971 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.971 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.971 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.972 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.972 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.972 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.972 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.972 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.973 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.973 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.973 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.973 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.974 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.974 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.974 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.974 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.974 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.975 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.975 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.975 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:04.975 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.976 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:04.976 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2023-11-06T13:42:04.976 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:04.976 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:04.977 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:04.977 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:04.977 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:04.977 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.978 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.978 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.978 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.979 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.979 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.979 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.979 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.980 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.980 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.980 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.980 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.981 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.981 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.981 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.981 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.981 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.982 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.982 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.982 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:04.983 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:04.983 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.983 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.983 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.984 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.984 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.984 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.985 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.985 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.985 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.985 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.986 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.986 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.986 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:04.987 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:04.987 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.987 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.988 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.988 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:04.988 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.988 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.989 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.989 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:04.989 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:04.990 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:04.990 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:04.990 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:04.991 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:04.991 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.991 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.991 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.992 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.992 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.992 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.992 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:04.993 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:04.993 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:04.993 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.993 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.994 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:04.994 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.994 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.994 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:04.994 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:04.995 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.995 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.995 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator": { 2023-11-06T13:42:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "orchestrator", 2023-11-06T13:42:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:04.997 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:04.997 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:04.997 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:04.997 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:04.998 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:04.998 INFO:teuthology.orchestra.run.smithi038.stdout: "cephadm", 2023-11-06T13:42:04.998 INFO:teuthology.orchestra.run.smithi038.stdout: "rook", 2023-11-06T13:42:04.998 INFO:teuthology.orchestra.run.smithi038.stdout: "test_orchestrator" 2023-11-06T13:42:04.999 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:04.999 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Orchestrator backend", 2023-11-06T13:42:04.999 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:04.999 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:04.999 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.000 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.000 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.000 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.000 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.001 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "osd_support", 2023-11-06T13:42:05.001 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.001 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.002 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.002 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.002 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.002 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.003 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.003 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.003 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.004 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.004 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.004 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.005 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.005 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.005 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.006 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.006 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.006 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.006 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.007 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.007 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.007 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.007 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.008 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.008 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.008 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.008 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.008 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.009 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.009 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.009 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.009 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.010 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.010 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.010 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.010 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.011 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.011 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.011 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.011 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.012 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.012 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.012 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.012 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.012 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.013 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.013 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.013 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.013 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.014 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.014 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.014 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.014 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.015 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.015 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.015 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.015 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.015 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.016 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.016 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.016 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.017 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.017 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.017 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.017 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.017 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.018 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.018 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.018 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.018 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.019 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.019 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.019 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.019 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.020 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.020 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.020 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "pg_autoscaler", 2023-11-06T13:42:05.020 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.021 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.021 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.021 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.021 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.022 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.022 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.022 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.022 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.023 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.024 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.024 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.024 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.024 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.024 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.025 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.025 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.025 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.025 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.026 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.026 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.026 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.026 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.026 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.027 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.027 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.027 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.027 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.028 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.028 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.028 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.028 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.029 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.029 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.029 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.029 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.030 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.030 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.030 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.030 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.031 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.031 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.031 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.031 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.031 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.032 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.032 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.032 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.032 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.032 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.033 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.033 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.033 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.033 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.033 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.034 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.034 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.034 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.034 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.035 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.035 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.035 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.035 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.035 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.036 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.036 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.036 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.036 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.036 INFO:teuthology.orchestra.run.smithi038.stdout: "noautoscale": { 2023-11-06T13:42:05.037 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "noautoscale", 2023-11-06T13:42:05.037 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.037 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.037 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.038 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.038 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.038 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.038 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.038 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "global autoscale flag", 2023-11-06T13:42:05.039 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-11-06T13:42:05.039 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.039 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.039 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.040 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:05.040 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:05.040 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:05.040 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.041 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.041 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:05.041 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.041 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.041 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.042 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.042 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.042 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.042 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.042 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.043 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.043 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.043 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.044 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "progress", 2023-11-06T13:42:05.044 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.044 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.045 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.045 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2023-11-06T13:42:05.045 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2023-11-06T13:42:05.045 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.046 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.046 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.046 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.047 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.047 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.047 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.048 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.048 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.048 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.049 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.049 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.050 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.050 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.050 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.051 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.051 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.051 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.051 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.052 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.052 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.052 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.052 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.053 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.053 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.053 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.053 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.054 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.054 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.054 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.054 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.055 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.055 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.055 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.055 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.055 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.056 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.056 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.056 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.056 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.057 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.057 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.057 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.057 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.057 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.058 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.058 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.058 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.058 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.059 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.059 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.059 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.059 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.060 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.060 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.060 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.060 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.060 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.061 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.061 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.061 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.061 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.062 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.062 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.062 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.062 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.062 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.063 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.063 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.063 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.063 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.064 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.064 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.064 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.064 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.064 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.065 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.065 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.065 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.065 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.066 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.066 INFO:teuthology.orchestra.run.smithi038.stdout: "max_completed_events": { 2023-11-06T13:42:05.066 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_completed_events", 2023-11-06T13:42:05.066 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.067 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.067 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.067 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "50", 2023-11-06T13:42:05.067 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.068 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.068 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.068 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "number of past completed events to remember", 2023-11-06T13:42:05.068 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.068 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.069 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.069 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.069 INFO:teuthology.orchestra.run.smithi038.stdout: "sleep_interval": { 2023-11-06T13:42:05.069 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "sleep_interval", 2023-11-06T13:42:05.070 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:05.070 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.070 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.070 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "5", 2023-11-06T13:42:05.070 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.071 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.073 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.073 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "how long the module is going to sleep", 2023-11-06T13:42:05.074 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.074 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.074 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.074 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.075 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.075 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.075 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.075 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "prometheus", 2023-11-06T13:42:05.076 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.076 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.076 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.076 INFO:teuthology.orchestra.run.smithi038.stdout: "cache": { 2023-11-06T13:42:05.076 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "cache", 2023-11-06T13:42:05.077 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.077 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.077 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.077 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.078 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.078 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.078 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.078 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.079 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.079 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.079 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.079 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.079 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.080 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.080 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.080 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.080 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.081 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.081 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.081 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.081 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.081 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.082 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.082 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.082 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.082 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.083 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.083 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.083 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.083 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.084 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.084 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.084 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.084 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.084 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.085 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.085 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.085 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.085 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.086 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.086 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.086 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.086 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.086 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.087 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.087 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.087 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.087 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.088 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.088 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.088 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.088 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.088 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.089 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.089 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.089 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.089 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.090 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.090 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.090 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.090 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.091 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.091 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.091 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.091 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.091 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.092 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.092 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.092 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.092 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.093 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.093 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.093 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.093 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.094 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.094 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.094 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.094 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.095 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.095 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.095 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.095 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.095 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools": { 2023-11-06T13:42:05.096 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools", 2023-11-06T13:42:05.096 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.096 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.096 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.097 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.097 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.097 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.097 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.098 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.098 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.098 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.098 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.099 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-06T13:42:05.099 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-06T13:42:05.099 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.099 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.100 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.100 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "300", 2023-11-06T13:42:05.100 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.100 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.101 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.101 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.101 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.101 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.102 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.102 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.102 INFO:teuthology.orchestra.run.smithi038.stdout: "scrape_interval": { 2023-11-06T13:42:05.102 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "scrape_interval", 2023-11-06T13:42:05.103 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:05.103 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.103 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.103 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15.0", 2023-11-06T13:42:05.103 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.104 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.104 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.104 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.104 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.105 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.105 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.105 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:05.106 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:05.106 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.106 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.106 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.107 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.107 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.107 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.107 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.107 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.108 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.108 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.108 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.108 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.109 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:05.109 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:05.109 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.109 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.110 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.110 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "9283", 2023-11-06T13:42:05.110 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.110 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.111 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.111 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-06T13:42:05.111 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.111 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.112 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.112 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.112 INFO:teuthology.orchestra.run.smithi038.stdout: "stale_cache_strategy": { 2023-11-06T13:42:05.112 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stale_cache_strategy", 2023-11-06T13:42:05.113 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.113 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.113 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.113 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "log", 2023-11-06T13:42:05.113 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.114 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.114 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.114 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.114 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.115 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.115 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.115 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.115 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_behaviour": { 2023-11-06T13:42:05.115 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_behaviour", 2023-11-06T13:42:05.116 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.116 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.116 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.116 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "default", 2023-11-06T13:42:05.117 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.117 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.117 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.117 INFO:teuthology.orchestra.run.smithi038.stdout: "default", 2023-11-06T13:42:05.118 INFO:teuthology.orchestra.run.smithi038.stdout: "error" 2023-11-06T13:42:05.118 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.118 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.118 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: "standby_error_status_code": { 2023-11-06T13:42:05.119 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "standby_error_status_code", 2023-11-06T13:42:05.120 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.120 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.120 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.120 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "500", 2023-11-06T13:42:05.121 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "400", 2023-11-06T13:42:05.121 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "599", 2023-11-06T13:42:05.121 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.121 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.121 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.122 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.122 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.122 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.122 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.123 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.123 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.123 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2023-11-06T13:42:05.123 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.123 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.124 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.124 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.124 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.124 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.125 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.125 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.125 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.125 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.126 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.126 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.126 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.127 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.127 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.127 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.127 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.128 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.128 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.128 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.128 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.129 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.129 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.129 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.129 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.130 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.130 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.130 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.130 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.130 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.131 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.131 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.131 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.131 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.132 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.132 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.132 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.133 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.133 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.133 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.134 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.134 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.134 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.134 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.135 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.135 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.135 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.135 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.135 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.136 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.136 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.136 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.136 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.136 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.137 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.137 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.137 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.137 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.138 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.138 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.138 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.138 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.138 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.139 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.139 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.139 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.139 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.140 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.140 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.140 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.140 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.141 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.141 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.141 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_snap_create": { 2023-11-06T13:42:05.142 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_snap_create", 2023-11-06T13:42:05.142 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.142 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.142 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.143 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10", 2023-11-06T13:42:05.143 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.143 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.143 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.144 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.144 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.144 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.144 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.145 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.145 INFO:teuthology.orchestra.run.smithi038.stdout: "mirror_snapshot_schedule": { 2023-11-06T13:42:05.145 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "mirror_snapshot_schedule", 2023-11-06T13:42:05.145 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.146 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.146 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.146 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.146 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.147 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.147 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.147 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.147 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.148 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.148 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.148 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.148 INFO:teuthology.orchestra.run.smithi038.stdout: "trash_purge_schedule": { 2023-11-06T13:42:05.149 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "trash_purge_schedule", 2023-11-06T13:42:05.149 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.149 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.149 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.150 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.150 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.150 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.150 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.151 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.151 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.151 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.151 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.151 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.152 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.152 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.152 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.152 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "restful", 2023-11-06T13:42:05.153 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.153 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.153 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.153 INFO:teuthology.orchestra.run.smithi038.stdout: "enable_auth": { 2023-11-06T13:42:05.154 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enable_auth", 2023-11-06T13:42:05.154 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.154 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.154 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.155 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.155 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.155 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.155 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.156 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.156 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.156 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.156 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.156 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.157 INFO:teuthology.orchestra.run.smithi038.stdout: "key_file": { 2023-11-06T13:42:05.157 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "key_file", 2023-11-06T13:42:05.157 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.157 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.158 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.158 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.158 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.158 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.158 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.159 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.159 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.159 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.159 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.160 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.160 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.160 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.160 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.160 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.161 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.161 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.161 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.161 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.162 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.162 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.162 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.162 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.162 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.163 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.163 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.163 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.163 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.164 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.164 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.164 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.164 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.165 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.165 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.165 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.165 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.165 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.166 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.166 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.166 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.166 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.167 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.167 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.167 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.167 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.167 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.168 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.168 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.168 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.168 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.169 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.169 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.169 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.169 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.170 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.170 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.170 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.170 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.171 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.171 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.171 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.171 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.171 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.172 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.172 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.172 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.172 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.173 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.173 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.173 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.173 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.174 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.174 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.174 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.174 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.174 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.175 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.175 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.175 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.175 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.176 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.176 INFO:teuthology.orchestra.run.smithi038.stdout: "server_addr": { 2023-11-06T13:42:05.176 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_addr", 2023-11-06T13:42:05.176 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.177 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.177 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.177 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.177 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.178 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.178 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.178 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.179 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.179 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.179 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.179 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "server_port": { 2023-11-06T13:42:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "server_port", 2023-11-06T13:42:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.180 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.181 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.182 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rook", 2023-11-06T13:42:05.183 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.184 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.185 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.186 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.187 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.188 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.189 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.190 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.191 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.192 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.193 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.193 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.193 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.193 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.194 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.194 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.194 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.194 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.195 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.195 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.195 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.195 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.195 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.196 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.196 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.196 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.196 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.197 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.197 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.197 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.198 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.198 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.198 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.199 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.199 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.199 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.200 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.200 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.200 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.200 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.201 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.201 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.201 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.202 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.202 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.202 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "selftest", 2023-11-06T13:42:05.202 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.202 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.203 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.203 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.203 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.203 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.204 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.204 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.204 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.204 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.204 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.205 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.205 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.205 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.205 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.206 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.206 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.206 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.206 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.207 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.207 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.207 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.207 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.207 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.208 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.208 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.208 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.208 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.209 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.209 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.209 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.209 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.210 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.210 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.210 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.210 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.210 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.211 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.211 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.211 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.211 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.212 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.212 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.212 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.212 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.213 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.213 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.213 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.213 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.213 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.214 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.214 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.214 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.214 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.215 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.215 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.215 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.215 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.215 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.216 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.216 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.216 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.216 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.216 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.217 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.217 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.217 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.217 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.217 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.218 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.218 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.218 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.219 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.219 INFO:teuthology.orchestra.run.smithi038.stdout: "roption1": { 2023-11-06T13:42:05.219 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption1", 2023-11-06T13:42:05.219 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.220 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.220 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.220 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.220 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.221 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.221 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.221 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.221 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.221 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.222 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.222 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.222 INFO:teuthology.orchestra.run.smithi038.stdout: "roption2": { 2023-11-06T13:42:05.222 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "roption2", 2023-11-06T13:42:05.223 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.223 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.223 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.223 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "xyz", 2023-11-06T13:42:05.223 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.224 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.224 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.224 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.224 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.225 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.225 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.225 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.225 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption1": { 2023-11-06T13:42:05.226 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption1", 2023-11-06T13:42:05.226 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.226 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.226 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.226 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.227 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.227 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.227 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.227 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.228 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.228 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.228 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.228 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.228 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption2": { 2023-11-06T13:42:05.229 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption2", 2023-11-06T13:42:05.229 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.229 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.229 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.229 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.230 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.230 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.230 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.230 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.231 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.231 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.231 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.231 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.232 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption3": { 2023-11-06T13:42:05.232 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption3", 2023-11-06T13:42:05.232 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "float", 2023-11-06T13:42:05.232 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.232 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.233 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.233 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.233 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.233 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.234 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.234 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.234 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.234 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.235 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.235 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption4": { 2023-11-06T13:42:05.235 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption4", 2023-11-06T13:42:05.235 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.235 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.236 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.236 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.236 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.236 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.237 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.237 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.237 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.237 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.238 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.238 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.238 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption5": { 2023-11-06T13:42:05.238 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption5", 2023-11-06T13:42:05.239 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.239 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.239 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.239 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.240 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.240 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.240 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.240 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.240 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.241 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.241 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.241 INFO:teuthology.orchestra.run.smithi038.stdout: "rwoption6": { 2023-11-06T13:42:05.242 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rwoption6", 2023-11-06T13:42:05.242 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.242 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.242 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.242 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.243 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.243 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.243 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.243 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.244 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.244 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.244 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.244 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.244 INFO:teuthology.orchestra.run.smithi038.stdout: "testkey": { 2023-11-06T13:42:05.245 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testkey", 2023-11-06T13:42:05.245 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.245 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.245 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.245 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.246 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.246 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.246 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.246 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.247 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.247 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.247 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.247 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.248 INFO:teuthology.orchestra.run.smithi038.stdout: "testlkey": { 2023-11-06T13:42:05.248 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testlkey", 2023-11-06T13:42:05.248 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.248 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.248 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.249 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.249 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.249 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.249 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.250 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.250 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.250 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.250 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.251 INFO:teuthology.orchestra.run.smithi038.stdout: "testnewline": { 2023-11-06T13:42:05.251 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "testnewline", 2023-11-06T13:42:05.251 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.251 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.252 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.252 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.252 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.252 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.253 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.253 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.253 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.253 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.254 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.254 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.254 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.254 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.255 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snap_schedule", 2023-11-06T13:42:05.255 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.255 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.255 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.256 INFO:teuthology.orchestra.run.smithi038.stdout: "allow_m_granularity": { 2023-11-06T13:42:05.256 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "allow_m_granularity", 2023-11-06T13:42:05.256 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.256 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.257 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.257 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.257 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.257 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.257 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.258 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "allow minute scheduled snapshots", 2023-11-06T13:42:05.258 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.258 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.258 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.259 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.259 INFO:teuthology.orchestra.run.smithi038.stdout: "dump_on_update": { 2023-11-06T13:42:05.259 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "dump_on_update", 2023-11-06T13:42:05.259 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.259 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.260 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.260 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.260 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.260 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.261 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.261 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "dump database to debug log on update", 2023-11-06T13:42:05.261 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.261 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.262 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.262 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.262 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.262 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.262 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.263 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.263 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.263 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.263 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.264 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.264 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.264 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.264 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.264 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.265 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.265 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.265 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.265 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.266 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.266 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.266 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.266 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.266 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.267 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.267 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.267 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.267 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.268 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.268 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.268 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.268 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.268 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.269 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.269 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.269 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.269 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.270 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.270 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.270 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.270 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.270 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.271 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.271 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.271 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.271 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.272 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.272 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.272 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.272 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.273 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.273 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.273 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.273 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.274 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.274 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.274 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.278 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.278 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.279 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.279 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.279 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.279 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.280 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.280 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.280 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.280 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.281 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.281 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.281 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.281 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.282 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.282 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.282 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.282 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.283 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.283 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "stats", 2023-11-06T13:42:05.283 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.283 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.283 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.284 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.284 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.284 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.284 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.285 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.285 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.285 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.285 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.285 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.286 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.286 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.286 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.286 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.287 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.287 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.287 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.287 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.287 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.288 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.288 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.288 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.289 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.289 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.289 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.289 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.290 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.290 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.290 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.290 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.290 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.291 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.291 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.291 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.292 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.292 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.292 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.292 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.293 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.293 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.293 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.293 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.294 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.294 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.294 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.294 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.295 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.295 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.295 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.295 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.295 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.296 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.296 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.296 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.297 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.297 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.297 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.297 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.298 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.298 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.298 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.298 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.299 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.299 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.299 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.299 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.300 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.300 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.300 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.300 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.301 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "status", 2023-11-06T13:42:05.301 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.301 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.301 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.302 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.302 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.302 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.302 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.302 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.303 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.303 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.303 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.303 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.304 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.304 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.304 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.304 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.305 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.305 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.305 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.305 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.305 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.306 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.306 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.306 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.307 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.307 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.307 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.307 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.307 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.308 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.308 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.308 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.308 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.308 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.309 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.309 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.309 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.310 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.310 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.310 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.310 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.310 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.311 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.311 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.311 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.311 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.311 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.312 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.312 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.312 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.312 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.313 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.313 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.313 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.313 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.313 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.314 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.314 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.314 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.314 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.315 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.315 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.315 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.315 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.316 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.316 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.316 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.316 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.316 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.317 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.317 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.317 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.317 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.317 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.318 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telegraf", 2023-11-06T13:42:05.318 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.318 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.318 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.319 INFO:teuthology.orchestra.run.smithi038.stdout: "address": { 2023-11-06T13:42:05.319 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "address", 2023-11-06T13:42:05.319 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.319 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.319 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.320 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-06T13:42:05.320 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.320 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.320 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.321 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.321 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.321 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.321 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.321 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.322 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:05.322 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:05.322 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:05.323 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.323 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.323 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "15", 2023-11-06T13:42:05.323 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.324 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.324 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.324 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.324 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.325 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.325 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.325 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.326 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.326 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.326 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.327 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.327 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.327 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.327 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.328 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.328 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.328 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.328 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.329 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.329 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.329 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.330 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.330 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.330 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.331 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.331 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.331 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.331 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.332 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.332 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.332 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.333 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.333 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.333 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.333 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.334 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.334 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.334 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.335 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.335 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.335 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.335 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.336 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.336 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.336 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.337 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.337 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.337 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.337 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.338 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.338 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.338 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.339 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.339 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.339 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.339 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.340 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.340 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.340 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.340 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.341 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.341 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.341 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.341 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.342 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.342 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.342 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.342 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.342 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.343 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.343 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.343 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.343 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.344 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.344 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.345 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "telemetry", 2023-11-06T13:42:05.345 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.345 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.345 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.345 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_basic": { 2023-11-06T13:42:05.346 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_basic", 2023-11-06T13:42:05.346 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.346 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.346 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.347 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.347 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.347 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.347 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.347 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-06T13:42:05.348 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.348 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.348 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_crash": { 2023-11-06T13:42:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_crash", 2023-11-06T13:42:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.349 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.350 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.350 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.350 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.350 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.350 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.351 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.351 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.351 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.351 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.352 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_device": { 2023-11-06T13:42:05.352 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_device", 2023-11-06T13:42:05.352 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.353 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.353 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.353 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "True", 2023-11-06T13:42:05.353 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.353 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.354 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.354 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.354 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.354 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.355 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.355 INFO:teuthology.orchestra.run.smithi038.stdout: "channel_ident": { 2023-11-06T13:42:05.355 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "channel_ident", 2023-11-06T13:42:05.355 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.356 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.356 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.356 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.356 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.357 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.357 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.357 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.357 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.358 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.358 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.358 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.358 INFO:teuthology.orchestra.run.smithi038.stdout: "contact": { 2023-11-06T13:42:05.359 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "contact", 2023-11-06T13:42:05.359 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.359 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.360 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.360 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:05.360 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.360 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.361 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.361 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.361 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.361 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.362 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.362 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.363 INFO:teuthology.orchestra.run.smithi038.stdout: "description": { 2023-11-06T13:42:05.363 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "description", 2023-11-06T13:42:05.363 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.364 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.364 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.364 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:05.364 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.365 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.365 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.365 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.365 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.366 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.366 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.366 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.367 INFO:teuthology.orchestra.run.smithi038.stdout: "device_url": { 2023-11-06T13:42:05.367 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "device_url", 2023-11-06T13:42:05.367 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.368 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.368 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.368 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-06T13:42:05.369 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.369 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.369 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.369 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.370 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.370 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.370 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.371 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.371 INFO:teuthology.orchestra.run.smithi038.stdout: "enabled": { 2023-11-06T13:42:05.371 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "enabled", 2023-11-06T13:42:05.371 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.372 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.372 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.372 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.372 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.373 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.373 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.373 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.373 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.373 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.374 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.374 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.374 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:05.374 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:05.375 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.375 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.375 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.375 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "24", 2023-11-06T13:42:05.376 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "8", 2023-11-06T13:42:05.376 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.376 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.376 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.376 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.377 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.377 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.377 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.377 INFO:teuthology.orchestra.run.smithi038.stdout: "last_opt_revision": { 2023-11-06T13:42:05.378 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "last_opt_revision", 2023-11-06T13:42:05.378 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.378 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.378 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.378 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "1", 2023-11-06T13:42:05.379 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.379 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.379 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.380 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.380 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.380 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.380 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.380 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.381 INFO:teuthology.orchestra.run.smithi038.stdout: "leaderboard": { 2023-11-06T13:42:05.381 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "leaderboard", 2023-11-06T13:42:05.381 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.381 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.382 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.382 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.382 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.382 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.383 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.383 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.383 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.383 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.384 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.384 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.384 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.384 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.385 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.385 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.385 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.385 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.385 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.386 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.386 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.386 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.386 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.386 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.387 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.387 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.387 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.387 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.387 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.388 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.388 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.388 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.388 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.389 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.389 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.389 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.389 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.389 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.390 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.390 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.390 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.390 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.391 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.391 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.391 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.391 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.392 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.392 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.392 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.392 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.393 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.393 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.393 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.393 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.394 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.394 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.394 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.395 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.395 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.395 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.395 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.396 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.396 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.396 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.396 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.396 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.397 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.398 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.398 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.398 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.398 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.399 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.399 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.399 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.400 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.400 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.400 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.401 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.401 INFO:teuthology.orchestra.run.smithi038.stdout: "organization": { 2023-11-06T13:42:05.401 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "organization", 2023-11-06T13:42:05.401 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.402 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.402 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.402 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:05.403 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.403 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.403 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.404 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.404 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.404 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.404 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.405 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.405 INFO:teuthology.orchestra.run.smithi038.stdout: "proxy": { 2023-11-06T13:42:05.405 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "proxy", 2023-11-06T13:42:05.406 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.406 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.406 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.406 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:05.407 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.407 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.407 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.408 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.408 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.408 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.408 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.409 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.409 INFO:teuthology.orchestra.run.smithi038.stdout: "url": { 2023-11-06T13:42:05.409 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "url", 2023-11-06T13:42:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.410 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-06T13:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.411 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.412 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.413 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.413 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.413 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "test_orchestrator", 2023-11-06T13:42:05.413 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.414 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.414 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.414 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.414 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.415 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.415 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.415 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.415 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.415 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.416 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.416 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.416 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.416 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.416 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.417 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.417 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.417 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.417 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.418 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.418 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.418 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.418 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.418 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.419 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.419 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.419 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.419 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.420 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.420 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.420 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.420 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.421 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.421 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.421 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.421 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.422 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.422 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.422 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.422 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.422 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.423 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.423 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.423 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.423 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.424 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.424 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.424 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.424 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.424 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.425 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.425 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.425 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.425 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.426 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.426 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.426 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.426 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.426 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.427 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.427 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.427 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.427 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.428 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.428 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.428 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.429 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.430 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.431 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2023-11-06T13:42:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.432 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.433 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.434 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.435 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.436 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.437 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.438 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.439 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.439 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.439 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.440 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.440 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.440 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.440 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.441 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.441 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.441 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.442 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.442 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.442 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.442 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.442 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.443 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.443 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.443 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.443 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.444 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.444 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.444 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.444 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.444 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.445 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.445 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.445 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.445 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.446 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.446 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.446 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.446 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.446 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.447 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.447 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.447 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.447 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.447 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.448 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.448 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.448 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.448 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.449 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.449 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.449 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.449 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.449 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.450 INFO:teuthology.orchestra.run.smithi038.stdout: "max_concurrent_clones": { 2023-11-06T13:42:05.450 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "max_concurrent_clones", 2023-11-06T13:42:05.450 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.450 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.450 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.451 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "4", 2023-11-06T13:42:05.451 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.451 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.451 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.452 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-06T13:42:05.452 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.452 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.452 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.452 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.452 INFO:teuthology.orchestra.run.smithi038.stdout: "snapshot_clone_delay": { 2023-11-06T13:42:05.453 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "snapshot_clone_delay", 2023-11-06T13:42:05.453 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.453 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.453 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.454 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "0", 2023-11-06T13:42:05.454 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.454 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.454 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.454 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-06T13:42:05.455 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.455 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.455 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.455 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.455 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.456 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.456 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.456 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix", 2023-11-06T13:42:05.456 INFO:teuthology.orchestra.run.smithi038.stdout: "can_run": true, 2023-11-06T13:42:05.457 INFO:teuthology.orchestra.run.smithi038.stdout: "error_string": "", 2023-11-06T13:42:05.457 INFO:teuthology.orchestra.run.smithi038.stdout: "module_options": { 2023-11-06T13:42:05.457 INFO:teuthology.orchestra.run.smithi038.stdout: "discovery_interval": { 2023-11-06T13:42:05.457 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "discovery_interval", 2023-11-06T13:42:05.457 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.458 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.458 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.458 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "100", 2023-11-06T13:42:05.458 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.458 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.459 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.459 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.459 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.459 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.460 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.460 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.460 INFO:teuthology.orchestra.run.smithi038.stdout: "identifier": { 2023-11-06T13:42:05.460 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "identifier", 2023-11-06T13:42:05.461 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.461 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.461 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.461 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.462 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.462 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.462 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.462 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.463 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.463 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.463 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.464 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.464 INFO:teuthology.orchestra.run.smithi038.stdout: "interval": { 2023-11-06T13:42:05.464 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "interval", 2023-11-06T13:42:05.464 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "secs", 2023-11-06T13:42:05.464 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.465 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.465 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "60", 2023-11-06T13:42:05.465 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.466 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.466 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.466 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.466 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.467 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.467 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.467 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.467 INFO:teuthology.orchestra.run.smithi038.stdout: "log_level": { 2023-11-06T13:42:05.468 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_level", 2023-11-06T13:42:05.468 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.468 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.469 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.469 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "", 2023-11-06T13:42:05.469 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.469 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.469 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.470 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.470 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.470 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.470 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.471 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.471 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.471 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.471 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.472 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.472 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.472 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.472 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.473 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster": { 2023-11-06T13:42:05.473 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster", 2023-11-06T13:42:05.473 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.473 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.474 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.474 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.474 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.475 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.475 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.475 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.476 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.476 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.476 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.476 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.477 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_cluster_level": { 2023-11-06T13:42:05.477 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_cluster_level", 2023-11-06T13:42:05.477 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.478 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.478 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.481 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "info", 2023-11-06T13:42:05.482 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.482 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.482 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [ 2023-11-06T13:42:05.482 INFO:teuthology.orchestra.run.smithi038.stdout: "", 2023-11-06T13:42:05.482 INFO:teuthology.orchestra.run.smithi038.stdout: "critical", 2023-11-06T13:42:05.483 INFO:teuthology.orchestra.run.smithi038.stdout: "debug", 2023-11-06T13:42:05.483 INFO:teuthology.orchestra.run.smithi038.stdout: "error", 2023-11-06T13:42:05.483 INFO:teuthology.orchestra.run.smithi038.stdout: "info", 2023-11-06T13:42:05.483 INFO:teuthology.orchestra.run.smithi038.stdout: "warning" 2023-11-06T13:42:05.484 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.484 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.484 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.484 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.484 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.485 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.485 INFO:teuthology.orchestra.run.smithi038.stdout: "log_to_file": { 2023-11-06T13:42:05.485 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "log_to_file", 2023-11-06T13:42:05.485 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "bool", 2023-11-06T13:42:05.485 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.486 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 1, 2023-11-06T13:42:05.486 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "False", 2023-11-06T13:42:05.486 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.486 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.486 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.487 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.487 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.487 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.487 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.487 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.488 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_host": { 2023-11-06T13:42:05.488 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_host", 2023-11-06T13:42:05.488 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.488 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.488 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.489 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "None", 2023-11-06T13:42:05.489 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.489 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.489 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.489 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.490 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.490 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.490 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.490 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.490 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_port": { 2023-11-06T13:42:05.491 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_port", 2023-11-06T13:42:05.491 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "int", 2023-11-06T13:42:05.491 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.491 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.491 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "10051", 2023-11-06T13:42:05.492 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.492 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.492 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.492 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.492 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.493 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.493 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.493 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.493 INFO:teuthology.orchestra.run.smithi038.stdout: "zabbix_sender": { 2023-11-06T13:42:05.493 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "zabbix_sender", 2023-11-06T13:42:05.494 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "str", 2023-11-06T13:42:05.494 INFO:teuthology.orchestra.run.smithi038.stdout: "level": "advanced", 2023-11-06T13:42:05.494 INFO:teuthology.orchestra.run.smithi038.stdout: "flags": 0, 2023-11-06T13:42:05.494 INFO:teuthology.orchestra.run.smithi038.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-06T13:42:05.495 INFO:teuthology.orchestra.run.smithi038.stdout: "min": "", 2023-11-06T13:42:05.495 INFO:teuthology.orchestra.run.smithi038.stdout: "max": "", 2023-11-06T13:42:05.495 INFO:teuthology.orchestra.run.smithi038.stdout: "enum_allowed": [], 2023-11-06T13:42:05.495 INFO:teuthology.orchestra.run.smithi038.stdout: "desc": "", 2023-11-06T13:42:05.495 INFO:teuthology.orchestra.run.smithi038.stdout: "long_desc": "", 2023-11-06T13:42:05.496 INFO:teuthology.orchestra.run.smithi038.stdout: "tags": [], 2023-11-06T13:42:05.496 INFO:teuthology.orchestra.run.smithi038.stdout: "see_also": [] 2023-11-06T13:42:05.496 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.496 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.496 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.497 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.497 INFO:teuthology.orchestra.run.smithi038.stdout: "services": {}, 2023-11-06T13:42:05.497 INFO:teuthology.orchestra.run.smithi038.stdout: "always_on_modules": { 2023-11-06T13:42:05.497 INFO:teuthology.orchestra.run.smithi038.stdout: "nautilus": [ 2023-11-06T13:42:05.497 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2023-11-06T13:42:05.497 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-11-06T13:42:05.498 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2023-11-06T13:42:05.498 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator_cli", 2023-11-06T13:42:05.498 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2023-11-06T13:42:05.498 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2023-11-06T13:42:05.498 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2023-11-06T13:42:05.499 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2023-11-06T13:42:05.499 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.499 INFO:teuthology.orchestra.run.smithi038.stdout: "octopus": [ 2023-11-06T13:42:05.499 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2023-11-06T13:42:05.499 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-11-06T13:42:05.500 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2023-11-06T13:42:05.500 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2023-11-06T13:42:05.500 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2023-11-06T13:42:05.500 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2023-11-06T13:42:05.500 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2023-11-06T13:42:05.501 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2023-11-06T13:42:05.501 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2023-11-06T13:42:05.501 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2023-11-06T13:42:05.501 INFO:teuthology.orchestra.run.smithi038.stdout: ], 2023-11-06T13:42:05.501 INFO:teuthology.orchestra.run.smithi038.stdout: "pacific": [ 2023-11-06T13:42:05.502 INFO:teuthology.orchestra.run.smithi038.stdout: "balancer", 2023-11-06T13:42:05.502 INFO:teuthology.orchestra.run.smithi038.stdout: "crash", 2023-11-06T13:42:05.502 INFO:teuthology.orchestra.run.smithi038.stdout: "devicehealth", 2023-11-06T13:42:05.502 INFO:teuthology.orchestra.run.smithi038.stdout: "orchestrator", 2023-11-06T13:42:05.502 INFO:teuthology.orchestra.run.smithi038.stdout: "pg_autoscaler", 2023-11-06T13:42:05.503 INFO:teuthology.orchestra.run.smithi038.stdout: "progress", 2023-11-06T13:42:05.503 INFO:teuthology.orchestra.run.smithi038.stdout: "rbd_support", 2023-11-06T13:42:05.503 INFO:teuthology.orchestra.run.smithi038.stdout: "status", 2023-11-06T13:42:05.503 INFO:teuthology.orchestra.run.smithi038.stdout: "telemetry", 2023-11-06T13:42:05.503 INFO:teuthology.orchestra.run.smithi038.stdout: "volumes" 2023-11-06T13:42:05.503 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:05.504 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.504 INFO:teuthology.orchestra.run.smithi038.stdout: "last_failure_osd_epoch": 0, 2023-11-06T13:42:05.504 INFO:teuthology.orchestra.run.smithi038.stdout: "active_clients": [ 2023-11-06T13:42:05.504 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.504 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "rbd_support", 2023-11-06T13:42:05.505 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-11-06T13:42:05.505 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.505 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-11-06T13:42:05.505 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.163:0", 2023-11-06T13:42:05.505 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 1605217629 2023-11-06T13:42:05.506 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.506 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:05.506 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.506 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.506 INFO:teuthology.orchestra.run.smithi038.stdout: "name": "volumes", 2023-11-06T13:42:05.507 INFO:teuthology.orchestra.run.smithi038.stdout: "addrvec": [ 2023-11-06T13:42:05.507 INFO:teuthology.orchestra.run.smithi038.stdout: { 2023-11-06T13:42:05.507 INFO:teuthology.orchestra.run.smithi038.stdout: "type": "v2", 2023-11-06T13:42:05.507 INFO:teuthology.orchestra.run.smithi038.stdout: "addr": "172.21.15.163:0", 2023-11-06T13:42:05.507 INFO:teuthology.orchestra.run.smithi038.stdout: "nonce": 3979379500 2023-11-06T13:42:05.508 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.508 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:05.508 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.508 INFO:teuthology.orchestra.run.smithi038.stdout: ] 2023-11-06T13:42:05.508 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:42:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1af408cb70 msgr2=0x7f1af408f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:05.510 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1af408cb70 0x7f1af408f030 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f1b080ef440 tx=0x7f1afc008040).stop 2023-11-06T13:42:05.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 msgr2=0x7f1b0817da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:05.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b0817da50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f1b0000a400 tx=0x7f1b00007910).stop 2023-11-06T13:42:05.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 shutdown_connections 2023-11-06T13:42:05.511 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08181620 0x7f1b08177f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7f1b08062770 0x7f1b0817da50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7f1af408cb70 0x7f1af408f030 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 --2- 172.21.15.38:0/3289155871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b08175890 0x7f1b08175dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 >> 172.21.15.38:0/3289155871 conn(0x7f1b080f2b00 msgr2=0x7f1b080f0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:05.512 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 shutdown_connections 2023-11-06T13:42:05.513 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:01.926+0000 7f1b0f158700 1 -- 172.21.15.38:0/3289155871 wait complete. 2023-11-06T13:42:05.518 DEBUG:tasks.check_counter:Getting stats from a 2023-11-06T13:42:05.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2023-11-06T13:42:05.659 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:42:05.660 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:05.660 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 0, 2023-11-06T13:42:05.660 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2, 2023-11-06T13:42:05.660 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 0, 2023-11-06T13:42:05.660 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 0, 2023-11-06T13:42:05.661 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2023-11-06T13:42:05.661 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2023-11-06T13:42:05.661 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.001837840, 2023-11-06T13:42:05.661 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000000000, 2023-11-06T13:42:05.661 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.000378324, 2023-11-06T13:42:05.662 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-06T13:42:05.662 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.662 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.662 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.663 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.663 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.663 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.663 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.663 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.664 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.664 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.664 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.664 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:05.664 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 235, 2023-11-06T13:42:05.665 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 231, 2023-11-06T13:42:05.665 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 406688, 2023-11-06T13:42:05.665 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 132604, 2023-11-06T13:42:05.665 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2023-11-06T13:42:05.665 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2023-11-06T13:42:05.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.031066586, 2023-11-06T13:42:05.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.011999732, 2023-11-06T13:42:05.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.014195241, 2023-11-06T13:42:05.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.004639836, 2023-11-06T13:42:05.666 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.667 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 231, 2023-11-06T13:42:05.667 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.039648476, 2023-11-06T13:42:05.667 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000171638 2023-11-06T13:42:05.667 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.667 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.668 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.668 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.668 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.668 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.668 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.668 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:05.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 5, 2023-11-06T13:42:05.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 179, 2023-11-06T13:42:05.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1728, 2023-11-06T13:42:05.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 101248, 2023-11-06T13:42:05.669 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2023-11-06T13:42:05.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2023-11-06T13:42:05.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.008780857, 2023-11-06T13:42:05.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.006150499, 2023-11-06T13:42:05.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.001174284, 2023-11-06T13:42:05.670 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-06T13:42:05.671 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.671 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 178, 2023-11-06T13:42:05.671 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.025292172, 2023-11-06T13:42:05.671 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000142090 2023-11-06T13:42:05.671 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.672 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.672 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.672 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.672 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.672 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.673 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2023-11-06T13:42:05.673 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2023-11-06T13:42:05.673 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2023-11-06T13:42:05.673 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.674 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2023-11-06T13:42:05.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:05.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:05.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:05.674 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:05.675 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:05.675 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:05.675 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:05.675 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:05.675 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:05.676 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:05.676 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:05.676 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:05.676 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:05.676 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:05.677 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:05.677 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:05.677 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:05.677 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:05.677 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:05.678 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:05.678 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:05.678 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:05.678 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:05.678 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:05.679 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:05.679 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:05.679 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:05.679 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:05.679 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:05.680 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:05.680 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:05.680 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2023-11-06T13:42:05.680 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:05.680 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:05.680 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:05.681 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:05.681 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 94431, 2023-11-06T13:42:05.681 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 43, 2023-11-06T13:42:05.681 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:05.681 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:05.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2023-11-06T13:42:05.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2023-11-06T13:42:05.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:05.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:05.682 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:05.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:05.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2023-11-06T13:42:05.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2023-11-06T13:42:05.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:05.683 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:05.684 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:05.684 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2023-11-06T13:42:05.684 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 856, 2023-11-06T13:42:05.684 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2023-11-06T13:42:05.685 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:05.685 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2023-11-06T13:42:05.685 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:05.685 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2023-11-06T13:42:05.685 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.686 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:05.686 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:05.686 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2023-11-06T13:42:05.686 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:05.686 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 236, 2023-11-06T13:42:05.687 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 373472, 2023-11-06T13:42:05.687 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:05.687 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 236, 2023-11-06T13:42:05.687 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:05.687 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:05.687 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 236, 2023-11-06T13:42:05.688 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 373472, 2023-11-06T13:42:05.688 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:05.688 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.688 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.688 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.689 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.689 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:42:05.690 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-11-06T13:42:05.691 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-11-06T13:42:05.691 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2023-11-06T13:42:05.691 DEBUG:tasks.check_counter:Getting stats from d 2023-11-06T13:42:05.691 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok perf dump 2023-11-06T13:42:05.818 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:42:05.818 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:05.818 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 235, 2023-11-06T13:42:05.819 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 231, 2023-11-06T13:42:05.819 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 406688, 2023-11-06T13:42:05.819 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 132464, 2023-11-06T13:42:05.819 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 4, 2023-11-06T13:42:05.820 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 0, 2023-11-06T13:42:05.820 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.032812271, 2023-11-06T13:42:05.820 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.012403031, 2023-11-06T13:42:05.820 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.014189392, 2023-11-06T13:42:05.820 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.004603262, 2023-11-06T13:42:05.821 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.821 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 230, 2023-11-06T13:42:05.821 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.029436116, 2023-11-06T13:42:05.821 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000127983 2023-11-06T13:42:05.822 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.822 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.822 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.823 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.823 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.823 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.823 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.824 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:05.824 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 5, 2023-11-06T13:42:05.824 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 179, 2023-11-06T13:42:05.825 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 1728, 2023-11-06T13:42:05.825 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 101248, 2023-11-06T13:42:05.825 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 3, 2023-11-06T13:42:05.825 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 2, 2023-11-06T13:42:05.826 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.009019970, 2023-11-06T13:42:05.826 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.006274787, 2023-11-06T13:42:05.826 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.001299841, 2023-11-06T13:42:05.826 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-06T13:42:05.827 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.827 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 178, 2023-11-06T13:42:05.827 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.037116257, 2023-11-06T13:42:05.827 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000208518 2023-11-06T13:42:05.828 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.828 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.828 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.828 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.828 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.829 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.829 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.829 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:05.829 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 0, 2023-11-06T13:42:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2, 2023-11-06T13:42:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 0, 2023-11-06T13:42:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 140, 2023-11-06T13:42:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 2, 2023-11-06T13:42:05.830 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 1, 2023-11-06T13:42:05.831 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.000431359, 2023-11-06T13:42:05.831 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.000011259, 2023-11-06T13:42:05.831 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.000308356, 2023-11-06T13:42:05.831 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-06T13:42:05.831 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.832 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1, 2023-11-06T13:42:05.832 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000411033, 2023-11-06T13:42:05.832 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000411033 2023-11-06T13:42:05.832 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.832 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.833 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.833 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.833 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.833 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.833 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.833 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2023-11-06T13:42:05.834 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 0, 2023-11-06T13:42:05.834 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2023-11-06T13:42:05.834 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.835 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2023-11-06T13:42:05.835 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:05.835 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:05.836 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:05.836 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:05.836 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:05.836 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:05.836 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:05.837 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:05.837 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:05.837 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:05.837 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:05.838 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:05.838 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:05.838 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:05.838 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:05.838 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:05.839 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:05.839 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:05.839 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:05.839 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:05.840 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:05.840 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:05.840 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:05.840 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:05.840 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:05.841 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:05.841 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:05.841 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:05.841 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:05.842 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:05.842 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:05.842 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2023-11-06T13:42:05.842 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:05.842 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:05.843 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:05.843 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:05.843 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 94391, 2023-11-06T13:42:05.843 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 42, 2023-11-06T13:42:05.843 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:05.844 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:05.844 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2023-11-06T13:42:05.844 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2023-11-06T13:42:05.844 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:05.844 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:05.845 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:05.845 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:05.845 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 0, 2023-11-06T13:42:05.845 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 0, 2023-11-06T13:42:05.846 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:05.846 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:05.846 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:05.847 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2023-11-06T13:42:05.847 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 856, 2023-11-06T13:42:05.848 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 2, 2023-11-06T13:42:05.848 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:05.848 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2023-11-06T13:42:05.849 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:05.849 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2023-11-06T13:42:05.849 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.850 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:05.850 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:05.850 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2023-11-06T13:42:05.851 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:05.852 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 236, 2023-11-06T13:42:05.852 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 373472, 2023-11-06T13:42:05.852 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:05.853 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 236, 2023-11-06T13:42:05.853 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:05.853 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:05.853 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 236, 2023-11-06T13:42:05.854 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 373472, 2023-11-06T13:42:05.854 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:05.854 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.854 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.855 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.855 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.855 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.855 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:42:05.856 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-11-06T13:42:05.857 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-11-06T13:42:05.857 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-11-06T13:42:05.857 DEBUG:tasks.check_counter:Getting stats from g 2023-11-06T13:42:05.857 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok perf dump 2023-11-06T13:42:05.985 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:42:05.986 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:05.986 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 1568, 2023-11-06T13:42:05.986 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 1568, 2023-11-06T13:42:05.986 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 88561709, 2023-11-06T13:42:05.987 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 486915, 2023-11-06T13:42:05.987 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 8, 2023-11-06T13:42:05.987 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 4, 2023-11-06T13:42:05.987 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.186915291, 2023-11-06T13:42:05.987 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.046581686, 2023-11-06T13:42:05.988 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.084861381, 2023-11-06T13:42:05.988 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.042429840, 2023-11-06T13:42:05.988 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.988 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1567, 2023-11-06T13:42:05.988 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.219859739, 2023-11-06T13:42:05.989 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000140306 2023-11-06T13:42:05.989 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.989 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.989 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.989 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.990 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.990 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.990 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.990 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:05.990 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 627, 2023-11-06T13:42:05.991 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 591, 2023-11-06T13:42:05.991 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 56828993, 2023-11-06T13:42:05.991 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 243577, 2023-11-06T13:42:05.991 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:05.991 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:05.992 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.094795080, 2023-11-06T13:42:05.992 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.021531029, 2023-11-06T13:42:05.992 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.057370700, 2023-11-06T13:42:05.992 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.013984868, 2023-11-06T13:42:05.992 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.993 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 591, 2023-11-06T13:42:05.993 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.080753181, 2023-11-06T13:42:05.993 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000136638 2023-11-06T13:42:05.993 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.993 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.994 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.994 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.994 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.994 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.994 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.995 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:05.995 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 913, 2023-11-06T13:42:05.995 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 1088, 2023-11-06T13:42:05.995 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 79942299, 2023-11-06T13:42:05.995 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 649781, 2023-11-06T13:42:05.996 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:05.996 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:05.996 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.127019816, 2023-11-06T13:42:05.996 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.030127353, 2023-11-06T13:42:05.996 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.066796699, 2023-11-06T13:42:05.997 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.022762454, 2023-11-06T13:42:05.997 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:05.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 1087, 2023-11-06T13:42:05.997 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.109363248, 2023-11-06T13:42:05.997 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000100610 2023-11-06T13:42:05.998 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.998 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:05.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:05.998 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:05.998 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:05.999 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:05.999 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:05.999 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2023-11-06T13:42:05.999 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2023-11-06T13:42:05.999 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2023-11-06T13:42:06.000 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.000 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2023-11-06T13:42:06.000 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2023-11-06T13:42:06.000 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2023-11-06T13:42:06.000 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 4693, 2023-11-06T13:42:06.001 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.118604880, 2023-11-06T13:42:06.001 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000025272 2023-11-06T13:42:06.001 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.001 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.001 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:06.002 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2023-11-06T13:42:06.002 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2023-11-06T13:42:06.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.002 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.002 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.003 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.003 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.003 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-11-06T13:42:06.003 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 0, 2023-11-06T13:42:06.003 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 0, 2023-11-06T13:42:06.004 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2023-11-06T13:42:06.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.004 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.004 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.004 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.005 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2023-11-06T13:42:06.005 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 0, 2023-11-06T13:42:06.005 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch": 0, 2023-11-06T13:42:06.005 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 0, 2023-11-06T13:42:06.005 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2023-11-06T13:42:06.006 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2023-11-06T13:42:06.006 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 13, 2023-11-06T13:42:06.006 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2023-11-06T13:42:06.006 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 0, 2023-11-06T13:42:06.006 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 13, 2023-11-06T13:42:06.007 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 13, 2023-11-06T13:42:06.007 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 40, 2023-11-06T13:42:06.007 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:06.007 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 0, 2023-11-06T13:42:06.007 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 1, 2023-11-06T13:42:06.008 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 0, 2023-11-06T13:42:06.008 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 0, 2023-11-06T13:42:06.008 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2023-11-06T13:42:06.008 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 0, 2023-11-06T13:42:06.008 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:06.009 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:06.009 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2023-11-06T13:42:06.009 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2023-11-06T13:42:06.009 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2023-11-06T13:42:06.009 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2023-11-06T13:42:06.010 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2023-11-06T13:42:06.010 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2023-11-06T13:42:06.010 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2023-11-06T13:42:06.010 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2023-11-06T13:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 0, 2023-11-06T13:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 0, 2023-11-06T13:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 0, 2023-11-06T13:42:06.011 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2023-11-06T13:42:06.012 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:06.012 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:06.012 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:06.012 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2023-11-06T13:42:06.012 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:06.013 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2023-11-06T13:42:06.013 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2023-11-06T13:42:06.013 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2023-11-06T13:42:06.013 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 0, 2023-11-06T13:42:06.014 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2023-11-06T13:42:06.014 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:06.014 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:06.014 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:06.014 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 0, 2023-11-06T13:42:06.015 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2023-11-06T13:42:06.015 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2023-11-06T13:42:06.015 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 0 2023-11-06T13:42:06.015 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.015 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2023-11-06T13:42:06.016 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2023-11-06T13:42:06.016 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:06.016 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:06.016 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2023-11-06T13:42:06.016 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2023-11-06T13:42:06.017 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:06.017 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2023-11-06T13:42:06.017 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:06.017 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:06.017 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:06.018 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2023-11-06T13:42:06.018 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2023-11-06T13:42:06.018 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:06.018 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2023-11-06T13:42:06.018 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2023-11-06T13:42:06.019 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2023-11-06T13:42:06.019 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:06.019 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0 2023-11-06T13:42:06.019 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.019 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2023-11-06T13:42:06.020 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 0, 2023-11-06T13:42:06.020 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2023-11-06T13:42:06.020 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2023-11-06T13:42:06.020 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 96554, 2023-11-06T13:42:06.020 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2023-11-06T13:42:06.021 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2023-11-06T13:42:06.021 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 0, 2023-11-06T13:42:06.021 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2023-11-06T13:42:06.021 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2023-11-06T13:42:06.021 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 118, 2023-11-06T13:42:06.022 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2023-11-06T13:42:06.022 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2023-11-06T13:42:06.022 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 4194304, 2023-11-06T13:42:06.022 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 228075032, 2023-11-06T13:42:06.023 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 228073922, 2023-11-06T13:42:06.023 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2023-11-06T13:42:06.023 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.023 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.023 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.023 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.024 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 96554 2023-11-06T13:42:06.024 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.024 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2023-11-06T13:42:06.024 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 16, 2023-11-06T13:42:06.024 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 36941, 2023-11-06T13:42:06.025 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 36925, 2023-11-06T13:42:06.025 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 11, 2023-11-06T13:42:06.025 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 1572, 2023-11-06T13:42:06.025 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 1561, 2023-11-06T13:42:06.025 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 14381, 2023-11-06T13:42:06.026 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 70916, 2023-11-06T13:42:06.026 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 56535, 2023-11-06T13:42:06.026 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 0, 2023-11-06T13:42:06.026 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 0, 2023-11-06T13:42:06.026 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 0, 2023-11-06T13:42:06.027 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 79736, 2023-11-06T13:42:06.027 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 340216 2023-11-06T13:42:06.027 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.027 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2023-11-06T13:42:06.027 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 0, 2023-11-06T13:42:06.028 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2023-11-06T13:42:06.028 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 0, 2023-11-06T13:42:06.028 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 0, 2023-11-06T13:42:06.028 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 0, 2023-11-06T13:42:06.028 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2023-11-06T13:42:06.029 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.029 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.029 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.029 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.029 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2023-11-06T13:42:06.030 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.030 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.030 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.030 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.030 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:06.031 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.031 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.031 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.031 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.031 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2023-11-06T13:42:06.032 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.032 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.032 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.032 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.032 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2023-11-06T13:42:06.033 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.033 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.033 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.033 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.033 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:06.034 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.034 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.034 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.034 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.034 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2023-11-06T13:42:06.035 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.035 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.035 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.035 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.035 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2023-11-06T13:42:06.036 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.036 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.036 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.036 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.037 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:06.037 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.037 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.037 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.037 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.038 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:06.038 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.038 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.038 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.038 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.039 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2023-11-06T13:42:06.039 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.039 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.039 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.039 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.039 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2023-11-06T13:42:06.040 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.040 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.040 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.040 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.040 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2023-11-06T13:42:06.041 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.041 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.041 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.041 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.041 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2023-11-06T13:42:06.042 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.042 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.042 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.042 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.042 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2023-11-06T13:42:06.043 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.043 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.043 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.043 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.043 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2023-11-06T13:42:06.044 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.044 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.044 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.044 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.044 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2023-11-06T13:42:06.045 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.045 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.045 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.045 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.045 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:06.046 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.046 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.046 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.046 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.046 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2023-11-06T13:42:06.047 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.047 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.047 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.047 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.047 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:06.048 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.048 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.048 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.048 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.048 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:06.049 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.049 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.049 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.049 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.049 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2023-11-06T13:42:06.050 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.050 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.050 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.050 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.050 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:06.051 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.051 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.051 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.051 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.051 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:06.052 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.052 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.052 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.052 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.052 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2023-11-06T13:42:06.053 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.053 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.053 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.053 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.053 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2023-11-06T13:42:06.054 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.054 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.054 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.054 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.054 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2023-11-06T13:42:06.055 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.055 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.055 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.055 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.055 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2023-11-06T13:42:06.056 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.056 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.056 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.056 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.056 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:06.057 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:06.057 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:06.057 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.057 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.057 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.058 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.058 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.058 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2023-11-06T13:42:06.058 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 1, 2023-11-06T13:42:06.058 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 1, 2023-11-06T13:42:06.059 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 0, 2023-11-06T13:42:06.059 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 1, 2023-11-06T13:42:06.059 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2023-11-06T13:42:06.059 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 0, 2023-11-06T13:42:06.059 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 0, 2023-11-06T13:42:06.060 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 1649 2023-11-06T13:42:06.060 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.060 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2023-11-06T13:42:06.060 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:06.060 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:06.061 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:06.061 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:06.061 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:06.061 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:06.061 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:06.062 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:06.062 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:06.062 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:06.062 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:06.062 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:06.063 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:06.063 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:06.063 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:06.063 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:06.063 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:06.064 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:06.064 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:06.064 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:06.064 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:06.064 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:06.065 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:06.065 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:06.065 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:06.065 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:06.065 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:06.066 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:06.066 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:06.066 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:06.066 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:06.066 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2023-11-06T13:42:06.066 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:06.067 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:06.067 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:06.067 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:06.067 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 183997, 2023-11-06T13:42:06.067 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 92, 2023-11-06T13:42:06.068 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:06.068 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:06.068 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2023-11-06T13:42:06.068 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2023-11-06T13:42:06.068 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:06.069 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:06.069 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:06.069 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:06.069 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:06.069 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 126, 2023-11-06T13:42:06.070 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:06.070 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:06.070 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:06.070 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2023-11-06T13:42:06.070 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 10172733, 2023-11-06T13:42:06.071 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 57926, 2023-11-06T13:42:06.071 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:06.071 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2023-11-06T13:42:06.071 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:06.071 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2023-11-06T13:42:06.072 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.072 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2023-11-06T13:42:06.072 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2023-11-06T13:42:06.072 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2023-11-06T13:42:06.072 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 2828, 2023-11-06T13:42:06.073 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 21, 2023-11-06T13:42:06.073 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 3, 2023-11-06T13:42:06.073 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 2828, 2023-11-06T13:42:06.073 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2023-11-06T13:42:06.073 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2828, 2023-11-06T13:42:06.073 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 2829 2023-11-06T13:42:06.074 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.074 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 2828, 2023-11-06T13:42:06.074 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 2828, 2023-11-06T13:42:06.074 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 0, 2023-11-06T13:42:06.074 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2023-11-06T13:42:06.075 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2023-11-06T13:42:06.075 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 1648, 2023-11-06T13:42:06.075 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 0, 2023-11-06T13:42:06.075 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 1178, 2023-11-06T13:42:06.075 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 0, 2023-11-06T13:42:06.076 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 0, 2023-11-06T13:42:06.076 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2023-11-06T13:42:06.076 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2023-11-06T13:42:06.076 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2023-11-06T13:42:06.076 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2023-11-06T13:42:06.077 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 0, 2023-11-06T13:42:06.077 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2023-11-06T13:42:06.077 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:06.077 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:06.077 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 1, 2023-11-06T13:42:06.078 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 0, 2023-11-06T13:42:06.078 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:06.078 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:06.078 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:06.078 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2023-11-06T13:42:06.079 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2023-11-06T13:42:06.079 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2023-11-06T13:42:06.079 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:06.079 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2023-11-06T13:42:06.079 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:06.080 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2023-11-06T13:42:06.080 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2023-11-06T13:42:06.080 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2023-11-06T13:42:06.080 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2023-11-06T13:42:06.080 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2023-11-06T13:42:06.081 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2023-11-06T13:42:06.081 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2023-11-06T13:42:06.081 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2023-11-06T13:42:06.081 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2023-11-06T13:42:06.081 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2023-11-06T13:42:06.081 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2023-11-06T13:42:06.082 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2023-11-06T13:42:06.082 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2023-11-06T13:42:06.082 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2023-11-06T13:42:06.082 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2023-11-06T13:42:06.082 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2023-11-06T13:42:06.083 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2023-11-06T13:42:06.083 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 33, 2023-11-06T13:42:06.083 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2023-11-06T13:42:06.083 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 2, 2023-11-06T13:42:06.083 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 11, 2023-11-06T13:42:06.084 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 11, 2023-11-06T13:42:06.084 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2023-11-06T13:42:06.084 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2023-11-06T13:42:06.084 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 0, 2023-11-06T13:42:06.084 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 2, 2023-11-06T13:42:06.085 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 0 2023-11-06T13:42:06.085 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.085 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2023-11-06T13:42:06.085 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 0, 2023-11-06T13:42:06.085 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:06.086 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2023-11-06T13:42:06.086 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2023-11-06T13:42:06.086 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.086 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2023-11-06T13:42:06.086 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:06.087 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2023-11-06T13:42:06.087 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2023-11-06T13:42:06.087 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2023-11-06T13:42:06.087 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2023-11-06T13:42:06.087 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:06.088 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.088 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:06.088 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.088 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2023-11-06T13:42:06.088 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.089 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 3103, 2023-11-06T13:42:06.089 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 225038082, 2023-11-06T13:42:06.089 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.089 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 3103, 2023-11-06T13:42:06.089 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:06.090 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:06.090 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 3103, 2023-11-06T13:42:06.090 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 225038082, 2023-11-06T13:42:06.093 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.093 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.093 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.094 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.094 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.094 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.094 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:06.094 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.095 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2023-11-06T13:42:06.095 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.095 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.095 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.095 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.096 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.096 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 2828, 2023-11-06T13:42:06.096 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 223919578, 2023-11-06T13:42:06.096 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 2828, 2023-11-06T13:42:06.096 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 223919578, 2023-11-06T13:42:06.097 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.097 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.097 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.097 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.097 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.098 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.098 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:06.098 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.098 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2023-11-06T13:42:06.098 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.099 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.099 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.099 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.099 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.099 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 2828, 2023-11-06T13:42:06.100 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 2828, 2023-11-06T13:42:06.100 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 2828, 2023-11-06T13:42:06.100 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 2828, 2023-11-06T13:42:06.100 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.100 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.101 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.101 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.101 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.101 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.101 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:06.101 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.102 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2023-11-06T13:42:06.102 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.102 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.102 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.102 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.103 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.103 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:06.103 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:06.103 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2023-11-06T13:42:06.103 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2023-11-06T13:42:06.104 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.104 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.104 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.104 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.104 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.105 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.105 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x55c51c5d2500": { 2023-11-06T13:42:06.105 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.105 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2023-11-06T13:42:06.105 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.106 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.106 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.106 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.106 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.107 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:06.107 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:06.107 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2023-11-06T13:42:06.107 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2023-11-06T13:42:06.107 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.107 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.108 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.108 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.108 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.108 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.108 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:42:06.110 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-11-06T13:42:06.110 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-11-06T13:42:06.111 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2023-11-06T13:42:06.111 DEBUG:tasks.check_counter:Getting stats from j 2023-11-06T13:42:06.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.j.asok perf dump 2023-11-06T13:42:06.238 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:42:06.238 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:06.238 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 2126, 2023-11-06T13:42:06.239 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 2128, 2023-11-06T13:42:06.239 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 197771361, 2023-11-06T13:42:06.239 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 661327, 2023-11-06T13:42:06.239 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 8, 2023-11-06T13:42:06.240 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 4, 2023-11-06T13:42:06.240 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.264128074, 2023-11-06T13:42:06.240 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.058590693, 2023-11-06T13:42:06.240 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.135049070, 2023-11-06T13:42:06.240 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.055205348, 2023-11-06T13:42:06.241 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 2127, 2023-11-06T13:42:06.241 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.226174821, 2023-11-06T13:42:06.241 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000106335 2023-11-06T13:42:06.241 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.242 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.242 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.242 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.243 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.243 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.243 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.243 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:06.243 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 331, 2023-11-06T13:42:06.244 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 507, 2023-11-06T13:42:06.244 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 81575791, 2023-11-06T13:42:06.244 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 470662, 2023-11-06T13:42:06.244 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 7, 2023-11-06T13:42:06.245 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 6, 2023-11-06T13:42:06.245 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.080906756, 2023-11-06T13:42:06.245 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.013927217, 2023-11-06T13:42:06.245 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.053727446, 2023-11-06T13:42:06.245 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.009137704, 2023-11-06T13:42:06.246 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.246 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 506, 2023-11-06T13:42:06.246 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.062875466, 2023-11-06T13:42:06.246 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000124259 2023-11-06T13:42:06.246 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.247 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.247 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.247 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.247 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.247 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.248 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.248 INFO:teuthology.orchestra.run.smithi038.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:06.248 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_messages": 950, 2023-11-06T13:42:06.248 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages": 909, 2023-11-06T13:42:06.248 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_recv_bytes": 151822374, 2023-11-06T13:42:06.249 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_bytes": 342155, 2023-11-06T13:42:06.249 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:06.249 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:06.249 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_total_time": 0.176892047, 2023-11-06T13:42:06.249 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_send_time": 0.026613170, 2023-11-06T13:42:06.250 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_recv_time": 0.110147843, 2023-11-06T13:42:06.250 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_running_fast_dispatch_time": 0.036496841, 2023-11-06T13:42:06.250 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.250 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 909, 2023-11-06T13:42:06.250 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.173056165, 2023-11-06T13:42:06.251 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000190380 2023-11-06T13:42:06.251 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.251 INFO:teuthology.orchestra.run.smithi038.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.251 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.251 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.252 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.252 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.252 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.252 INFO:teuthology.orchestra.run.smithi038.stdout: "cct": { 2023-11-06T13:42:06.252 INFO:teuthology.orchestra.run.smithi038.stdout: "total_workers": 1, 2023-11-06T13:42:06.253 INFO:teuthology.orchestra.run.smithi038.stdout: "unhealthy_workers": 0 2023-11-06T13:42:06.253 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.253 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-MDSRank": { 2023-11-06T13:42:06.253 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2023-11-06T13:42:06.253 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2023-11-06T13:42:06.254 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 5103, 2023-11-06T13:42:06.254 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.269156946, 2023-11-06T13:42:06.254 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000052744 2023-11-06T13:42:06.254 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.254 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.255 INFO:teuthology.orchestra.run.smithi038.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:06.255 INFO:teuthology.orchestra.run.smithi038.stdout: "queue_len": 0, 2023-11-06T13:42:06.255 INFO:teuthology.orchestra.run.smithi038.stdout: "complete_latency": { 2023-11-06T13:42:06.255 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.255 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.256 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.256 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.256 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.256 INFO:teuthology.orchestra.run.smithi038.stdout: "mds": { 2023-11-06T13:42:06.256 INFO:teuthology.orchestra.run.smithi038.stdout: "request": 0, 2023-11-06T13:42:06.257 INFO:teuthology.orchestra.run.smithi038.stdout: "reply": 0, 2023-11-06T13:42:06.257 INFO:teuthology.orchestra.run.smithi038.stdout: "reply_latency": { 2023-11-06T13:42:06.257 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.257 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.257 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.257 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.258 INFO:teuthology.orchestra.run.smithi038.stdout: "slow_reply": 0, 2023-11-06T13:42:06.258 INFO:teuthology.orchestra.run.smithi038.stdout: "forward": 0, 2023-11-06T13:42:06.258 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_fetch": 0, 2023-11-06T13:42:06.258 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_commit": 0, 2023-11-06T13:42:06.258 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_split": 0, 2023-11-06T13:42:06.259 INFO:teuthology.orchestra.run.smithi038.stdout: "dir_merge": 0, 2023-11-06T13:42:06.259 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes": 13, 2023-11-06T13:42:06.259 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_top": 0, 2023-11-06T13:42:06.259 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_bottom": 0, 2023-11-06T13:42:06.259 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pin_tail": 13, 2023-11-06T13:42:06.260 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_pinned": 13, 2023-11-06T13:42:06.260 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_expired": 7787, 2023-11-06T13:42:06.260 INFO:teuthology.orchestra.run.smithi038.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:06.260 INFO:teuthology.orchestra.run.smithi038.stdout: "caps": 0, 2023-11-06T13:42:06.260 INFO:teuthology.orchestra.run.smithi038.stdout: "subtrees": 1, 2023-11-06T13:42:06.261 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse": 0, 2023-11-06T13:42:06.261 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_hit": 0, 2023-11-06T13:42:06.261 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_forward": 0, 2023-11-06T13:42:06.261 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_discover": 0, 2023-11-06T13:42:06.261 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:06.262 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:06.262 INFO:teuthology.orchestra.run.smithi038.stdout: "traverse_lock": 0, 2023-11-06T13:42:06.262 INFO:teuthology.orchestra.run.smithi038.stdout: "load_cent": 0, 2023-11-06T13:42:06.262 INFO:teuthology.orchestra.run.smithi038.stdout: "q": 0, 2023-11-06T13:42:06.262 INFO:teuthology.orchestra.run.smithi038.stdout: "exported": 0, 2023-11-06T13:42:06.263 INFO:teuthology.orchestra.run.smithi038.stdout: "exported_inodes": 0, 2023-11-06T13:42:06.263 INFO:teuthology.orchestra.run.smithi038.stdout: "imported": 0, 2023-11-06T13:42:06.263 INFO:teuthology.orchestra.run.smithi038.stdout: "imported_inodes": 0, 2023-11-06T13:42:06.263 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:06.263 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_backtrace_fetch": 0, 2023-11-06T13:42:06.264 INFO:teuthology.orchestra.run.smithi038.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:06.264 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rfiles": 0, 2023-11-06T13:42:06.264 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rbytes": 0, 2023-11-06T13:42:06.264 INFO:teuthology.orchestra.run.smithi038.stdout: "root_rsnaps": 0, 2023-11-06T13:42:06.264 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_fetch": 0, 2023-11-06T13:42:06.265 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:06.265 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:06.265 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:06.265 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_inodes": 0, 2023-11-06T13:42:06.265 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:06.266 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_dirfrag_rstats": 0, 2023-11-06T13:42:06.266 INFO:teuthology.orchestra.run.smithi038.stdout: "scrub_file_inodes": 0, 2023-11-06T13:42:06.266 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_inode_file_caps": 0, 2023-11-06T13:42:06.266 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_revoke": 0, 2023-11-06T13:42:06.267 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_grant": 0, 2023-11-06T13:42:06.267 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:06.267 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:06.267 INFO:teuthology.orchestra.run.smithi038.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:06.267 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps": 0, 2023-11-06T13:42:06.268 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_caps_dirty": 0, 2023-11-06T13:42:06.268 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_cap_release": 0, 2023-11-06T13:42:06.268 INFO:teuthology.orchestra.run.smithi038.stdout: "process_request_cap_release": 0 2023-11-06T13:42:06.268 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.268 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_cache": { 2023-11-06T13:42:06.269 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays": 0, 2023-11-06T13:42:06.269 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:06.269 INFO:teuthology.orchestra.run.smithi038.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:06.269 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_created": 0, 2023-11-06T13:42:06.269 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_enqueued": 0, 2023-11-06T13:42:06.270 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:06.270 INFO:teuthology.orchestra.run.smithi038.stdout: "strays_migrated": 0, 2023-11-06T13:42:06.270 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:06.270 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:06.270 INFO:teuthology.orchestra.run.smithi038.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:06.271 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_started": 0, 2023-11-06T13:42:06.271 INFO:teuthology.orchestra.run.smithi038.stdout: "recovery_completed": 0, 2023-11-06T13:42:06.271 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:06.271 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_exportdir": 0, 2023-11-06T13:42:06.271 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_flush": 0, 2023-11-06T13:42:06.272 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragmentdir": 0, 2023-11-06T13:42:06.272 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:06.272 INFO:teuthology.orchestra.run.smithi038.stdout: "ireq_inodestats": 0 2023-11-06T13:42:06.272 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.272 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_log": { 2023-11-06T13:42:06.273 INFO:teuthology.orchestra.run.smithi038.stdout: "evadd": 0, 2023-11-06T13:42:06.273 INFO:teuthology.orchestra.run.smithi038.stdout: "evex": 0, 2023-11-06T13:42:06.273 INFO:teuthology.orchestra.run.smithi038.stdout: "evtrm": 0, 2023-11-06T13:42:06.273 INFO:teuthology.orchestra.run.smithi038.stdout: "ev": 193843, 2023-11-06T13:42:06.273 INFO:teuthology.orchestra.run.smithi038.stdout: "evexg": 0, 2023-11-06T13:42:06.274 INFO:teuthology.orchestra.run.smithi038.stdout: "evexd": 0, 2023-11-06T13:42:06.274 INFO:teuthology.orchestra.run.smithi038.stdout: "segadd": 0, 2023-11-06T13:42:06.274 INFO:teuthology.orchestra.run.smithi038.stdout: "segex": 0, 2023-11-06T13:42:06.274 INFO:teuthology.orchestra.run.smithi038.stdout: "segtrm": 0, 2023-11-06T13:42:06.274 INFO:teuthology.orchestra.run.smithi038.stdout: "seg": 129, 2023-11-06T13:42:06.274 INFO:teuthology.orchestra.run.smithi038.stdout: "segexg": 0, 2023-11-06T13:42:06.275 INFO:teuthology.orchestra.run.smithi038.stdout: "segexd": 0, 2023-11-06T13:42:06.275 INFO:teuthology.orchestra.run.smithi038.stdout: "expos": 226497747, 2023-11-06T13:42:06.275 INFO:teuthology.orchestra.run.smithi038.stdout: "wrpos": 433803340, 2023-11-06T13:42:06.275 INFO:teuthology.orchestra.run.smithi038.stdout: "rdpos": 433802741, 2023-11-06T13:42:06.275 INFO:teuthology.orchestra.run.smithi038.stdout: "jlat": { 2023-11-06T13:42:06.276 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.276 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.276 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.276 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.276 INFO:teuthology.orchestra.run.smithi038.stdout: "replayed": 193843 2023-11-06T13:42:06.277 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.277 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_mem": { 2023-11-06T13:42:06.277 INFO:teuthology.orchestra.run.smithi038.stdout: "ino": 15, 2023-11-06T13:42:06.277 INFO:teuthology.orchestra.run.smithi038.stdout: "ino+": 58981, 2023-11-06T13:42:06.277 INFO:teuthology.orchestra.run.smithi038.stdout: "ino-": 58966, 2023-11-06T13:42:06.278 INFO:teuthology.orchestra.run.smithi038.stdout: "dir": 24, 2023-11-06T13:42:06.278 INFO:teuthology.orchestra.run.smithi038.stdout: "dir+": 2791, 2023-11-06T13:42:06.278 INFO:teuthology.orchestra.run.smithi038.stdout: "dir-": 2767, 2023-11-06T13:42:06.278 INFO:teuthology.orchestra.run.smithi038.stdout: "dn": 29516, 2023-11-06T13:42:06.278 INFO:teuthology.orchestra.run.smithi038.stdout: "dn+": 125630, 2023-11-06T13:42:06.279 INFO:teuthology.orchestra.run.smithi038.stdout: "dn-": 96114, 2023-11-06T13:42:06.279 INFO:teuthology.orchestra.run.smithi038.stdout: "cap": 0, 2023-11-06T13:42:06.279 INFO:teuthology.orchestra.run.smithi038.stdout: "cap+": 0, 2023-11-06T13:42:06.279 INFO:teuthology.orchestra.run.smithi038.stdout: "cap-": 0, 2023-11-06T13:42:06.279 INFO:teuthology.orchestra.run.smithi038.stdout: "rss": 107468, 2023-11-06T13:42:06.280 INFO:teuthology.orchestra.run.smithi038.stdout: "heap": 340216 2023-11-06T13:42:06.280 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.280 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_server": { 2023-11-06T13:42:06.280 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_client_request": 0, 2023-11-06T13:42:06.280 INFO:teuthology.orchestra.run.smithi038.stdout: "dispatch_server_request": 0, 2023-11-06T13:42:06.281 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_request": 0, 2023-11-06T13:42:06.281 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_client_session": 0, 2023-11-06T13:42:06.281 INFO:teuthology.orchestra.run.smithi038.stdout: "handle_peer_request": 0, 2023-11-06T13:42:06.281 INFO:teuthology.orchestra.run.smithi038.stdout: "req_create_latency": { 2023-11-06T13:42:06.281 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.282 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.282 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.282 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.282 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getattr_latency": { 2023-11-06T13:42:06.282 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.283 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.283 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.283 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.283 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:06.283 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.284 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.284 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.284 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.284 INFO:teuthology.orchestra.run.smithi038.stdout: "req_link_latency": { 2023-11-06T13:42:06.284 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.285 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.285 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.285 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.285 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookup_latency": { 2023-11-06T13:42:06.285 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.286 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.286 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.286 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.286 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:06.286 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.287 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.287 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.287 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.287 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupino_latency": { 2023-11-06T13:42:06.287 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.288 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.288 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.288 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.288 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupname_latency": { 2023-11-06T13:42:06.288 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.288 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.289 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.289 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.289 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:06.289 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.289 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.290 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.290 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.290 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:06.290 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.290 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.291 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.291 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.291 INFO:teuthology.orchestra.run.smithi038.stdout: "req_lssnap_latency": { 2023-11-06T13:42:06.291 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.291 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.292 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.292 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.292 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mkdir_latency": { 2023-11-06T13:42:06.292 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.292 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.293 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.293 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.293 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mknod_latency": { 2023-11-06T13:42:06.293 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.293 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.294 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.294 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.294 INFO:teuthology.orchestra.run.smithi038.stdout: "req_mksnap_latency": { 2023-11-06T13:42:06.294 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.294 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.295 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.295 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.295 INFO:teuthology.orchestra.run.smithi038.stdout: "req_open_latency": { 2023-11-06T13:42:06.295 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.295 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.296 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.296 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.296 INFO:teuthology.orchestra.run.smithi038.stdout: "req_readdir_latency": { 2023-11-06T13:42:06.296 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.296 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.297 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.297 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.297 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rename_latency": { 2023-11-06T13:42:06.297 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.297 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.298 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.298 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.298 INFO:teuthology.orchestra.run.smithi038.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:06.298 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.298 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.299 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.299 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.299 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmdir_latency": { 2023-11-06T13:42:06.299 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.299 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.300 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.300 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.300 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:06.300 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.300 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.301 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.301 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.301 INFO:teuthology.orchestra.run.smithi038.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:06.301 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.301 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.302 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.302 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.302 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setattr_latency": { 2023-11-06T13:42:06.302 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.302 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.303 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.303 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.303 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:06.303 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.303 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.304 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.305 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.305 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setlayout_latency": { 2023-11-06T13:42:06.305 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.305 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.305 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.306 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.306 INFO:teuthology.orchestra.run.smithi038.stdout: "req_setxattr_latency": { 2023-11-06T13:42:06.306 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.306 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.306 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.307 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.307 INFO:teuthology.orchestra.run.smithi038.stdout: "req_symlink_latency": { 2023-11-06T13:42:06.307 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.307 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.308 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.308 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.308 INFO:teuthology.orchestra.run.smithi038.stdout: "req_unlink_latency": { 2023-11-06T13:42:06.308 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.308 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.308 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:06.309 INFO:teuthology.orchestra.run.smithi038.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.310 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_sessions": { 2023-11-06T13:42:06.311 INFO:teuthology.orchestra.run.smithi038.stdout: "session_count": 1, 2023-11-06T13:42:06.311 INFO:teuthology.orchestra.run.smithi038.stdout: "session_add": 2, 2023-11-06T13:42:06.311 INFO:teuthology.orchestra.run.smithi038.stdout: "session_remove": 1, 2023-11-06T13:42:06.311 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_open": 1, 2023-11-06T13:42:06.311 INFO:teuthology.orchestra.run.smithi038.stdout: "sessions_stale": 0, 2023-11-06T13:42:06.312 INFO:teuthology.orchestra.run.smithi038.stdout: "total_load": 0, 2023-11-06T13:42:06.312 INFO:teuthology.orchestra.run.smithi038.stdout: "average_load": 0, 2023-11-06T13:42:06.312 INFO:teuthology.orchestra.run.smithi038.stdout: "avg_session_uptime": 1649 2023-11-06T13:42:06.312 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.313 INFO:teuthology.orchestra.run.smithi038.stdout: "mempool": { 2023-11-06T13:42:06.313 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:06.313 INFO:teuthology.orchestra.run.smithi038.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:06.313 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:06.313 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:06.313 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:06.314 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:06.314 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:06.314 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:06.314 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:06.314 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:06.315 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:06.315 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:06.315 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:06.315 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:06.315 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:06.316 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:06.316 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:06.316 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:06.316 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:06.316 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:06.317 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:06.317 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:06.317 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:06.317 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:06.317 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:06.318 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:06.318 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:06.318 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:06.318 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:06.318 INFO:teuthology.orchestra.run.smithi038.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:06.319 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:06.319 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_items": 0, 2023-11-06T13:42:06.319 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:06.319 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:06.319 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:06.320 INFO:teuthology.orchestra.run.smithi038.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:06.320 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_bytes": 192061, 2023-11-06T13:42:06.320 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_anon_items": 96, 2023-11-06T13:42:06.320 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:06.320 INFO:teuthology.orchestra.run.smithi038.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:06.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_bytes": 0, 2023-11-06T13:42:06.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_items": 0, 2023-11-06T13:42:06.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:06.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:06.321 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:06.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:06.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:06.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_items": 126, 2023-11-06T13:42:06.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:06.322 INFO:teuthology.orchestra.run.smithi038.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:06.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:06.323 INFO:teuthology.orchestra.run.smithi038.stdout: "pgmap_items": 0, 2023-11-06T13:42:06.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_bytes": 20863713, 2023-11-06T13:42:06.323 INFO:teuthology.orchestra.run.smithi038.stdout: "mds_co_items": 118221, 2023-11-06T13:42:06.324 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:06.324 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_1_items": 0, 2023-11-06T13:42:06.324 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:06.324 INFO:teuthology.orchestra.run.smithi038.stdout: "unittest_2_items": 0 2023-11-06T13:42:06.325 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.325 INFO:teuthology.orchestra.run.smithi038.stdout: "objecter": { 2023-11-06T13:42:06.325 INFO:teuthology.orchestra.run.smithi038.stdout: "op_active": 0, 2023-11-06T13:42:06.325 INFO:teuthology.orchestra.run.smithi038.stdout: "op_laggy": 0, 2023-11-06T13:42:06.325 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send": 3125, 2023-11-06T13:42:06.326 INFO:teuthology.orchestra.run.smithi038.stdout: "op_send_bytes": 21, 2023-11-06T13:42:06.326 INFO:teuthology.orchestra.run.smithi038.stdout: "op_resend": 3, 2023-11-06T13:42:06.326 INFO:teuthology.orchestra.run.smithi038.stdout: "op_reply": 3125, 2023-11-06T13:42:06.326 INFO:teuthology.orchestra.run.smithi038.stdout: "oplen_avg": { 2023-11-06T13:42:06.326 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 3125, 2023-11-06T13:42:06.327 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 3126 2023-11-06T13:42:06.327 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.327 INFO:teuthology.orchestra.run.smithi038.stdout: "op": 3125, 2023-11-06T13:42:06.327 INFO:teuthology.orchestra.run.smithi038.stdout: "op_r": 3125, 2023-11-06T13:42:06.327 INFO:teuthology.orchestra.run.smithi038.stdout: "op_w": 0, 2023-11-06T13:42:06.328 INFO:teuthology.orchestra.run.smithi038.stdout: "op_rmw": 0, 2023-11-06T13:42:06.328 INFO:teuthology.orchestra.run.smithi038.stdout: "op_pg": 0, 2023-11-06T13:42:06.328 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_stat": 1791, 2023-11-06T13:42:06.328 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_create": 0, 2023-11-06T13:42:06.328 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_read": 1332, 2023-11-06T13:42:06.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_write": 0, 2023-11-06T13:42:06.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writefull": 0, 2023-11-06T13:42:06.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_writesame": 0, 2023-11-06T13:42:06.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_append": 0, 2023-11-06T13:42:06.329 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_zero": 0, 2023-11-06T13:42:06.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_truncate": 0, 2023-11-06T13:42:06.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_delete": 0, 2023-11-06T13:42:06.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_mapext": 0, 2023-11-06T13:42:06.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:06.330 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:06.331 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_getxattr": 1, 2023-11-06T13:42:06.331 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_setxattr": 0, 2023-11-06T13:42:06.331 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:06.331 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:06.331 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:06.332 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_call": 0, 2023-11-06T13:42:06.332 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_watch": 0, 2023-11-06T13:42:06.332 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_notify": 0, 2023-11-06T13:42:06.332 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:06.332 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls": 0, 2023-11-06T13:42:06.333 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:06.333 INFO:teuthology.orchestra.run.smithi038.stdout: "osdop_other": 0, 2023-11-06T13:42:06.333 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_active": 0, 2023-11-06T13:42:06.333 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_send": 0, 2023-11-06T13:42:06.333 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_resend": 0, 2023-11-06T13:42:06.334 INFO:teuthology.orchestra.run.smithi038.stdout: "linger_ping": 0, 2023-11-06T13:42:06.334 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_active": 0, 2023-11-06T13:42:06.334 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_send": 0, 2023-11-06T13:42:06.334 INFO:teuthology.orchestra.run.smithi038.stdout: "poolop_resend": 0, 2023-11-06T13:42:06.334 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_active": 0, 2023-11-06T13:42:06.335 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_send": 0, 2023-11-06T13:42:06.335 INFO:teuthology.orchestra.run.smithi038.stdout: "poolstat_resend": 0, 2023-11-06T13:42:06.335 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_active": 0, 2023-11-06T13:42:06.335 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_send": 0, 2023-11-06T13:42:06.335 INFO:teuthology.orchestra.run.smithi038.stdout: "statfs_resend": 0, 2023-11-06T13:42:06.335 INFO:teuthology.orchestra.run.smithi038.stdout: "command_active": 0, 2023-11-06T13:42:06.336 INFO:teuthology.orchestra.run.smithi038.stdout: "command_send": 0, 2023-11-06T13:42:06.336 INFO:teuthology.orchestra.run.smithi038.stdout: "command_resend": 0, 2023-11-06T13:42:06.336 INFO:teuthology.orchestra.run.smithi038.stdout: "map_epoch": 33, 2023-11-06T13:42:06.336 INFO:teuthology.orchestra.run.smithi038.stdout: "map_full": 0, 2023-11-06T13:42:06.337 INFO:teuthology.orchestra.run.smithi038.stdout: "map_inc": 2, 2023-11-06T13:42:06.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_sessions": 12, 2023-11-06T13:42:06.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_open": 12, 2023-11-06T13:42:06.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_session_close": 0, 2023-11-06T13:42:06.337 INFO:teuthology.orchestra.run.smithi038.stdout: "osd_laggy": 0, 2023-11-06T13:42:06.337 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_wr": 0, 2023-11-06T13:42:06.338 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_rd": 2, 2023-11-06T13:42:06.338 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_del": 0 2023-11-06T13:42:06.338 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.338 INFO:teuthology.orchestra.run.smithi038.stdout: "oft": { 2023-11-06T13:42:06.338 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_objs": 0, 2023-11-06T13:42:06.339 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:06.339 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_updates": 0, 2023-11-06T13:42:06.339 INFO:teuthology.orchestra.run.smithi038.stdout: "omap_total_removes": 0 2023-11-06T13:42:06.339 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.339 INFO:teuthology.orchestra.run.smithi038.stdout: "purge_queue": { 2023-11-06T13:42:06.340 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:06.340 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_ops_high_water": 0, 2023-11-06T13:42:06.340 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing": 0, 2023-11-06T13:42:06.340 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executing_high_water": 0, 2023-11-06T13:42:06.340 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_executed": 0, 2023-11-06T13:42:06.341 INFO:teuthology.orchestra.run.smithi038.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:06.341 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.341 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:06.341 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.341 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2023-11-06T13:42:06.342 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.342 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 3403, 2023-11-06T13:42:06.342 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 430847563, 2023-11-06T13:42:06.342 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.342 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 3403, 2023-11-06T13:42:06.343 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:06.343 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:06.343 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 3403, 2023-11-06T13:42:06.343 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 430847563, 2023-11-06T13:42:06.344 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.344 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.344 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.344 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.344 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.344 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.345 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:06.345 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.345 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 104857600, 2023-11-06T13:42:06.345 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.345 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.346 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.346 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.346 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.346 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 3125, 2023-11-06T13:42:06.346 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 429666026, 2023-11-06T13:42:06.347 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 3125, 2023-11-06T13:42:06.347 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 429666026, 2023-11-06T13:42:06.347 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.347 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.347 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.348 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.348 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.348 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.348 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:06.348 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.349 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 1024, 2023-11-06T13:42:06.349 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.349 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.349 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.349 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.350 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.350 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 3125, 2023-11-06T13:42:06.350 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 3125, 2023-11-06T13:42:06.350 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 3125, 2023-11-06T13:42:06.350 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 3125, 2023-11-06T13:42:06.351 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.351 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.351 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.351 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.351 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.352 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.352 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:06.352 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.352 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2023-11-06T13:42:06.352 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.353 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.353 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:06.354 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:06.354 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2023-11-06T13:42:06.354 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2023-11-06T13:42:06.354 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.354 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.355 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.355 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.355 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.355 INFO:teuthology.orchestra.run.smithi038.stdout: }, 2023-11-06T13:42:06.355 INFO:teuthology.orchestra.run.smithi038.stdout: "throttle-write_buf_throttle-0x563d760de5a0": { 2023-11-06T13:42:06.356 INFO:teuthology.orchestra.run.smithi038.stdout: "val": 0, 2023-11-06T13:42:06.356 INFO:teuthology.orchestra.run.smithi038.stdout: "max": 3758096384, 2023-11-06T13:42:06.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get_started": 0, 2023-11-06T13:42:06.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get": 0, 2023-11-06T13:42:06.356 INFO:teuthology.orchestra.run.smithi038.stdout: "get_sum": 0, 2023-11-06T13:42:06.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.357 INFO:teuthology.orchestra.run.smithi038.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.357 INFO:teuthology.orchestra.run.smithi038.stdout: "take": 0, 2023-11-06T13:42:06.357 INFO:teuthology.orchestra.run.smithi038.stdout: "take_sum": 0, 2023-11-06T13:42:06.357 INFO:teuthology.orchestra.run.smithi038.stdout: "put": 0, 2023-11-06T13:42:06.358 INFO:teuthology.orchestra.run.smithi038.stdout: "put_sum": 0, 2023-11-06T13:42:06.358 INFO:teuthology.orchestra.run.smithi038.stdout: "wait": { 2023-11-06T13:42:06.358 INFO:teuthology.orchestra.run.smithi038.stdout: "avgcount": 0, 2023-11-06T13:42:06.358 INFO:teuthology.orchestra.run.smithi038.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.358 INFO:teuthology.orchestra.run.smithi038.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.359 INFO:teuthology.orchestra.run.smithi038.stdout: } 2023-11-06T13:42:06.359 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:42:06.361 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2023-11-06T13:42:06.361 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2023-11-06T13:42:06.361 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2023-11-06T13:42:06.361 DEBUG:tasks.check_counter:Getting stats from b 2023-11-06T13:42:06.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2023-11-06T13:42:06.653 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-06T13:42:06.653 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:06.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 149511, 2023-11-06T13:42:06.653 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 257727, 2023-11-06T13:42:06.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 53295051, 2023-11-06T13:42:06.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 189299807, 2023-11-06T13:42:06.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 13, 2023-11-06T13:42:06.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2023-11-06T13:42:06.654 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 8.883830822, 2023-11-06T13:42:06.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 4.254948225, 2023-11-06T13:42:06.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 143.383837765, 2023-11-06T13:42:06.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.527164502, 2023-11-06T13:42:06.655 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.655 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 257725, 2023-11-06T13:42:06.656 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 22.771896027, 2023-11-06T13:42:06.656 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000088357 2023-11-06T13:42:06.656 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.656 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.656 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 275749, 2023-11-06T13:42:06.657 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.048900882, 2023-11-06T13:42:06.657 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000177 2023-11-06T13:42:06.657 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.657 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.657 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:06.658 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 3341386, 2023-11-06T13:42:06.658 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 3338579, 2023-11-06T13:42:06.658 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 539056894, 2023-11-06T13:42:06.658 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 647641912, 2023-11-06T13:42:06.658 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 9, 2023-11-06T13:42:06.659 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 7, 2023-11-06T13:42:06.659 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 87.169951746, 2023-11-06T13:42:06.659 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 37.177692776, 2023-11-06T13:42:06.659 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 58.696220008, 2023-11-06T13:42:06.659 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.411800644, 2023-11-06T13:42:06.660 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.660 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3338578, 2023-11-06T13:42:06.660 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 47.633652714, 2023-11-06T13:42:06.661 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000014267 2023-11-06T13:42:06.661 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.661 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.661 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5675969, 2023-11-06T13:42:06.661 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.971914403, 2023-11-06T13:42:06.661 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000171 2023-11-06T13:42:06.662 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.662 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:06.662 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 825909, 2023-11-06T13:42:06.663 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 830525, 2023-11-06T13:42:06.663 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 154090705, 2023-11-06T13:42:06.663 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 205102649, 2023-11-06T13:42:06.663 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2023-11-06T13:42:06.663 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 6, 2023-11-06T13:42:06.663 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 28.081764464, 2023-11-06T13:42:06.664 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 11.183804505, 2023-11-06T13:42:06.664 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 19.446606226, 2023-11-06T13:42:06.664 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.445513837, 2023-11-06T13:42:06.664 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.664 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 830525, 2023-11-06T13:42:06.665 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 14.789592635, 2023-11-06T13:42:06.665 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000017807 2023-11-06T13:42:06.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.665 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.665 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1559635, 2023-11-06T13:42:06.666 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.195454245, 2023-11-06T13:42:06.666 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000125 2023-11-06T13:42:06.666 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.667 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2023-11-06T13:42:06.667 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2023-11-06T13:42:06.667 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2023-11-06T13:42:06.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.667 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2023-11-06T13:42:06.668 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:06.668 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:06.668 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 14503, 2023-11-06T13:42:06.668 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 64.170087655, 2023-11-06T13:42:06.668 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.004424607 2023-11-06T13:42:06.668 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.669 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:06.669 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:06.669 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:06.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 26207, 2023-11-06T13:42:06.670 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 6.234630721, 2023-11-06T13:42:06.670 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000237899 2023-11-06T13:42:06.670 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.671 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2023-11-06T13:42:06.671 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 75442, 2023-11-06T13:42:06.671 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 72150, 2023-11-06T13:42:06.671 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2023-11-06T13:42:06.671 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 72150, 2023-11-06T13:42:06.672 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 7426.691198319, 2023-11-06T13:42:06.672 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.102934042 2023-11-06T13:42:06.672 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.672 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2023-11-06T13:42:06.672 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 3292, 2023-11-06T13:42:06.673 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch": 0, 2023-11-06T13:42:06.673 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 598, 2023-11-06T13:42:06.673 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 65, 2023-11-06T13:42:06.673 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 2, 2023-11-06T13:42:06.673 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 19, 2023-11-06T13:42:06.674 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 3, 2023-11-06T13:42:06.674 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 3, 2023-11-06T13:42:06.674 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 13, 2023-11-06T13:42:06.674 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 14, 2023-11-06T13:42:06.674 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 45291, 2023-11-06T13:42:06.675 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 4, 2023-11-06T13:42:06.675 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 4, 2023-11-06T13:42:06.675 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 4, 2023-11-06T13:42:06.675 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 121940, 2023-11-06T13:42:06.675 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 109336, 2023-11-06T13:42:06.676 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 3163, 2023-11-06T13:42:06.676 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 617, 2023-11-06T13:42:06.676 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:06.676 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:06.676 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 489, 2023-11-06T13:42:06.677 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 20379, 2023-11-06T13:42:06.677 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2023-11-06T13:42:06.677 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 348, 2023-11-06T13:42:06.677 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 32822, 2023-11-06T13:42:06.677 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 362, 2023-11-06T13:42:06.678 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 30821, 2023-11-06T13:42:06.678 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:06.678 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 9055, 2023-11-06T13:42:06.678 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:06.679 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 3939, 2023-11-06T13:42:06.679 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 92437865, 2023-11-06T13:42:06.679 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2023-11-06T13:42:06.679 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 9055, 2023-11-06T13:42:06.679 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:06.680 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:06.680 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:06.680 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 56, 2023-11-06T13:42:06.680 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:06.680 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 56, 2023-11-06T13:42:06.681 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 8999, 2023-11-06T13:42:06.681 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 175, 2023-11-06T13:42:06.681 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 15648, 2023-11-06T13:42:06.681 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 34022, 2023-11-06T13:42:06.682 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:06.682 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:06.682 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:06.682 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 36912, 2023-11-06T13:42:06.682 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 14940, 2023-11-06T13:42:06.683 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 438, 2023-11-06T13:42:06.683 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 37473 2023-11-06T13:42:06.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.683 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2023-11-06T13:42:06.684 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 3, 2023-11-06T13:42:06.684 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:06.684 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:06.684 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 14371, 2023-11-06T13:42:06.684 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 14368, 2023-11-06T13:42:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2023-11-06T13:42:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:06.685 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2023-11-06T13:42:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2023-11-06T13:42:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 354, 2023-11-06T13:42:06.686 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2023-11-06T13:42:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 67, 2023-11-06T13:42:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2023-11-06T13:42:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.687 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2023-11-06T13:42:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 96554, 2023-11-06T13:42:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2023-11-06T13:42:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2023-11-06T13:42:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 96554, 2023-11-06T13:42:06.688 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2023-11-06T13:42:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2023-11-06T13:42:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 118, 2023-11-06T13:42:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2023-11-06T13:42:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2023-11-06T13:42:06.689 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 118, 2023-11-06T13:42:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2023-11-06T13:42:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2023-11-06T13:42:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2023-11-06T13:42:06.690 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 228075032, 2023-11-06T13:42:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 0, 2023-11-06T13:42:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2023-11-06T13:42:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3072, 2023-11-06T13:42:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 163.328749787, 2023-11-06T13:42:06.691 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.053166910 2023-11-06T13:42:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 0 2023-11-06T13:42:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2023-11-06T13:42:06.692 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 25, 2023-11-06T13:42:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 37250, 2023-11-06T13:42:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 37225, 2023-11-06T13:42:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 18, 2023-11-06T13:42:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 1684, 2023-11-06T13:42:06.693 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 1666, 2023-11-06T13:42:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 18, 2023-11-06T13:42:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 75108, 2023-11-06T13:42:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 75090, 2023-11-06T13:42:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 3, 2023-11-06T13:42:06.694 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 43535, 2023-11-06T13:42:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 43532, 2023-11-06T13:42:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 110260, 2023-11-06T13:42:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 332024 2023-11-06T13:42:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.695 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2023-11-06T13:42:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 93798, 2023-11-06T13:42:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 3095, 2023-11-06T13:42:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 75442, 2023-11-06T13:42:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 391, 2023-11-06T13:42:06.696 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 5339, 2023-11-06T13:42:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2023-11-06T13:42:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 14879, 2023-11-06T13:42:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 45.790628580, 2023-11-06T13:42:06.697 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003077534 2023-11-06T13:42:06.698 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.698 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2023-11-06T13:42:06.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 210, 2023-11-06T13:42:06.698 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 24.696025121, 2023-11-06T13:42:06.698 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.117600119 2023-11-06T13:42:06.699 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.699 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:06.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.699 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.699 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.700 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.700 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2023-11-06T13:42:06.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.700 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.700 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.701 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.701 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2023-11-06T13:42:06.701 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 26150, 2023-11-06T13:42:06.701 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 6833.806156824, 2023-11-06T13:42:06.701 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.261331019 2023-11-06T13:42:06.702 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.702 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:06.702 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.702 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.702 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.703 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.703 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2023-11-06T13:42:06.703 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.703 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.703 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.705 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.706 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2023-11-06T13:42:06.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.706 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.706 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.707 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:06.707 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.707 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.707 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.707 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.708 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:06.708 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.708 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.708 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.708 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.709 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2023-11-06T13:42:06.709 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.709 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.709 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.709 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.709 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2023-11-06T13:42:06.710 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 90, 2023-11-06T13:42:06.710 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.514872485, 2023-11-06T13:42:06.710 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005720805 2023-11-06T13:42:06.710 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.710 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2023-11-06T13:42:06.711 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.711 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.711 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.711 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.711 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2023-11-06T13:42:06.712 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.712 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.712 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.712 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.712 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2023-11-06T13:42:06.713 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3226, 2023-11-06T13:42:06.713 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 16.758351927, 2023-11-06T13:42:06.713 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.005194777 2023-11-06T13:42:06.713 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.713 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2023-11-06T13:42:06.714 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 536, 2023-11-06T13:42:06.714 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2.072309882, 2023-11-06T13:42:06.714 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.003866249 2023-11-06T13:42:06.714 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.714 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2023-11-06T13:42:06.715 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 14892, 2023-11-06T13:42:06.715 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 469.142822495, 2023-11-06T13:42:06.715 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.031503009 2023-11-06T13:42:06.715 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.715 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:06.716 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.716 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.716 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.716 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.716 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2023-11-06T13:42:06.717 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 71, 2023-11-06T13:42:06.717 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 14.432982702, 2023-11-06T13:42:06.717 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.203281446 2023-11-06T13:42:06.717 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.717 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:06.718 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.718 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.718 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.718 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.718 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:06.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.719 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.719 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.719 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2023-11-06T13:42:06.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.720 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.720 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.721 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:06.721 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.721 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.721 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.721 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:06.722 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.722 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.722 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.723 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2023-11-06T13:42:06.723 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.723 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.723 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.723 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2023-11-06T13:42:06.724 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.724 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.724 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.724 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2023-11-06T13:42:06.725 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.725 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.725 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.725 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2023-11-06T13:42:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 12096, 2023-11-06T13:42:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 19.477048303, 2023-11-06T13:42:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.001610205 2023-11-06T13:42:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.726 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:06.727 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:06.727 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:06.727 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.727 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.727 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.728 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.728 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2023-11-06T13:42:06.728 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2023-11-06T13:42:06.728 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 1, 2023-11-06T13:42:06.728 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 0, 2023-11-06T13:42:06.729 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2023-11-06T13:42:06.729 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2023-11-06T13:42:06.729 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 6655, 2023-11-06T13:42:06.729 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 6655, 2023-11-06T13:42:06.729 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 1859 2023-11-06T13:42:06.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.730 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2023-11-06T13:42:06.730 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:06.730 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:06.730 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:06.731 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:06.731 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:06.731 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:06.731 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:06.731 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:06.732 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:06.732 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:06.732 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:06.732 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:06.732 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:06.733 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:06.733 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:06.733 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:06.733 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:06.733 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:06.734 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:06.734 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:06.734 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:06.734 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:06.735 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:06.735 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:06.735 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:06.735 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:06.735 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:06.736 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:06.736 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:06.736 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:06.736 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:06.736 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2023-11-06T13:42:06.737 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:06.737 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:06.737 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:06.737 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:06.737 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 215935, 2023-11-06T13:42:06.738 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 133, 2023-11-06T13:42:06.738 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:06.738 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:06.738 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2023-11-06T13:42:06.738 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2023-11-06T13:42:06.739 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:06.739 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:06.739 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:06.739 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:06.739 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 126, 2023-11-06T13:42:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:06.740 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2023-11-06T13:42:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 102050, 2023-11-06T13:42:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 854, 2023-11-06T13:42:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2023-11-06T13:42:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:06.741 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2023-11-06T13:42:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2023-11-06T13:42:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2023-11-06T13:42:06.742 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2023-11-06T13:42:06.743 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 43257, 2023-11-06T13:42:06.743 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 238300299, 2023-11-06T13:42:06.743 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 33, 2023-11-06T13:42:06.743 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 43257, 2023-11-06T13:42:06.743 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2023-11-06T13:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 43257, 2023-11-06T13:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 44150 2023-11-06T13:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 43257, 2023-11-06T13:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 9517, 2023-11-06T13:42:06.744 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 33740, 2023-11-06T13:42:06.745 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2023-11-06T13:42:06.745 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2023-11-06T13:42:06.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 0, 2023-11-06T13:42:06.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 10, 2023-11-06T13:42:06.745 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 462, 2023-11-06T13:42:06.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 3534, 2023-11-06T13:42:06.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 254, 2023-11-06T13:42:06.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2023-11-06T13:42:06.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2023-11-06T13:42:06.746 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2023-11-06T13:42:06.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 65, 2023-11-06T13:42:06.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 29154, 2023-11-06T13:42:06.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2023-11-06T13:42:06.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:06.747 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:06.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 9055, 2023-11-06T13:42:06.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 20, 2023-11-06T13:42:06.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:06.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:06.748 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:06.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2023-11-06T13:42:06.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2023-11-06T13:42:06.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2023-11-06T13:42:06.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:06.749 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2023-11-06T13:42:06.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:06.750 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2023-11-06T13:42:06.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2023-11-06T13:42:06.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2023-11-06T13:42:06.750 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2023-11-06T13:42:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2023-11-06T13:42:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2023-11-06T13:42:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2023-11-06T13:42:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2023-11-06T13:42:06.752 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2023-11-06T13:42:06.752 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2023-11-06T13:42:06.752 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2023-11-06T13:42:06.752 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2023-11-06T13:42:06.752 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2023-11-06T13:42:06.753 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2023-11-06T13:42:06.753 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2023-11-06T13:42:06.753 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2023-11-06T13:42:06.753 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2023-11-06T13:42:06.753 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 33, 2023-11-06T13:42:06.754 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2023-11-06T13:42:06.754 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 2, 2023-11-06T13:42:06.754 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 12, 2023-11-06T13:42:06.754 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 12, 2023-11-06T13:42:06.754 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2023-11-06T13:42:06.755 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2023-11-06T13:42:06.755 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 1416, 2023-11-06T13:42:06.755 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 0, 2023-11-06T13:42:06.755 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 180 2023-11-06T13:42:06.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.756 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2023-11-06T13:42:06.756 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 1, 2023-11-06T13:42:06.756 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:06.756 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2023-11-06T13:42:06.756 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2023-11-06T13:42:06.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.757 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2023-11-06T13:42:06.757 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:06.757 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 17, 2023-11-06T13:42:06.757 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2023-11-06T13:42:06.758 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 5, 2023-11-06T13:42:06.758 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 14368, 2023-11-06T13:42:06.758 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:06.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.758 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:06.759 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:06.759 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:06.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:06.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 4316801, 2023-11-06T13:42:06.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 351904956, 2023-11-06T13:42:06.759 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.760 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 4316801, 2023-11-06T13:42:06.760 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:06.760 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:06.760 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 4316801, 2023-11-06T13:42:06.760 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 351904956, 2023-11-06T13:42:06.761 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:06.761 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.761 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.761 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.761 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.762 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:06.762 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:06.762 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:06.763 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:06.763 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:06.763 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:06.763 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.763 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.763 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 43257, 2023-11-06T13:42:06.764 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 239866251, 2023-11-06T13:42:06.764 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 43257, 2023-11-06T13:42:06.764 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 239866251, 2023-11-06T13:42:06.764 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:06.764 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.765 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.765 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.765 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.765 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:06.766 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:06.766 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2023-11-06T13:42:06.766 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:06.766 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:06.766 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:06.767 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.767 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:06.767 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 43257, 2023-11-06T13:42:06.767 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 43257, 2023-11-06T13:42:06.767 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 43257, 2023-11-06T13:42:06.768 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 43257, 2023-11-06T13:42:06.768 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:06.768 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.768 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.768 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.769 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.769 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:06.769 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:06.769 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:06.770 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:06.770 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 14368, 2023-11-06T13:42:06.770 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 1565952, 2023-11-06T13:42:06.770 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.770 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 14368, 2023-11-06T13:42:06.771 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:06.771 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:06.771 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 462, 2023-11-06T13:42:06.771 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 1565952, 2023-11-06T13:42:06.771 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:06.771 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.772 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.772 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.772 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.772 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55661c698280": { 2023-11-06T13:42:06.773 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:06.773 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:06.773 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:06.773 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 96554, 2023-11-06T13:42:06.773 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 223880728, 2023-11-06T13:42:06.774 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:06.774 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 96554, 2023-11-06T13:42:06.774 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:06.774 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:06.774 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3072, 2023-11-06T13:42:06.775 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 223880728, 2023-11-06T13:42:06.775 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:06.775 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.775 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.775 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.776 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.776 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.776 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-06T13:42:06.778 INFO:tasks.check_counter:Daemon mds.b mds.exported=348 2023-11-06T13:42:06.778 INFO:tasks.check_counter:Daemon mds.b mds.imported=362 2023-11-06T13:42:06.778 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=65 2023-11-06T13:42:06.778 DEBUG:tasks.check_counter:Getting stats from e 2023-11-06T13:42:06.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok perf dump 2023-11-06T13:42:06.912 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-06T13:42:06.912 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1583, 2023-11-06T13:42:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1584, 2023-11-06T13:42:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 63769654, 2023-11-06T13:42:06.913 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 491834, 2023-11-06T13:42:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 8, 2023-11-06T13:42:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2023-11-06T13:42:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.148918860, 2023-11-06T13:42:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.033395407, 2023-11-06T13:42:06.914 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.061696779, 2023-11-06T13:42:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.041684803, 2023-11-06T13:42:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1583, 2023-11-06T13:42:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.091922605, 2023-11-06T13:42:06.915 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000058068 2023-11-06T13:42:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.916 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1000, 2023-11-06T13:42:06.917 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 961, 2023-11-06T13:42:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 38574647, 2023-11-06T13:42:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 358528, 2023-11-06T13:42:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:06.918 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.101175124, 2023-11-06T13:42:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.023587455, 2023-11-06T13:42:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.052245965, 2023-11-06T13:42:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.022073665, 2023-11-06T13:42:06.919 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 961, 2023-11-06T13:42:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.053015237, 2023-11-06T13:42:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000055166 2023-11-06T13:42:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.920 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 887, 2023-11-06T13:42:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1063, 2023-11-06T13:42:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 58951227, 2023-11-06T13:42:06.922 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 643376, 2023-11-06T13:42:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:06.923 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.094816810, 2023-11-06T13:42:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.023976116, 2023-11-06T13:42:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.043405955, 2023-11-06T13:42:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.020981099, 2023-11-06T13:42:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:06.924 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1061, 2023-11-06T13:42:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.034062749, 2023-11-06T13:42:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000032104 2023-11-06T13:42:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:06.925 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.926 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2023-11-06T13:42:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2023-11-06T13:42:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2023-11-06T13:42:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2023-11-06T13:42:06.927 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5149, 2023-11-06T13:42:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.128452118, 2023-11-06T13:42:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000024947 2023-11-06T13:42:06.928 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:06.929 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.930 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2023-11-06T13:42:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2023-11-06T13:42:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2023-11-06T13:42:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2023-11-06T13:42:06.931 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2023-11-06T13:42:06.932 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2023-11-06T13:42:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch": 0, 2023-11-06T13:42:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2023-11-06T13:42:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2023-11-06T13:42:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2023-11-06T13:42:06.933 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 11, 2023-11-06T13:42:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2023-11-06T13:42:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 0, 2023-11-06T13:42:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 11, 2023-11-06T13:42:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 11, 2023-11-06T13:42:06.934 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 93, 2023-11-06T13:42:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2023-11-06T13:42:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 1, 2023-11-06T13:42:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2023-11-06T13:42:06.935 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2023-11-06T13:42:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2023-11-06T13:42:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2023-11-06T13:42:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:06.936 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2023-11-06T13:42:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2023-11-06T13:42:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2023-11-06T13:42:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2023-11-06T13:42:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2023-11-06T13:42:06.937 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2023-11-06T13:42:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2023-11-06T13:42:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2023-11-06T13:42:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2023-11-06T13:42:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2023-11-06T13:42:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2023-11-06T13:42:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2023-11-06T13:42:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2023-11-06T13:42:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2023-11-06T13:42:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2023-11-06T13:42:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2023-11-06T13:42:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2023-11-06T13:42:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2023-11-06T13:42:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2023-11-06T13:42:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2023-11-06T13:42:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2023-11-06T13:42:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2023-11-06T13:42:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2023-11-06T13:42:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2023-11-06T13:42:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2023-11-06T13:42:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2023-11-06T13:42:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2023-11-06T13:42:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2023-11-06T13:42:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2023-11-06T13:42:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2023-11-06T13:42:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2023-11-06T13:42:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2023-11-06T13:42:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2023-11-06T13:42:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2023-11-06T13:42:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2023-11-06T13:42:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2023-11-06T13:42:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2023-11-06T13:42:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 81155, 2023-11-06T13:42:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2023-11-06T13:42:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2023-11-06T13:42:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2023-11-06T13:42:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2023-11-06T13:42:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2023-11-06T13:42:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 100, 2023-11-06T13:42:06.950 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2023-11-06T13:42:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2023-11-06T13:42:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2023-11-06T13:42:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 163938068, 2023-11-06T13:42:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 163935803, 2023-11-06T13:42:06.951 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2023-11-06T13:42:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.952 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 81155 2023-11-06T13:42:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2023-11-06T13:42:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 14, 2023-11-06T13:42:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 16388, 2023-11-06T13:42:06.953 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 16374, 2023-11-06T13:42:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 11, 2023-11-06T13:42:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 747, 2023-11-06T13:42:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 736, 2023-11-06T13:42:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 13960, 2023-11-06T13:42:06.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 40175, 2023-11-06T13:42:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 26215, 2023-11-06T13:42:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2023-11-06T13:42:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2023-11-06T13:42:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2023-11-06T13:42:06.955 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 77636, 2023-11-06T13:42:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 340216 2023-11-06T13:42:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2023-11-06T13:42:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2023-11-06T13:42:06.956 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2023-11-06T13:42:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2023-11-06T13:42:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2023-11-06T13:42:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2023-11-06T13:42:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2023-11-06T13:42:06.957 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2023-11-06T13:42:06.958 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:06.959 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2023-11-06T13:42:06.960 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2023-11-06T13:42:06.961 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:06.962 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2023-11-06T13:42:06.963 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2023-11-06T13:42:06.964 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.965 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.967 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2023-11-06T13:42:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.968 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2023-11-06T13:42:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.969 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2023-11-06T13:42:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.970 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2023-11-06T13:42:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.971 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2023-11-06T13:42:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.972 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2023-11-06T13:42:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.973 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2023-11-06T13:42:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.974 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.975 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2023-11-06T13:42:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:06.976 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:06.977 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.978 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2023-11-06T13:42:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.979 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:06.980 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2023-11-06T13:42:06.981 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2023-11-06T13:42:06.982 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.983 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2023-11-06T13:42:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2023-11-06T13:42:06.984 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:06.985 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2023-11-06T13:42:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2023-11-06T13:42:06.987 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2023-11-06T13:42:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2023-11-06T13:42:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2023-11-06T13:42:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2023-11-06T13:42:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2023-11-06T13:42:06.988 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2023-11-06T13:42:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 2875 2023-11-06T13:42:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2023-11-06T13:42:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:06.989 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:06.990 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:06.991 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:06.992 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:06.993 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:06.994 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:06.995 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2023-11-06T13:42:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:06.996 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 184691, 2023-11-06T13:42:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 92, 2023-11-06T13:42:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2023-11-06T13:42:06.997 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2023-11-06T13:42:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:06.998 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 126, 2023-11-06T13:42:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:06.999 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2023-11-06T13:42:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 9871848, 2023-11-06T13:42:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 56063, 2023-11-06T13:42:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2023-11-06T13:42:07.000 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2023-11-06T13:42:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2023-11-06T13:42:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2023-11-06T13:42:07.001 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2023-11-06T13:42:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 3188, 2023-11-06T13:42:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2023-11-06T13:42:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2023-11-06T13:42:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 3188, 2023-11-06T13:42:07.002 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2023-11-06T13:42:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3188, 2023-11-06T13:42:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3189 2023-11-06T13:42:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 3188, 2023-11-06T13:42:07.003 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 3188, 2023-11-06T13:42:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2023-11-06T13:42:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2023-11-06T13:42:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2023-11-06T13:42:07.004 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1973, 2023-11-06T13:42:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2023-11-06T13:42:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 1213, 2023-11-06T13:42:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2023-11-06T13:42:07.005 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2023-11-06T13:42:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2023-11-06T13:42:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2023-11-06T13:42:07.006 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2023-11-06T13:42:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2023-11-06T13:42:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2023-11-06T13:42:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2023-11-06T13:42:07.007 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2023-11-06T13:42:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2023-11-06T13:42:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:07.008 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2023-11-06T13:42:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2023-11-06T13:42:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2023-11-06T13:42:07.009 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2023-11-06T13:42:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2023-11-06T13:42:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2023-11-06T13:42:07.010 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2023-11-06T13:42:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2023-11-06T13:42:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2023-11-06T13:42:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2023-11-06T13:42:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2023-11-06T13:42:07.011 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2023-11-06T13:42:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2023-11-06T13:42:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2023-11-06T13:42:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2023-11-06T13:42:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2023-11-06T13:42:07.012 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2023-11-06T13:42:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2023-11-06T13:42:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2023-11-06T13:42:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2023-11-06T13:42:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2023-11-06T13:42:07.013 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 33, 2023-11-06T13:42:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2023-11-06T13:42:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 2, 2023-11-06T13:42:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 11, 2023-11-06T13:42:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 11, 2023-11-06T13:42:07.014 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2023-11-06T13:42:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2023-11-06T13:42:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2023-11-06T13:42:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2023-11-06T13:42:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2023-11-06T13:42:07.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2023-11-06T13:42:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2023-11-06T13:42:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2023-11-06T13:42:07.016 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2023-11-06T13:42:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2023-11-06T13:42:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2023-11-06T13:42:07.017 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2023-11-06T13:42:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2023-11-06T13:42:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2023-11-06T13:42:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.018 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 3466, 2023-11-06T13:42:07.019 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 160968124, 2023-11-06T13:42:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 3466, 2023-11-06T13:42:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.020 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3466, 2023-11-06T13:42:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 160968124, 2023-11-06T13:42:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.021 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.022 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.023 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3188, 2023-11-06T13:42:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 159771943, 2023-11-06T13:42:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3188, 2023-11-06T13:42:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 159771943, 2023-11-06T13:42:07.024 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2023-11-06T13:42:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.026 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3188, 2023-11-06T13:42:07.027 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 3188, 2023-11-06T13:42:07.028 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3188, 2023-11-06T13:42:07.028 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 3188, 2023-11-06T13:42:07.028 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.028 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.028 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.029 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.029 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.029 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.029 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:07.029 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.030 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:07.030 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.030 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.030 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.030 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.031 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.031 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.031 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.031 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2023-11-06T13:42:07.031 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2023-11-06T13:42:07.032 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.032 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.032 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.032 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.032 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.033 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.033 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x5610f254c5a0": { 2023-11-06T13:42:07.033 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.033 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:07.034 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.034 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.034 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.034 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.034 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.035 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.035 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.035 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2023-11-06T13:42:07.035 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2023-11-06T13:42:07.035 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.035 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.036 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.036 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.036 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.036 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.037 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-06T13:42:07.038 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-11-06T13:42:07.039 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-11-06T13:42:07.039 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-11-06T13:42:07.039 DEBUG:tasks.check_counter:Getting stats from h 2023-11-06T13:42:07.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok perf dump 2023-11-06T13:42:07.164 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-06T13:42:07.165 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:07.165 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1398, 2023-11-06T13:42:07.165 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1400, 2023-11-06T13:42:07.165 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 46567831, 2023-11-06T13:42:07.165 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 434919, 2023-11-06T13:42:07.166 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 8, 2023-11-06T13:42:07.166 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2023-11-06T13:42:07.166 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.128505837, 2023-11-06T13:42:07.166 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.029176189, 2023-11-06T13:42:07.166 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.050926640, 2023-11-06T13:42:07.167 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.037070418, 2023-11-06T13:42:07.167 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:07.167 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1399, 2023-11-06T13:42:07.167 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.071327081, 2023-11-06T13:42:07.167 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050984 2023-11-06T13:42:07.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.168 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:07.168 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.168 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.168 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.169 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.169 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.169 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:07.169 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1328, 2023-11-06T13:42:07.169 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1287, 2023-11-06T13:42:07.170 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 50593482, 2023-11-06T13:42:07.170 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 459775, 2023-11-06T13:42:07.170 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:07.170 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:07.171 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.127299391, 2023-11-06T13:42:07.171 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.026623995, 2023-11-06T13:42:07.171 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.065957443, 2023-11-06T13:42:07.171 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.030105043, 2023-11-06T13:42:07.171 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:07.172 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1287, 2023-11-06T13:42:07.172 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.072584272, 2023-11-06T13:42:07.172 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000056398 2023-11-06T13:42:07.172 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.172 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:07.173 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.173 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.173 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.173 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.173 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.173 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:07.174 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 349, 2023-11-06T13:42:07.174 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 525, 2023-11-06T13:42:07.174 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 42193874, 2023-11-06T13:42:07.174 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 476058, 2023-11-06T13:42:07.174 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:07.175 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:07.175 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.052186491, 2023-11-06T13:42:07.175 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.011548496, 2023-11-06T13:42:07.175 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.029312741, 2023-11-06T13:42:07.175 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.007871925, 2023-11-06T13:42:07.176 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:07.176 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 523, 2023-11-06T13:42:07.176 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.026427895, 2023-11-06T13:42:07.176 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050531 2023-11-06T13:42:07.176 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.177 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:07.177 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.177 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.177 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.177 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.178 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2023-11-06T13:42:07.178 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2023-11-06T13:42:07.178 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2023-11-06T13:42:07.178 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.179 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2023-11-06T13:42:07.179 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:07.179 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:07.179 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 4696, 2023-11-06T13:42:07.179 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.114222624, 2023-11-06T13:42:07.180 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000024323 2023-11-06T13:42:07.180 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.180 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.180 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:07.180 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:07.181 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:07.181 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.181 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.181 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.182 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.182 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2023-11-06T13:42:07.182 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2023-11-06T13:42:07.183 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2023-11-06T13:42:07.183 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2023-11-06T13:42:07.183 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.183 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.183 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2023-11-06T13:42:07.184 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2023-11-06T13:42:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch": 0, 2023-11-06T13:42:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2023-11-06T13:42:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2023-11-06T13:42:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2023-11-06T13:42:07.185 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 10, 2023-11-06T13:42:07.186 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2023-11-06T13:42:07.186 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 0, 2023-11-06T13:42:07.186 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 10, 2023-11-06T13:42:07.186 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 10, 2023-11-06T13:42:07.187 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 134, 2023-11-06T13:42:07.187 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:07.187 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2023-11-06T13:42:07.187 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 1, 2023-11-06T13:42:07.187 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2023-11-06T13:42:07.188 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2023-11-06T13:42:07.188 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2023-11-06T13:42:07.188 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2023-11-06T13:42:07.189 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:07.189 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:07.189 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2023-11-06T13:42:07.189 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2023-11-06T13:42:07.189 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2023-11-06T13:42:07.190 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2023-11-06T13:42:07.190 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2023-11-06T13:42:07.190 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2023-11-06T13:42:07.190 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2023-11-06T13:42:07.191 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:07.191 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2023-11-06T13:42:07.191 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:07.191 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 0, 2023-11-06T13:42:07.192 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 0, 2023-11-06T13:42:07.192 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2023-11-06T13:42:07.192 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2023-11-06T13:42:07.192 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:07.193 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:07.193 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:07.193 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2023-11-06T13:42:07.193 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:07.194 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2023-11-06T13:42:07.194 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2023-11-06T13:42:07.194 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2023-11-06T13:42:07.194 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2023-11-06T13:42:07.195 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2023-11-06T13:42:07.195 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:07.195 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:07.195 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:07.196 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2023-11-06T13:42:07.196 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2023-11-06T13:42:07.196 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2023-11-06T13:42:07.196 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2023-11-06T13:42:07.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.197 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2023-11-06T13:42:07.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2023-11-06T13:42:07.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:07.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:07.197 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2023-11-06T13:42:07.198 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2023-11-06T13:42:07.198 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:07.198 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2023-11-06T13:42:07.198 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:07.198 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:07.199 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:07.199 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2023-11-06T13:42:07.199 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2023-11-06T13:42:07.199 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:07.199 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2023-11-06T13:42:07.199 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2023-11-06T13:42:07.200 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2023-11-06T13:42:07.200 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:07.200 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2023-11-06T13:42:07.200 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.200 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2023-11-06T13:42:07.201 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2023-11-06T13:42:07.201 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2023-11-06T13:42:07.201 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2023-11-06T13:42:07.201 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 64186, 2023-11-06T13:42:07.202 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2023-11-06T13:42:07.202 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2023-11-06T13:42:07.202 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2023-11-06T13:42:07.202 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2023-11-06T13:42:07.202 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2023-11-06T13:42:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 83, 2023-11-06T13:42:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2023-11-06T13:42:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2023-11-06T13:42:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2023-11-06T13:42:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 141925248, 2023-11-06T13:42:07.204 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 141924138, 2023-11-06T13:42:07.204 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2023-11-06T13:42:07.204 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.204 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.204 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.205 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 64186 2023-11-06T13:42:07.205 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.205 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2023-11-06T13:42:07.205 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 13, 2023-11-06T13:42:07.205 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 20532, 2023-11-06T13:42:07.206 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 20519, 2023-11-06T13:42:07.206 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 11, 2023-11-06T13:42:07.206 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 876, 2023-11-06T13:42:07.206 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 865, 2023-11-06T13:42:07.206 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 9808, 2023-11-06T13:42:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 41511, 2023-11-06T13:42:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 31703, 2023-11-06T13:42:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2023-11-06T13:42:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2023-11-06T13:42:07.207 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2023-11-06T13:42:07.208 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 75920, 2023-11-06T13:42:07.208 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 340216 2023-11-06T13:42:07.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.208 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2023-11-06T13:42:07.208 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2023-11-06T13:42:07.209 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2023-11-06T13:42:07.209 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2023-11-06T13:42:07.209 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2023-11-06T13:42:07.209 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2023-11-06T13:42:07.209 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2023-11-06T13:42:07.210 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.210 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.210 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.210 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2023-11-06T13:42:07.211 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.211 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.211 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.211 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:07.212 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.212 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.212 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.212 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2023-11-06T13:42:07.212 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.213 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.213 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.213 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2023-11-06T13:42:07.213 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.214 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.214 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.214 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:07.215 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.215 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.215 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.216 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2023-11-06T13:42:07.216 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.216 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.216 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.217 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2023-11-06T13:42:07.217 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.217 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.217 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.218 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:07.218 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.218 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.218 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.219 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.219 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:07.219 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.219 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.219 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.220 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.220 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2023-11-06T13:42:07.220 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.220 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.221 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.221 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.221 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2023-11-06T13:42:07.222 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.222 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.222 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.223 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2023-11-06T13:42:07.223 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.223 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.223 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.223 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.224 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2023-11-06T13:42:07.224 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.224 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.224 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.225 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.225 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2023-11-06T13:42:07.225 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.225 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.226 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.226 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2023-11-06T13:42:07.227 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.227 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.227 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.228 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2023-11-06T13:42:07.228 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.228 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.228 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.229 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:07.229 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.229 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.229 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.230 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2023-11-06T13:42:07.230 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.230 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.230 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.231 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:07.231 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.231 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.231 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.232 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:07.232 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.232 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.233 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.233 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2023-11-06T13:42:07.233 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.234 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.234 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.234 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:07.235 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.235 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.235 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.235 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:07.236 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.236 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.236 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.236 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2023-11-06T13:42:07.237 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.237 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.237 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.237 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.237 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2023-11-06T13:42:07.238 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.238 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.238 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.238 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.238 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2023-11-06T13:42:07.239 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.239 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.239 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.239 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.239 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2023-11-06T13:42:07.240 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.240 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.240 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.240 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:07.241 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:07.241 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:07.241 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.241 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.241 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.242 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.242 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.242 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2023-11-06T13:42:07.242 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2023-11-06T13:42:07.242 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 2, 2023-11-06T13:42:07.243 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 1, 2023-11-06T13:42:07.243 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 1, 2023-11-06T13:42:07.243 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2023-11-06T13:42:07.243 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2023-11-06T13:42:07.243 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2023-11-06T13:42:07.244 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 1859 2023-11-06T13:42:07.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.244 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2023-11-06T13:42:07.244 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:07.244 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:07.245 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:07.245 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:07.245 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:07.245 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:07.245 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:07.246 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:07.246 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:07.246 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:07.246 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:07.246 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:07.247 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:07.247 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:07.247 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:07.247 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:07.247 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:07.248 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:07.248 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:07.248 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:07.248 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:07.248 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:07.249 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:07.249 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:07.249 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:07.249 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:07.249 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:07.250 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:07.250 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:07.250 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:07.250 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:07.251 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2023-11-06T13:42:07.251 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:07.251 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:07.251 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:07.251 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:07.252 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 184679, 2023-11-06T13:42:07.252 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 91, 2023-11-06T13:42:07.252 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:07.252 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2023-11-06T13:42:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2023-11-06T13:42:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:07.253 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:07.254 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:07.254 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:07.254 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:07.254 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 126, 2023-11-06T13:42:07.255 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:07.255 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:07.255 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:07.255 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2023-11-06T13:42:07.256 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 6946584, 2023-11-06T13:42:07.256 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 39360, 2023-11-06T13:42:07.256 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:07.256 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2023-11-06T13:42:07.257 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:07.257 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2023-11-06T13:42:07.257 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.257 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2023-11-06T13:42:07.258 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2023-11-06T13:42:07.258 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2023-11-06T13:42:07.258 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 2793, 2023-11-06T13:42:07.258 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 21, 2023-11-06T13:42:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 3, 2023-11-06T13:42:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 2793, 2023-11-06T13:42:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2023-11-06T13:42:07.259 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 2793, 2023-11-06T13:42:07.260 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 2794 2023-11-06T13:42:07.260 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.260 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 2793, 2023-11-06T13:42:07.260 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 2793, 2023-11-06T13:42:07.261 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2023-11-06T13:42:07.261 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2023-11-06T13:42:07.261 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2023-11-06T13:42:07.261 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1637, 2023-11-06T13:42:07.262 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2023-11-06T13:42:07.262 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 1154, 2023-11-06T13:42:07.262 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2023-11-06T13:42:07.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2023-11-06T13:42:07.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2023-11-06T13:42:07.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2023-11-06T13:42:07.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2023-11-06T13:42:07.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2023-11-06T13:42:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2023-11-06T13:42:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2023-11-06T13:42:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:07.264 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 1, 2023-11-06T13:42:07.265 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2023-11-06T13:42:07.265 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:07.265 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:07.265 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:07.265 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2023-11-06T13:42:07.266 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2023-11-06T13:42:07.266 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2023-11-06T13:42:07.266 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:07.266 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2023-11-06T13:42:07.266 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:07.267 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2023-11-06T13:42:07.267 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2023-11-06T13:42:07.267 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2023-11-06T13:42:07.267 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2023-11-06T13:42:07.267 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2023-11-06T13:42:07.267 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2023-11-06T13:42:07.268 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2023-11-06T13:42:07.268 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2023-11-06T13:42:07.268 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2023-11-06T13:42:07.268 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2023-11-06T13:42:07.269 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2023-11-06T13:42:07.269 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2023-11-06T13:42:07.269 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2023-11-06T13:42:07.269 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2023-11-06T13:42:07.269 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2023-11-06T13:42:07.269 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2023-11-06T13:42:07.270 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2023-11-06T13:42:07.270 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 33, 2023-11-06T13:42:07.270 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2023-11-06T13:42:07.270 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 2, 2023-11-06T13:42:07.271 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 11, 2023-11-06T13:42:07.271 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 11, 2023-11-06T13:42:07.271 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2023-11-06T13:42:07.271 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2023-11-06T13:42:07.271 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2023-11-06T13:42:07.271 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2023-11-06T13:42:07.272 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2023-11-06T13:42:07.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.272 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2023-11-06T13:42:07.272 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2023-11-06T13:42:07.272 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:07.273 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2023-11-06T13:42:07.273 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2023-11-06T13:42:07.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.273 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2023-11-06T13:42:07.273 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:07.274 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2023-11-06T13:42:07.274 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2023-11-06T13:42:07.274 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2023-11-06T13:42:07.274 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2023-11-06T13:42:07.274 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:07.275 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.275 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:07.275 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.275 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:07.275 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.276 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 3071, 2023-11-06T13:42:07.276 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 139063104, 2023-11-06T13:42:07.276 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.276 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 3071, 2023-11-06T13:42:07.276 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.277 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.277 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3071, 2023-11-06T13:42:07.277 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 139063104, 2023-11-06T13:42:07.277 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.277 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.278 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.278 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.278 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.278 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.278 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:07.279 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.279 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:07.279 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.279 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.279 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.280 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.280 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.280 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2793, 2023-11-06T13:42:07.280 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 137934723, 2023-11-06T13:42:07.280 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2793, 2023-11-06T13:42:07.281 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 137934723, 2023-11-06T13:42:07.281 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.281 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.281 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.281 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.282 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:07.282 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.282 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2023-11-06T13:42:07.283 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.283 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.283 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.283 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.283 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.283 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 2793, 2023-11-06T13:42:07.284 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 2793, 2023-11-06T13:42:07.284 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 2793, 2023-11-06T13:42:07.284 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 2793, 2023-11-06T13:42:07.284 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.284 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.285 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.285 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.285 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:07.286 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.286 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:07.286 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.286 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.286 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.287 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.287 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.287 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.287 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.287 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2023-11-06T13:42:07.288 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2023-11-06T13:42:07.288 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.288 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.288 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.288 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.289 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.289 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55dbb9f5c5a0": { 2023-11-06T13:42:07.289 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.289 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:07.290 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.290 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.290 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.290 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.290 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.291 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.291 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.291 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2023-11-06T13:42:07.291 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2023-11-06T13:42:07.291 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.291 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.292 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.292 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.292 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-06T13:42:07.294 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-11-06T13:42:07.294 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-11-06T13:42:07.294 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2023-11-06T13:42:07.295 DEBUG:tasks.check_counter:Getting stats from k 2023-11-06T13:42:07.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.k.asok perf dump 2023-11-06T13:42:07.421 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2023-11-06T13:42:07.421 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 1662, 2023-11-06T13:42:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 1664, 2023-11-06T13:42:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 92782917, 2023-11-06T13:42:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 516892, 2023-11-06T13:42:07.422 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 8, 2023-11-06T13:42:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 4, 2023-11-06T13:42:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.164540703, 2023-11-06T13:42:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.041339131, 2023-11-06T13:42:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.069979693, 2023-11-06T13:42:07.423 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.041364405, 2023-11-06T13:42:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 1662, 2023-11-06T13:42:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.073142735, 2023-11-06T13:42:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000044008 2023-11-06T13:42:07.424 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.425 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:07.425 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.425 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.425 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.425 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.426 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.426 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:07.427 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 889, 2023-11-06T13:42:07.427 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 848, 2023-11-06T13:42:07.427 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 93088723, 2023-11-06T13:42:07.428 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 323099, 2023-11-06T13:42:07.428 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 6, 2023-11-06T13:42:07.428 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:07.428 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.119172974, 2023-11-06T13:42:07.428 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.019355703, 2023-11-06T13:42:07.429 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.075519531, 2023-11-06T13:42:07.429 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.021307324, 2023-11-06T13:42:07.429 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:07.429 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 848, 2023-11-06T13:42:07.429 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.042897305, 2023-11-06T13:42:07.430 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000050586 2023-11-06T13:42:07.430 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.430 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:07.430 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.431 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.431 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.431 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.431 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.431 INFO:teuthology.orchestra.run.smithi044.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:07.432 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_messages": 820, 2023-11-06T13:42:07.432 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages": 996, 2023-11-06T13:42:07.432 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_recv_bytes": 37146656, 2023-11-06T13:42:07.432 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_bytes": 692244, 2023-11-06T13:42:07.432 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_created_connections": 7, 2023-11-06T13:42:07.433 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:07.433 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_total_time": 0.089231115, 2023-11-06T13:42:07.433 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_send_time": 0.020718035, 2023-11-06T13:42:07.433 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_recv_time": 0.040647488, 2023-11-06T13:42:07.433 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_running_fast_dispatch_time": 0.021338783, 2023-11-06T13:42:07.434 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:07.434 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 994, 2023-11-06T13:42:07.434 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.067553003, 2023-11-06T13:42:07.434 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000067960 2023-11-06T13:42:07.434 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.435 INFO:teuthology.orchestra.run.smithi044.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:07.435 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.435 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.436 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.436 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.436 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.437 INFO:teuthology.orchestra.run.smithi044.stdout: "cct": { 2023-11-06T13:42:07.437 INFO:teuthology.orchestra.run.smithi044.stdout: "total_workers": 1, 2023-11-06T13:42:07.437 INFO:teuthology.orchestra.run.smithi044.stdout: "unhealthy_workers": 0 2023-11-06T13:42:07.437 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.437 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-MDSRank": { 2023-11-06T13:42:07.438 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:07.438 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:07.438 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 5049, 2023-11-06T13:42:07.438 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.120648316, 2023-11-06T13:42:07.438 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000023895 2023-11-06T13:42:07.439 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.439 INFO:teuthology.orchestra.run.smithi044.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:07.439 INFO:teuthology.orchestra.run.smithi044.stdout: "queue_len": 0, 2023-11-06T13:42:07.439 INFO:teuthology.orchestra.run.smithi044.stdout: "complete_latency": { 2023-11-06T13:42:07.440 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.440 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.440 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": { 2023-11-06T13:42:07.441 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2023-11-06T13:42:07.441 INFO:teuthology.orchestra.run.smithi044.stdout: "reply": 0, 2023-11-06T13:42:07.441 INFO:teuthology.orchestra.run.smithi044.stdout: "reply_latency": { 2023-11-06T13:42:07.442 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.442 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.442 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.443 INFO:teuthology.orchestra.run.smithi044.stdout: "slow_reply": 0, 2023-11-06T13:42:07.443 INFO:teuthology.orchestra.run.smithi044.stdout: "forward": 0, 2023-11-06T13:42:07.443 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_fetch": 0, 2023-11-06T13:42:07.444 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_commit": 0, 2023-11-06T13:42:07.444 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_split": 0, 2023-11-06T13:42:07.445 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_merge": 0, 2023-11-06T13:42:07.445 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes": 51, 2023-11-06T13:42:07.445 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_top": 0, 2023-11-06T13:42:07.445 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_bottom": 0, 2023-11-06T13:42:07.446 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pin_tail": 51, 2023-11-06T13:42:07.446 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_pinned": 51, 2023-11-06T13:42:07.446 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_expired": 184, 2023-11-06T13:42:07.446 INFO:teuthology.orchestra.run.smithi044.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:07.447 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 0, 2023-11-06T13:42:07.447 INFO:teuthology.orchestra.run.smithi044.stdout: "subtrees": 3, 2023-11-06T13:42:07.447 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse": 0, 2023-11-06T13:42:07.447 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_hit": 0, 2023-11-06T13:42:07.448 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_forward": 0, 2023-11-06T13:42:07.448 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_discover": 0, 2023-11-06T13:42:07.448 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:07.448 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:07.448 INFO:teuthology.orchestra.run.smithi044.stdout: "traverse_lock": 0, 2023-11-06T13:42:07.449 INFO:teuthology.orchestra.run.smithi044.stdout: "load_cent": 0, 2023-11-06T13:42:07.449 INFO:teuthology.orchestra.run.smithi044.stdout: "q": 0, 2023-11-06T13:42:07.449 INFO:teuthology.orchestra.run.smithi044.stdout: "exported": 0, 2023-11-06T13:42:07.450 INFO:teuthology.orchestra.run.smithi044.stdout: "exported_inodes": 0, 2023-11-06T13:42:07.450 INFO:teuthology.orchestra.run.smithi044.stdout: "imported": 0, 2023-11-06T13:42:07.450 INFO:teuthology.orchestra.run.smithi044.stdout: "imported_inodes": 0, 2023-11-06T13:42:07.451 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:07.451 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_backtrace_fetch": 0, 2023-11-06T13:42:07.451 INFO:teuthology.orchestra.run.smithi044.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:07.452 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rfiles": 365, 2023-11-06T13:42:07.452 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rbytes": 7058488, 2023-11-06T13:42:07.452 INFO:teuthology.orchestra.run.smithi044.stdout: "root_rsnaps": 0, 2023-11-06T13:42:07.453 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_fetch": 0, 2023-11-06T13:42:07.453 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:07.453 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:07.454 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:07.454 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_inodes": 0, 2023-11-06T13:42:07.454 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:07.455 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_dirfrag_rstats": 0, 2023-11-06T13:42:07.455 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_file_inodes": 0, 2023-11-06T13:42:07.456 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_inode_file_caps": 0, 2023-11-06T13:42:07.456 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_revoke": 0, 2023-11-06T13:42:07.456 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_grant": 0, 2023-11-06T13:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:07.458 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps": 0, 2023-11-06T13:42:07.458 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_caps_dirty": 0, 2023-11-06T13:42:07.458 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_cap_release": 0, 2023-11-06T13:42:07.459 INFO:teuthology.orchestra.run.smithi044.stdout: "process_request_cap_release": 0 2023-11-06T13:42:07.459 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.459 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_cache": { 2023-11-06T13:42:07.460 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays": 0, 2023-11-06T13:42:07.460 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:07.460 INFO:teuthology.orchestra.run.smithi044.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:07.461 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_created": 0, 2023-11-06T13:42:07.461 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_enqueued": 0, 2023-11-06T13:42:07.461 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:07.461 INFO:teuthology.orchestra.run.smithi044.stdout: "strays_migrated": 0, 2023-11-06T13:42:07.462 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:07.462 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:07.462 INFO:teuthology.orchestra.run.smithi044.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:07.462 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_started": 0, 2023-11-06T13:42:07.463 INFO:teuthology.orchestra.run.smithi044.stdout: "recovery_completed": 0, 2023-11-06T13:42:07.463 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:07.463 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_exportdir": 0, 2023-11-06T13:42:07.463 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_flush": 0, 2023-11-06T13:42:07.464 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragmentdir": 0, 2023-11-06T13:42:07.468 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:07.468 INFO:teuthology.orchestra.run.smithi044.stdout: "ireq_inodestats": 0 2023-11-06T13:42:07.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.469 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_log": { 2023-11-06T13:42:07.470 INFO:teuthology.orchestra.run.smithi044.stdout: "evadd": 0, 2023-11-06T13:42:07.470 INFO:teuthology.orchestra.run.smithi044.stdout: "evex": 0, 2023-11-06T13:42:07.470 INFO:teuthology.orchestra.run.smithi044.stdout: "evtrm": 0, 2023-11-06T13:42:07.471 INFO:teuthology.orchestra.run.smithi044.stdout: "ev": 101677, 2023-11-06T13:42:07.471 INFO:teuthology.orchestra.run.smithi044.stdout: "evexg": 0, 2023-11-06T13:42:07.472 INFO:teuthology.orchestra.run.smithi044.stdout: "evexd": 0, 2023-11-06T13:42:07.472 INFO:teuthology.orchestra.run.smithi044.stdout: "segadd": 0, 2023-11-06T13:42:07.472 INFO:teuthology.orchestra.run.smithi044.stdout: "segex": 0, 2023-11-06T13:42:07.472 INFO:teuthology.orchestra.run.smithi044.stdout: "segtrm": 0, 2023-11-06T13:42:07.473 INFO:teuthology.orchestra.run.smithi044.stdout: "seg": 120, 2023-11-06T13:42:07.473 INFO:teuthology.orchestra.run.smithi044.stdout: "segexg": 0, 2023-11-06T13:42:07.474 INFO:teuthology.orchestra.run.smithi044.stdout: "segexd": 0, 2023-11-06T13:42:07.474 INFO:teuthology.orchestra.run.smithi044.stdout: "expos": 4194304, 2023-11-06T13:42:07.474 INFO:teuthology.orchestra.run.smithi044.stdout: "wrpos": 225671266, 2023-11-06T13:42:07.475 INFO:teuthology.orchestra.run.smithi044.stdout: "rdpos": 225670999, 2023-11-06T13:42:07.475 INFO:teuthology.orchestra.run.smithi044.stdout: "jlat": { 2023-11-06T13:42:07.476 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.476 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.476 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.476 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.477 INFO:teuthology.orchestra.run.smithi044.stdout: "replayed": 101677 2023-11-06T13:42:07.477 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.477 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_mem": { 2023-11-06T13:42:07.478 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 25, 2023-11-06T13:42:07.478 INFO:teuthology.orchestra.run.smithi044.stdout: "ino+": 25761, 2023-11-06T13:42:07.478 INFO:teuthology.orchestra.run.smithi044.stdout: "ino-": 25736, 2023-11-06T13:42:07.479 INFO:teuthology.orchestra.run.smithi044.stdout: "dir": 20, 2023-11-06T13:42:07.479 INFO:teuthology.orchestra.run.smithi044.stdout: "dir+": 1137, 2023-11-06T13:42:07.479 INFO:teuthology.orchestra.run.smithi044.stdout: "dir-": 1117, 2023-11-06T13:42:07.479 INFO:teuthology.orchestra.run.smithi044.stdout: "dn": 10399, 2023-11-06T13:42:07.479 INFO:teuthology.orchestra.run.smithi044.stdout: "dn+": 53509, 2023-11-06T13:42:07.480 INFO:teuthology.orchestra.run.smithi044.stdout: "dn-": 43110, 2023-11-06T13:42:07.480 INFO:teuthology.orchestra.run.smithi044.stdout: "cap": 0, 2023-11-06T13:42:07.480 INFO:teuthology.orchestra.run.smithi044.stdout: "cap+": 0, 2023-11-06T13:42:07.480 INFO:teuthology.orchestra.run.smithi044.stdout: "cap-": 0, 2023-11-06T13:42:07.480 INFO:teuthology.orchestra.run.smithi044.stdout: "rss": 79296, 2023-11-06T13:42:07.481 INFO:teuthology.orchestra.run.smithi044.stdout: "heap": 340216 2023-11-06T13:42:07.481 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.481 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_server": { 2023-11-06T13:42:07.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_client_request": 0, 2023-11-06T13:42:07.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dispatch_server_request": 0, 2023-11-06T13:42:07.482 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_request": 0, 2023-11-06T13:42:07.482 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_client_session": 0, 2023-11-06T13:42:07.482 INFO:teuthology.orchestra.run.smithi044.stdout: "handle_peer_request": 0, 2023-11-06T13:42:07.482 INFO:teuthology.orchestra.run.smithi044.stdout: "req_create_latency": { 2023-11-06T13:42:07.482 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.483 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.483 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.483 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.483 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getattr_latency": { 2023-11-06T13:42:07.483 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.484 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.484 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.484 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:07.484 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.484 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: "req_link_latency": { 2023-11-06T13:42:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.485 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.486 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.486 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookup_latency": { 2023-11-06T13:42:07.486 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.486 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.487 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.487 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:07.487 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.488 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.488 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.489 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupino_latency": { 2023-11-06T13:42:07.489 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.489 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.489 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.490 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupname_latency": { 2023-11-06T13:42:07.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.490 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.490 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.491 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:07.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.491 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.491 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.492 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:07.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.492 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.492 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.493 INFO:teuthology.orchestra.run.smithi044.stdout: "req_lssnap_latency": { 2023-11-06T13:42:07.493 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.493 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.493 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.494 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mkdir_latency": { 2023-11-06T13:42:07.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.494 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.494 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.495 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mknod_latency": { 2023-11-06T13:42:07.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.495 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.495 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.496 INFO:teuthology.orchestra.run.smithi044.stdout: "req_mksnap_latency": { 2023-11-06T13:42:07.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.496 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.496 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.497 INFO:teuthology.orchestra.run.smithi044.stdout: "req_open_latency": { 2023-11-06T13:42:07.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.497 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.497 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.498 INFO:teuthology.orchestra.run.smithi044.stdout: "req_readdir_latency": { 2023-11-06T13:42:07.498 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.498 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.499 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rename_latency": { 2023-11-06T13:42:07.499 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.500 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.500 INFO:teuthology.orchestra.run.smithi044.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:07.500 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.501 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.501 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.501 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmdir_latency": { 2023-11-06T13:42:07.501 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.502 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.502 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.502 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:07.502 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.503 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.503 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.503 INFO:teuthology.orchestra.run.smithi044.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:07.503 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.504 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.504 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.504 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setattr_latency": { 2023-11-06T13:42:07.505 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.505 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.505 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.505 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.506 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:07.506 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.506 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.507 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.507 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.507 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:07.508 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.508 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.509 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.509 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.509 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setlayout_latency": { 2023-11-06T13:42:07.510 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.510 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.510 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.511 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.512 INFO:teuthology.orchestra.run.smithi044.stdout: "req_setxattr_latency": { 2023-11-06T13:42:07.512 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.512 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.513 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.513 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.514 INFO:teuthology.orchestra.run.smithi044.stdout: "req_symlink_latency": { 2023-11-06T13:42:07.514 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.514 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.515 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.515 INFO:teuthology.orchestra.run.smithi044.stdout: "req_unlink_latency": { 2023-11-06T13:42:07.516 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.516 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.516 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.516 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:07.517 INFO:teuthology.orchestra.run.smithi044.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:07.517 INFO:teuthology.orchestra.run.smithi044.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:07.517 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.517 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.518 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.518 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.519 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_sessions": { 2023-11-06T13:42:07.519 INFO:teuthology.orchestra.run.smithi044.stdout: "session_count": 1, 2023-11-06T13:42:07.519 INFO:teuthology.orchestra.run.smithi044.stdout: "session_add": 3, 2023-11-06T13:42:07.519 INFO:teuthology.orchestra.run.smithi044.stdout: "session_remove": 2, 2023-11-06T13:42:07.520 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_open": 2, 2023-11-06T13:42:07.520 INFO:teuthology.orchestra.run.smithi044.stdout: "sessions_stale": 0, 2023-11-06T13:42:07.520 INFO:teuthology.orchestra.run.smithi044.stdout: "total_load": 0, 2023-11-06T13:42:07.521 INFO:teuthology.orchestra.run.smithi044.stdout: "average_load": 0, 2023-11-06T13:42:07.521 INFO:teuthology.orchestra.run.smithi044.stdout: "avg_session_uptime": 2874 2023-11-06T13:42:07.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.522 INFO:teuthology.orchestra.run.smithi044.stdout: "mempool": { 2023-11-06T13:42:07.522 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:07.526 INFO:teuthology.orchestra.run.smithi044.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:07.526 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:07.526 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:07.527 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:07.527 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:07.527 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:07.527 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:07.527 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:07.528 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:07.528 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:07.528 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:07.528 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:07.529 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:07.529 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:07.529 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:07.529 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:07.530 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:07.530 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:07.530 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:07.530 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:07.531 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:07.531 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:07.531 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:07.531 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:07.532 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:07.532 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:07.532 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:07.532 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:07.533 INFO:teuthology.orchestra.run.smithi044.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:07.533 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:07.533 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_items": 0, 2023-11-06T13:42:07.533 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:07.533 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:07.534 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:07.534 INFO:teuthology.orchestra.run.smithi044.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:07.534 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_bytes": 184994, 2023-11-06T13:42:07.534 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_anon_items": 92, 2023-11-06T13:42:07.534 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:07.535 INFO:teuthology.orchestra.run.smithi044.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:07.535 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_bytes": 0, 2023-11-06T13:42:07.535 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_items": 0, 2023-11-06T13:42:07.535 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:07.535 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:07.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:07.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:07.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:07.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_items": 126, 2023-11-06T13:42:07.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:07.537 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:07.537 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:07.537 INFO:teuthology.orchestra.run.smithi044.stdout: "pgmap_items": 0, 2023-11-06T13:42:07.537 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_bytes": 7399386, 2023-11-06T13:42:07.537 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_co_items": 41966, 2023-11-06T13:42:07.538 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:07.538 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_1_items": 0, 2023-11-06T13:42:07.538 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:07.538 INFO:teuthology.orchestra.run.smithi044.stdout: "unittest_2_items": 0 2023-11-06T13:42:07.538 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.539 INFO:teuthology.orchestra.run.smithi044.stdout: "objecter": { 2023-11-06T13:42:07.539 INFO:teuthology.orchestra.run.smithi044.stdout: "op_active": 0, 2023-11-06T13:42:07.539 INFO:teuthology.orchestra.run.smithi044.stdout: "op_laggy": 0, 2023-11-06T13:42:07.539 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send": 3086, 2023-11-06T13:42:07.539 INFO:teuthology.orchestra.run.smithi044.stdout: "op_send_bytes": 26, 2023-11-06T13:42:07.539 INFO:teuthology.orchestra.run.smithi044.stdout: "op_resend": 4, 2023-11-06T13:42:07.540 INFO:teuthology.orchestra.run.smithi044.stdout: "op_reply": 3086, 2023-11-06T13:42:07.540 INFO:teuthology.orchestra.run.smithi044.stdout: "oplen_avg": { 2023-11-06T13:42:07.540 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 3086, 2023-11-06T13:42:07.540 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 3087 2023-11-06T13:42:07.541 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.541 INFO:teuthology.orchestra.run.smithi044.stdout: "op": 3086, 2023-11-06T13:42:07.541 INFO:teuthology.orchestra.run.smithi044.stdout: "op_r": 3086, 2023-11-06T13:42:07.541 INFO:teuthology.orchestra.run.smithi044.stdout: "op_w": 0, 2023-11-06T13:42:07.541 INFO:teuthology.orchestra.run.smithi044.stdout: "op_rmw": 0, 2023-11-06T13:42:07.542 INFO:teuthology.orchestra.run.smithi044.stdout: "op_pg": 0, 2023-11-06T13:42:07.542 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_stat": 1850, 2023-11-06T13:42:07.542 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_create": 0, 2023-11-06T13:42:07.542 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_read": 1233, 2023-11-06T13:42:07.542 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_write": 0, 2023-11-06T13:42:07.543 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writefull": 0, 2023-11-06T13:42:07.543 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_writesame": 0, 2023-11-06T13:42:07.543 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_append": 0, 2023-11-06T13:42:07.543 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_zero": 0, 2023-11-06T13:42:07.543 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_truncate": 0, 2023-11-06T13:42:07.544 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_delete": 0, 2023-11-06T13:42:07.544 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_mapext": 0, 2023-11-06T13:42:07.544 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:07.544 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:07.544 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_getxattr": 2, 2023-11-06T13:42:07.545 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_setxattr": 0, 2023-11-06T13:42:07.545 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:07.545 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:07.545 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:07.545 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_call": 0, 2023-11-06T13:42:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_watch": 0, 2023-11-06T13:42:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_notify": 0, 2023-11-06T13:42:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls": 0, 2023-11-06T13:42:07.546 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "osdop_other": 0, 2023-11-06T13:42:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_active": 0, 2023-11-06T13:42:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_send": 0, 2023-11-06T13:42:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_resend": 0, 2023-11-06T13:42:07.547 INFO:teuthology.orchestra.run.smithi044.stdout: "linger_ping": 0, 2023-11-06T13:42:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_active": 0, 2023-11-06T13:42:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_send": 0, 2023-11-06T13:42:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "poolop_resend": 0, 2023-11-06T13:42:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_active": 0, 2023-11-06T13:42:07.548 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_send": 0, 2023-11-06T13:42:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "poolstat_resend": 0, 2023-11-06T13:42:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_active": 0, 2023-11-06T13:42:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_send": 0, 2023-11-06T13:42:07.549 INFO:teuthology.orchestra.run.smithi044.stdout: "statfs_resend": 0, 2023-11-06T13:42:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "command_active": 0, 2023-11-06T13:42:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "command_send": 0, 2023-11-06T13:42:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "command_resend": 0, 2023-11-06T13:42:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "map_epoch": 33, 2023-11-06T13:42:07.550 INFO:teuthology.orchestra.run.smithi044.stdout: "map_full": 0, 2023-11-06T13:42:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "map_inc": 2, 2023-11-06T13:42:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_sessions": 11, 2023-11-06T13:42:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_open": 11, 2023-11-06T13:42:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_session_close": 0, 2023-11-06T13:42:07.551 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_laggy": 0, 2023-11-06T13:42:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_wr": 0, 2023-11-06T13:42:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_rd": 2, 2023-11-06T13:42:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_del": 0 2023-11-06T13:42:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.552 INFO:teuthology.orchestra.run.smithi044.stdout: "oft": { 2023-11-06T13:42:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_objs": 0, 2023-11-06T13:42:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_updates": 0, 2023-11-06T13:42:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: "omap_total_removes": 0 2023-11-06T13:42:07.553 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "purge_queue": { 2023-11-06T13:42:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_ops_high_water": 0, 2023-11-06T13:42:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing": 0, 2023-11-06T13:42:07.554 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executing_high_water": 0, 2023-11-06T13:42:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_executed": 0, 2023-11-06T13:42:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:07.555 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 3366, 2023-11-06T13:42:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 222699467, 2023-11-06T13:42:07.556 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 3366, 2023-11-06T13:42:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3366, 2023-11-06T13:42:07.557 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 222699467, 2023-11-06T13:42:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.558 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 104857600, 2023-11-06T13:42:07.559 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.560 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3086, 2023-11-06T13:42:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 221522111, 2023-11-06T13:42:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3086, 2023-11-06T13:42:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 221522111, 2023-11-06T13:42:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.561 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.562 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 1024, 2023-11-06T13:42:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.563 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 3086, 2023-11-06T13:42:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 3086, 2023-11-06T13:42:07.564 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 3086, 2023-11-06T13:42:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 3086, 2023-11-06T13:42:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.565 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:07.566 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.567 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2023-11-06T13:42:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2023-11-06T13:42:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.568 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2023-11-06T13:42:07.569 INFO:teuthology.orchestra.run.smithi044.stdout: "throttle-write_buf_throttle-0x55aa2125c5a0": { 2023-11-06T13:42:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "val": 0, 2023-11-06T13:42:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "max": 3758096384, 2023-11-06T13:42:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "get_started": 0, 2023-11-06T13:42:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "get": 0, 2023-11-06T13:42:07.570 INFO:teuthology.orchestra.run.smithi044.stdout: "get_sum": 0, 2023-11-06T13:42:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "take": 0, 2023-11-06T13:42:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "take_sum": 0, 2023-11-06T13:42:07.571 INFO:teuthology.orchestra.run.smithi044.stdout: "put": 0, 2023-11-06T13:42:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "put_sum": 0, 2023-11-06T13:42:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "wait": { 2023-11-06T13:42:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "avgcount": 0, 2023-11-06T13:42:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "sum": 0.000000000, 2023-11-06T13:42:07.572 INFO:teuthology.orchestra.run.smithi044.stdout: "avgtime": 0.000000000 2023-11-06T13:42:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.573 INFO:teuthology.orchestra.run.smithi044.stdout: } 2023-11-06T13:42:07.573 INFO:teuthology.orchestra.run.smithi044.stdout:} 2023-11-06T13:42:07.575 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-11-06T13:42:07.575 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-11-06T13:42:07.575 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2023-11-06T13:42:07.576 DEBUG:tasks.check_counter:Getting stats from c 2023-11-06T13:42:07.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2023-11-06T13:42:08.258 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-11-06T13:42:08.259 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:08.259 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 224535, 2023-11-06T13:42:08.259 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 280513, 2023-11-06T13:42:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 63239736, 2023-11-06T13:42:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 151246093, 2023-11-06T13:42:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 13, 2023-11-06T13:42:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 8, 2023-11-06T13:42:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 12.132483902, 2023-11-06T13:42:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 5.551780349, 2023-11-06T13:42:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 84.521953798, 2023-11-06T13:42:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.329761720, 2023-11-06T13:42:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 280510, 2023-11-06T13:42:08.262 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 33.077608418, 2023-11-06T13:42:08.262 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000117919 2023-11-06T13:42:08.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.262 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.263 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 419411, 2023-11-06T13:42:08.263 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.078777996, 2023-11-06T13:42:08.263 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000187 2023-11-06T13:42:08.263 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.263 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.264 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:08.264 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 2526292, 2023-11-06T13:42:08.264 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 2523507, 2023-11-06T13:42:08.264 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 413027129, 2023-11-06T13:42:08.264 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 449708974, 2023-11-06T13:42:08.265 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 10, 2023-11-06T13:42:08.265 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:08.265 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 113.468077773, 2023-11-06T13:42:08.265 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 50.142866856, 2023-11-06T13:42:08.265 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 81.330697997, 2023-11-06T13:42:08.266 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.373652263, 2023-11-06T13:42:08.266 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.266 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2523510, 2023-11-06T13:42:08.266 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 64.698274464, 2023-11-06T13:42:08.267 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000025638 2023-11-06T13:42:08.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.267 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.267 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 4934447, 2023-11-06T13:42:08.267 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.765986118, 2023-11-06T13:42:08.268 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000155 2023-11-06T13:42:08.268 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.268 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.268 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:08.268 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 3098345, 2023-11-06T13:42:08.269 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 3102682, 2023-11-06T13:42:08.269 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 511999187, 2023-11-06T13:42:08.269 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 558308030, 2023-11-06T13:42:08.269 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 9, 2023-11-06T13:42:08.269 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 7, 2023-11-06T13:42:08.270 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 101.332789403, 2023-11-06T13:42:08.270 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 40.328142582, 2023-11-06T13:42:08.270 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 77.399544926, 2023-11-06T13:42:08.270 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.425637411, 2023-11-06T13:42:08.270 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.271 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3102679, 2023-11-06T13:42:08.271 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 92.307234444, 2023-11-06T13:42:08.271 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000029750 2023-11-06T13:42:08.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.271 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.272 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5552520, 2023-11-06T13:42:08.272 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.401338942, 2023-11-06T13:42:08.272 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000252 2023-11-06T13:42:08.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-11-06T13:42:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2023-11-06T13:42:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-11-06T13:42:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2023-11-06T13:42:08.273 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:08.274 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:08.274 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5355, 2023-11-06T13:42:08.274 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 43.598925956, 2023-11-06T13:42:08.274 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.008141722 2023-11-06T13:42:08.274 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.275 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:08.275 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:08.275 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:08.275 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 18256, 2023-11-06T13:42:08.276 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 5.209795876, 2023-11-06T13:42:08.276 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000285374 2023-11-06T13:42:08.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.276 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.276 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2023-11-06T13:42:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 74614, 2023-11-06T13:42:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 74074, 2023-11-06T13:42:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2023-11-06T13:42:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 74074, 2023-11-06T13:42:08.277 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1940.571593506, 2023-11-06T13:42:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.026197742 2023-11-06T13:42:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2023-11-06T13:42:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 528, 2023-11-06T13:42:08.278 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch": 0, 2023-11-06T13:42:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 400, 2023-11-06T13:42:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 43, 2023-11-06T13:42:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 2, 2023-11-06T13:42:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 23, 2023-11-06T13:42:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 7, 2023-11-06T13:42:08.279 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 6, 2023-11-06T13:42:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 10, 2023-11-06T13:42:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 10, 2023-11-06T13:42:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 24608, 2023-11-06T13:42:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:08.280 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 0, 2023-11-06T13:42:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 5, 2023-11-06T13:42:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 133349, 2023-11-06T13:42:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 107395, 2023-11-06T13:42:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 359, 2023-11-06T13:42:08.281 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 495, 2023-11-06T13:42:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 561, 2023-11-06T13:42:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 10, 2023-11-06T13:42:08.282 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2023-11-06T13:42:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 119, 2023-11-06T13:42:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 15377, 2023-11-06T13:42:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 132, 2023-11-06T13:42:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 18325, 2023-11-06T13:42:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:08.283 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 1660, 2023-11-06T13:42:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 3939, 2023-11-06T13:42:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 92437865, 2023-11-06T13:42:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2023-11-06T13:42:08.284 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 1660, 2023-11-06T13:42:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 9, 2023-11-06T13:42:08.285 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 9, 2023-11-06T13:42:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 1651, 2023-11-06T13:42:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 297, 2023-11-06T13:42:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 9056, 2023-11-06T13:42:08.286 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 21330, 2023-11-06T13:42:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 26518, 2023-11-06T13:42:08.287 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 8799, 2023-11-06T13:42:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 296, 2023-11-06T13:42:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 23142 2023-11-06T13:42:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2023-11-06T13:42:08.288 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 0, 2023-11-06T13:42:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 9798, 2023-11-06T13:42:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 9798, 2023-11-06T13:42:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:08.289 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2023-11-06T13:42:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2023-11-06T13:42:08.290 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2023-11-06T13:42:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 120, 2023-11-06T13:42:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2023-11-06T13:42:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 45, 2023-11-06T13:42:08.291 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2023-11-06T13:42:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2023-11-06T13:42:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 64186, 2023-11-06T13:42:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2023-11-06T13:42:08.292 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2023-11-06T13:42:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 64186, 2023-11-06T13:42:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2023-11-06T13:42:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2023-11-06T13:42:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 83, 2023-11-06T13:42:08.293 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2023-11-06T13:42:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2023-11-06T13:42:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 83, 2023-11-06T13:42:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2023-11-06T13:42:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2023-11-06T13:42:08.294 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2023-11-06T13:42:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 141925248, 2023-11-06T13:42:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 0, 2023-11-06T13:42:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2023-11-06T13:42:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1927, 2023-11-06T13:42:08.295 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 47.495579608, 2023-11-06T13:42:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.024647420 2023-11-06T13:42:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 0 2023-11-06T13:42:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.296 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2023-11-06T13:42:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 30, 2023-11-06T13:42:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 20726, 2023-11-06T13:42:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 20696, 2023-11-06T13:42:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 28, 2023-11-06T13:42:08.297 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 944, 2023-11-06T13:42:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 916, 2023-11-06T13:42:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 23, 2023-11-06T13:42:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 45243, 2023-11-06T13:42:08.298 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 45220, 2023-11-06T13:42:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 0, 2023-11-06T13:42:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 22685, 2023-11-06T13:42:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 22685, 2023-11-06T13:42:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 109268, 2023-11-06T13:42:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 332024 2023-11-06T13:42:08.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2023-11-06T13:42:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 85521, 2023-11-06T13:42:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 3229, 2023-11-06T13:42:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 74614, 2023-11-06T13:42:08.300 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 239, 2023-11-06T13:42:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 5148, 2023-11-06T13:42:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2023-11-06T13:42:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 8417, 2023-11-06T13:42:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 39.182629053, 2023-11-06T13:42:08.301 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.004655177 2023-11-06T13:42:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2023-11-06T13:42:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 281, 2023-11-06T13:42:08.302 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 7.623486022, 2023-11-06T13:42:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.027129843 2023-11-06T13:42:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.303 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2023-11-06T13:42:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.304 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2023-11-06T13:42:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 45310, 2023-11-06T13:42:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1381.085107845, 2023-11-06T13:42:08.305 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.030480801 2023-11-06T13:42:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.306 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2023-11-06T13:42:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.307 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2023-11-06T13:42:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.308 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.309 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.310 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2023-11-06T13:42:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.311 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2023-11-06T13:42:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 53, 2023-11-06T13:42:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.282294909, 2023-11-06T13:42:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.005326319 2023-11-06T13:42:08.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2023-11-06T13:42:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2023-11-06T13:42:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.314 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2023-11-06T13:42:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3314, 2023-11-06T13:42:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 26.770959765, 2023-11-06T13:42:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.008078141 2023-11-06T13:42:08.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2023-11-06T13:42:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 322, 2023-11-06T13:42:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.490815532, 2023-11-06T13:42:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001524271 2023-11-06T13:42:08.316 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2023-11-06T13:42:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 8410, 2023-11-06T13:42:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 454.224811043, 2023-11-06T13:42:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.054010084 2023-11-06T13:42:08.317 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2023-11-06T13:42:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 57, 2023-11-06T13:42:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 16.323604773, 2023-11-06T13:42:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.286379031 2023-11-06T13:42:08.319 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.320 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.321 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2023-11-06T13:42:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.322 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.323 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2023-11-06T13:42:08.324 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2023-11-06T13:42:08.325 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2023-11-06T13:42:08.326 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2023-11-06T13:42:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 7910, 2023-11-06T13:42:08.327 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 14.587884564, 2023-11-06T13:42:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001844233 2023-11-06T13:42:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:08.328 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.329 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2023-11-06T13:42:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 1, 2023-11-06T13:42:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 2, 2023-11-06T13:42:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 1, 2023-11-06T13:42:08.330 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 1, 2023-11-06T13:42:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2023-11-06T13:42:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 2117, 2023-11-06T13:42:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 2117, 2023-11-06T13:42:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 1811 2023-11-06T13:42:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.331 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-11-06T13:42:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:08.332 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:08.333 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:08.334 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:08.335 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:08.336 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:08.337 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-11-06T13:42:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:08.338 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 244666, 2023-11-06T13:42:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 136, 2023-11-06T13:42:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-11-06T13:42:08.339 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-11-06T13:42:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:08.340 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 126, 2023-11-06T13:42:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:08.341 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-11-06T13:42:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 126197, 2023-11-06T13:42:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 615, 2023-11-06T13:42:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-11-06T13:42:08.342 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-11-06T13:42:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2023-11-06T13:42:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2023-11-06T13:42:08.343 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2023-11-06T13:42:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 24867, 2023-11-06T13:42:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 146881858, 2023-11-06T13:42:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 28, 2023-11-06T13:42:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 24867, 2023-11-06T13:42:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2023-11-06T13:42:08.344 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 24867, 2023-11-06T13:42:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 25528 2023-11-06T13:42:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 24867, 2023-11-06T13:42:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 1978, 2023-11-06T13:42:08.345 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 22889, 2023-11-06T13:42:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2023-11-06T13:42:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2023-11-06T13:42:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 0, 2023-11-06T13:42:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 10, 2023-11-06T13:42:08.346 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 318, 2023-11-06T13:42:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 2246, 2023-11-06T13:42:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 190, 2023-11-06T13:42:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2023-11-06T13:42:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2023-11-06T13:42:08.347 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2023-11-06T13:42:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 43, 2023-11-06T13:42:08.348 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 19879, 2023-11-06T13:42:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2023-11-06T13:42:08.349 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 1660, 2023-11-06T13:42:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 20, 2023-11-06T13:42:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:08.350 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2023-11-06T13:42:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2023-11-06T13:42:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2023-11-06T13:42:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:08.351 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2023-11-06T13:42:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2023-11-06T13:42:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2023-11-06T13:42:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2023-11-06T13:42:08.352 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2023-11-06T13:42:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2023-11-06T13:42:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2023-11-06T13:42:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2023-11-06T13:42:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2023-11-06T13:42:08.353 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2023-11-06T13:42:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2023-11-06T13:42:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2023-11-06T13:42:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2023-11-06T13:42:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2023-11-06T13:42:08.354 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2023-11-06T13:42:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2023-11-06T13:42:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2023-11-06T13:42:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2023-11-06T13:42:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 33, 2023-11-06T13:42:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2023-11-06T13:42:08.355 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 2, 2023-11-06T13:42:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 12, 2023-11-06T13:42:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 12, 2023-11-06T13:42:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2023-11-06T13:42:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2023-11-06T13:42:08.356 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 1015, 2023-11-06T13:42:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 0, 2023-11-06T13:42:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 147 2023-11-06T13:42:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2023-11-06T13:42:08.357 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 1, 2023-11-06T13:42:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2023-11-06T13:42:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2023-11-06T13:42:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.358 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2023-11-06T13:42:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 17, 2023-11-06T13:42:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2023-11-06T13:42:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 5, 2023-11-06T13:42:08.359 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 9798, 2023-11-06T13:42:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.360 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 5849168, 2023-11-06T13:42:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 456044804, 2023-11-06T13:42:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.361 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 5849168, 2023-11-06T13:42:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 5849168, 2023-11-06T13:42:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 456044804, 2023-11-06T13:42:08.362 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:08.364 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 24867, 2023-11-06T13:42:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 147949664, 2023-11-06T13:42:08.365 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 24867, 2023-11-06T13:42:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 147949664, 2023-11-06T13:42:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.366 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2023-11-06T13:42:08.367 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:08.368 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 24867, 2023-11-06T13:42:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 24867, 2023-11-06T13:42:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 24867, 2023-11-06T13:42:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 24867, 2023-11-06T13:42:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.369 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:08.370 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 9798, 2023-11-06T13:42:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 1067806, 2023-11-06T13:42:08.371 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 9798, 2023-11-06T13:42:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 319, 2023-11-06T13:42:08.372 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 1067806, 2023-11-06T13:42:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.373 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x563303dac280": { 2023-11-06T13:42:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:08.374 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 64186, 2023-11-06T13:42:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 137730944, 2023-11-06T13:42:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 64186, 2023-11-06T13:42:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.375 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 1927, 2023-11-06T13:42:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 137730944, 2023-11-06T13:42:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.376 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.377 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.377 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-11-06T13:42:08.379 INFO:tasks.check_counter:Daemon mds.c mds.exported=119 2023-11-06T13:42:08.379 INFO:tasks.check_counter:Daemon mds.c mds.imported=132 2023-11-06T13:42:08.379 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=43 2023-11-06T13:42:08.379 DEBUG:tasks.check_counter:Getting stats from f 2023-11-06T13:42:08.380 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok perf dump 2023-11-06T13:42:08.501 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-11-06T13:42:08.502 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:08.502 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 707220, 2023-11-06T13:42:08.502 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 762708, 2023-11-06T13:42:08.503 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 143261727, 2023-11-06T13:42:08.503 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 218868154, 2023-11-06T13:42:08.503 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 13, 2023-11-06T13:42:08.503 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 7, 2023-11-06T13:42:08.503 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 32.676080168, 2023-11-06T13:42:08.504 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 12.968884291, 2023-11-06T13:42:08.504 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 214.927352890, 2023-11-06T13:42:08.504 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.553127318, 2023-11-06T13:42:08.504 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.504 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 762706, 2023-11-06T13:42:08.505 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 44.692093421, 2023-11-06T13:42:08.505 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000058596 2023-11-06T13:42:08.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.505 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.505 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1372432, 2023-11-06T13:42:08.506 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.248337465, 2023-11-06T13:42:08.506 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000180 2023-11-06T13:42:08.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.506 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.506 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:08.507 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 1403619, 2023-11-06T13:42:08.507 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 1405004, 2023-11-06T13:42:08.507 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 233752106, 2023-11-06T13:42:08.507 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 290465247, 2023-11-06T13:42:08.507 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 9, 2023-11-06T13:42:08.508 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 7, 2023-11-06T13:42:08.508 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 69.578488114, 2023-11-06T13:42:08.508 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 29.308379309, 2023-11-06T13:42:08.508 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 50.900440989, 2023-11-06T13:42:08.508 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.504518127, 2023-11-06T13:42:08.509 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.509 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1405003, 2023-11-06T13:42:08.509 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 35.756663252, 2023-11-06T13:42:08.509 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000025449 2023-11-06T13:42:08.509 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.509 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.510 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2777661, 2023-11-06T13:42:08.510 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.469875874, 2023-11-06T13:42:08.510 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000169 2023-11-06T13:42:08.510 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.511 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:08.511 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 1506979, 2023-11-06T13:42:08.511 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 1509949, 2023-11-06T13:42:08.511 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 250990948, 2023-11-06T13:42:08.512 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 297710047, 2023-11-06T13:42:08.512 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 10, 2023-11-06T13:42:08.512 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:08.512 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 70.355291145, 2023-11-06T13:42:08.512 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 30.971129366, 2023-11-06T13:42:08.513 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 49.835928002, 2023-11-06T13:42:08.513 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.338186821, 2023-11-06T13:42:08.513 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.513 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1509950, 2023-11-06T13:42:08.514 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 34.133259378, 2023-11-06T13:42:08.514 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000022605 2023-11-06T13:42:08.514 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.514 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.514 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2853281, 2023-11-06T13:42:08.514 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.472522549, 2023-11-06T13:42:08.515 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000165 2023-11-06T13:42:08.515 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.515 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-11-06T13:42:08.515 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2023-11-06T13:42:08.516 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-11-06T13:42:08.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.516 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2023-11-06T13:42:08.516 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:08.516 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:08.517 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 6361, 2023-11-06T13:42:08.517 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 51.071888957, 2023-11-06T13:42:08.517 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.008028908 2023-11-06T13:42:08.517 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.518 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:08.518 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:08.518 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:08.518 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 25471, 2023-11-06T13:42:08.518 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 5.658058837, 2023-11-06T13:42:08.519 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000222137 2023-11-06T13:42:08.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.519 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2023-11-06T13:42:08.519 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 63198, 2023-11-06T13:42:08.520 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 62350, 2023-11-06T13:42:08.520 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2023-11-06T13:42:08.520 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 62350, 2023-11-06T13:42:08.520 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1652.846534117, 2023-11-06T13:42:08.520 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.026509166 2023-11-06T13:42:08.520 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.521 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2023-11-06T13:42:08.521 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 848, 2023-11-06T13:42:08.521 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch": 6, 2023-11-06T13:42:08.521 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 407, 2023-11-06T13:42:08.521 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 44, 2023-11-06T13:42:08.522 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 0, 2023-11-06T13:42:08.522 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 18, 2023-11-06T13:42:08.522 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 3, 2023-11-06T13:42:08.522 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 4, 2023-11-06T13:42:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 11, 2023-11-06T13:42:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 11, 2023-11-06T13:42:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 12514, 2023-11-06T13:42:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 2, 2023-11-06T13:42:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 2, 2023-11-06T13:42:08.523 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 4, 2023-11-06T13:42:08.524 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 106730, 2023-11-06T13:42:08.524 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 91706, 2023-11-06T13:42:08.524 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 780, 2023-11-06T13:42:08.524 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 616, 2023-11-06T13:42:08.524 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:08.525 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:08.525 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 855, 2023-11-06T13:42:08.525 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 6944, 2023-11-06T13:42:08.525 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 4, 2023-11-06T13:42:08.525 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 223, 2023-11-06T13:42:08.526 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 3102, 2023-11-06T13:42:08.526 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 169, 2023-11-06T13:42:08.526 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 10698, 2023-11-06T13:42:08.526 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:08.527 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 1439, 2023-11-06T13:42:08.527 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:08.527 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 3939, 2023-11-06T13:42:08.527 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 92437865, 2023-11-06T13:42:08.527 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2023-11-06T13:42:08.528 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 1439, 2023-11-06T13:42:08.528 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:08.528 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:08.528 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:08.529 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 1, 2023-11-06T13:42:08.529 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:08.529 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 1, 2023-11-06T13:42:08.529 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 1438, 2023-11-06T13:42:08.529 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 160, 2023-11-06T13:42:08.530 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 9741, 2023-11-06T13:42:08.530 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 26715, 2023-11-06T13:42:08.530 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2023-11-06T13:42:08.530 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:08.531 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:08.531 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 27507, 2023-11-06T13:42:08.531 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 9341, 2023-11-06T13:42:08.531 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 307, 2023-11-06T13:42:08.532 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 30500 2023-11-06T13:42:08.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.532 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2023-11-06T13:42:08.532 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 1, 2023-11-06T13:42:08.532 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:08.533 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:08.533 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 13950, 2023-11-06T13:42:08.533 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 13949, 2023-11-06T13:42:08.533 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:08.533 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2023-11-06T13:42:08.534 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:08.534 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:08.534 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:08.534 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2023-11-06T13:42:08.534 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2023-11-06T13:42:08.535 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:08.535 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 223, 2023-11-06T13:42:08.535 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2023-11-06T13:42:08.535 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 44, 2023-11-06T13:42:08.535 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:08.536 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2023-11-06T13:42:08.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.536 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2023-11-06T13:42:08.536 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 81156, 2023-11-06T13:42:08.536 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2023-11-06T13:42:08.537 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2023-11-06T13:42:08.537 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 81156, 2023-11-06T13:42:08.537 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2023-11-06T13:42:08.537 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2023-11-06T13:42:08.537 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 100, 2023-11-06T13:42:08.538 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2023-11-06T13:42:08.538 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2023-11-06T13:42:08.538 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 100, 2023-11-06T13:42:08.538 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2023-11-06T13:42:08.538 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2023-11-06T13:42:08.539 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2023-11-06T13:42:08.539 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 163939178, 2023-11-06T13:42:08.539 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 0, 2023-11-06T13:42:08.539 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2023-11-06T13:42:08.539 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2579, 2023-11-06T13:42:08.540 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 60.563191731, 2023-11-06T13:42:08.540 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.023483207 2023-11-06T13:42:08.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.540 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 0 2023-11-06T13:42:08.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.540 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2023-11-06T13:42:08.541 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 25, 2023-11-06T13:42:08.541 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 16566, 2023-11-06T13:42:08.541 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 16541, 2023-11-06T13:42:08.541 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 21, 2023-11-06T13:42:08.541 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 820, 2023-11-06T13:42:08.542 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 799, 2023-11-06T13:42:08.542 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 18, 2023-11-06T13:42:08.542 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 43797, 2023-11-06T13:42:08.542 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 43779, 2023-11-06T13:42:08.542 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 2, 2023-11-06T13:42:08.543 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 19452, 2023-11-06T13:42:08.543 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 19450, 2023-11-06T13:42:08.543 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 107252, 2023-11-06T13:42:08.543 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 332024 2023-11-06T13:42:08.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.544 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2023-11-06T13:42:08.544 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 76010, 2023-11-06T13:42:08.544 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 3956, 2023-11-06T13:42:08.544 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 63198, 2023-11-06T13:42:08.544 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 328, 2023-11-06T13:42:08.545 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 6039, 2023-11-06T13:42:08.545 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2023-11-06T13:42:08.545 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 9051, 2023-11-06T13:42:08.545 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 23.106254519, 2023-11-06T13:42:08.545 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002552895 2023-11-06T13:42:08.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.546 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2023-11-06T13:42:08.546 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 188, 2023-11-06T13:42:08.546 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 38.118251332, 2023-11-06T13:42:08.546 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.202756656 2023-11-06T13:42:08.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.547 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:08.547 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.548 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.548 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.549 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2023-11-06T13:42:08.549 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.549 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.549 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.550 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2023-11-06T13:42:08.550 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 28143, 2023-11-06T13:42:08.550 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1086.776776991, 2023-11-06T13:42:08.550 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.038616237 2023-11-06T13:42:08.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.551 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:08.551 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.551 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.551 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.553 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2023-11-06T13:42:08.553 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.553 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.554 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.554 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2023-11-06T13:42:08.554 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.554 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.555 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.555 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:08.555 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.556 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.556 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.556 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:08.556 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.557 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.557 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.557 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2023-11-06T13:42:08.557 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.558 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.558 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.558 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.558 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2023-11-06T13:42:08.558 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 58, 2023-11-06T13:42:08.559 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.273691555, 2023-11-06T13:42:08.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.021960199 2023-11-06T13:42:08.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.559 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2023-11-06T13:42:08.559 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.559 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.560 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2023-11-06T13:42:08.560 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.560 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.561 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.561 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2023-11-06T13:42:08.561 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2913, 2023-11-06T13:42:08.561 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 10.263627761, 2023-11-06T13:42:08.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.003523387 2023-11-06T13:42:08.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.562 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2023-11-06T13:42:08.562 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 495, 2023-11-06T13:42:08.562 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.797865819, 2023-11-06T13:42:08.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001611850 2023-11-06T13:42:08.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.563 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2023-11-06T13:42:08.563 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 9051, 2023-11-06T13:42:08.563 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 464.405788423, 2023-11-06T13:42:08.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.051309887 2023-11-06T13:42:08.564 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.564 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:08.564 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.564 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.565 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.565 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.565 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2023-11-06T13:42:08.565 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 69, 2023-11-06T13:42:08.565 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 8.314693670, 2023-11-06T13:42:08.566 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.120502806 2023-11-06T13:42:08.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.566 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:08.566 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.566 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.566 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.567 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:08.567 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.567 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.567 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.568 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.568 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2023-11-06T13:42:08.568 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.568 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.568 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.569 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:08.569 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.569 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.569 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.570 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:08.570 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.570 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.570 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.571 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2023-11-06T13:42:08.571 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.571 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.571 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.571 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.572 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2023-11-06T13:42:08.572 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.572 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.573 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.573 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.573 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2023-11-06T13:42:08.573 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.573 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2023-11-06T13:42:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 12382, 2023-11-06T13:42:08.574 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 19.789584047, 2023-11-06T13:42:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001598254 2023-11-06T13:42:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:08.575 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.576 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.576 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.576 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.576 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.576 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2023-11-06T13:42:08.577 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 1, 2023-11-06T13:42:08.577 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 2, 2023-11-06T13:42:08.577 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 1, 2023-11-06T13:42:08.577 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 1, 2023-11-06T13:42:08.577 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2023-11-06T13:42:08.578 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 4672, 2023-11-06T13:42:08.578 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 4672, 2023-11-06T13:42:08.578 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 830 2023-11-06T13:42:08.578 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.578 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-11-06T13:42:08.579 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2023-11-06T13:42:08.579 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2023-11-06T13:42:08.579 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:08.579 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:08.579 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:08.580 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:08.580 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:08.580 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:08.580 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:08.580 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:08.580 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:08.581 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:08.581 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:08.581 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:08.581 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:08.581 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:08.582 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:08.582 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:08.582 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:08.582 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:08.582 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:08.583 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:08.583 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:08.583 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:08.583 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:08.583 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:08.584 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-11-06T13:42:08.585 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:08.585 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:08.585 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:08.585 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:08.585 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 241191, 2023-11-06T13:42:08.586 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 140, 2023-11-06T13:42:08.586 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2023-11-06T13:42:08.586 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2023-11-06T13:42:08.586 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-11-06T13:42:08.586 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-11-06T13:42:08.587 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:08.587 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:08.587 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:08.587 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:08.587 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:08.588 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 126, 2023-11-06T13:42:08.588 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:08.588 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:08.588 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:08.588 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-11-06T13:42:08.588 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 108966, 2023-11-06T13:42:08.589 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 721, 2023-11-06T13:42:08.589 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:08.589 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-11-06T13:42:08.589 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:08.589 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-11-06T13:42:08.590 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.590 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2023-11-06T13:42:08.590 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2023-11-06T13:42:08.590 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2023-11-06T13:42:08.590 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 33879, 2023-11-06T13:42:08.591 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 169560718, 2023-11-06T13:42:08.591 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 28, 2023-11-06T13:42:08.591 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 33879, 2023-11-06T13:42:08.591 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2023-11-06T13:42:08.591 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 33879, 2023-11-06T13:42:08.592 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 34550 2023-11-06T13:42:08.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.592 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 33879, 2023-11-06T13:42:08.592 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 1858, 2023-11-06T13:42:08.592 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 32021, 2023-11-06T13:42:08.593 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2023-11-06T13:42:08.593 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2023-11-06T13:42:08.593 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 0, 2023-11-06T13:42:08.593 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 10, 2023-11-06T13:42:08.593 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 413, 2023-11-06T13:42:08.593 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 2992, 2023-11-06T13:42:08.594 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 233, 2023-11-06T13:42:08.594 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2023-11-06T13:42:08.594 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2023-11-06T13:42:08.594 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2023-11-06T13:42:08.594 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 44, 2023-11-06T13:42:08.595 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 28215, 2023-11-06T13:42:08.595 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2023-11-06T13:42:08.595 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:08.595 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:08.595 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 1439, 2023-11-06T13:42:08.596 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 20, 2023-11-06T13:42:08.596 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:08.596 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:08.596 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:08.596 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2023-11-06T13:42:08.597 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2023-11-06T13:42:08.597 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2023-11-06T13:42:08.597 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:08.597 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2023-11-06T13:42:08.597 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:08.597 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2023-11-06T13:42:08.598 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2023-11-06T13:42:08.598 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2023-11-06T13:42:08.598 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2023-11-06T13:42:08.598 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2023-11-06T13:42:08.598 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2023-11-06T13:42:08.599 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2023-11-06T13:42:08.599 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2023-11-06T13:42:08.599 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2023-11-06T13:42:08.599 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2023-11-06T13:42:08.599 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2023-11-06T13:42:08.600 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2023-11-06T13:42:08.600 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2023-11-06T13:42:08.600 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2023-11-06T13:42:08.600 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2023-11-06T13:42:08.601 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2023-11-06T13:42:08.601 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2023-11-06T13:42:08.601 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 33, 2023-11-06T13:42:08.601 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2023-11-06T13:42:08.601 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 2, 2023-11-06T13:42:08.602 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 12, 2023-11-06T13:42:08.602 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 12, 2023-11-06T13:42:08.602 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2023-11-06T13:42:08.602 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2023-11-06T13:42:08.602 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 1025, 2023-11-06T13:42:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 12, 2023-11-06T13:42:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 147 2023-11-06T13:42:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2023-11-06T13:42:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 1, 2023-11-06T13:42:08.603 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:08.604 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2023-11-06T13:42:08.604 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2023-11-06T13:42:08.604 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.604 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2023-11-06T13:42:08.604 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:08.605 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 17, 2023-11-06T13:42:08.605 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2023-11-06T13:42:08.605 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 5, 2023-11-06T13:42:08.605 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 13949, 2023-11-06T13:42:08.605 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:08.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.606 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:08.606 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.606 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:08.606 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.607 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 3617813, 2023-11-06T13:42:08.607 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 296921926, 2023-11-06T13:42:08.607 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.607 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 3617813, 2023-11-06T13:42:08.607 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.608 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.608 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 3617813, 2023-11-06T13:42:08.608 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 296921926, 2023-11-06T13:42:08.608 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.608 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.608 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.609 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.609 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.609 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:08.609 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.610 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:08.610 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.610 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:08.610 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:08.610 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.611 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:08.611 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 33879, 2023-11-06T13:42:08.611 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 171080847, 2023-11-06T13:42:08.611 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 33879, 2023-11-06T13:42:08.611 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 171080847, 2023-11-06T13:42:08.612 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.612 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.612 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.612 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.613 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:08.613 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.613 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2023-11-06T13:42:08.613 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.614 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:08.614 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:08.614 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.614 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:08.614 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 33879, 2023-11-06T13:42:08.615 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 33879, 2023-11-06T13:42:08.615 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 33879, 2023-11-06T13:42:08.615 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 33879, 2023-11-06T13:42:08.615 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.615 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.616 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.616 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.616 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.616 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:08.617 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.617 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:08.617 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.617 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 13949, 2023-11-06T13:42:08.617 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 1520225, 2023-11-06T13:42:08.618 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.618 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 13949, 2023-11-06T13:42:08.618 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.618 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.618 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 413, 2023-11-06T13:42:08.618 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 1520225, 2023-11-06T13:42:08.619 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.619 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.619 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.619 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.619 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.620 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x564b43202280": { 2023-11-06T13:42:08.620 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.620 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:08.620 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.621 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 81156, 2023-11-06T13:42:08.621 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 159744874, 2023-11-06T13:42:08.621 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.621 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 81156, 2023-11-06T13:42:08.621 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.622 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.622 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2579, 2023-11-06T13:42:08.622 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 159744874, 2023-11-06T13:42:08.622 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.622 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.623 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.623 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.623 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.623 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.623 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-11-06T13:42:08.625 INFO:tasks.check_counter:Daemon mds.f mds.exported=223 2023-11-06T13:42:08.625 INFO:tasks.check_counter:Daemon mds.f mds.imported=169 2023-11-06T13:42:08.625 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=44 2023-11-06T13:42:08.626 DEBUG:tasks.check_counter:Getting stats from i 2023-11-06T13:42:08.626 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok perf dump 2023-11-06T13:42:08.749 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-11-06T13:42:08.750 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:08.750 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 1278081, 2023-11-06T13:42:08.750 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 1280719, 2023-11-06T13:42:08.750 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 219249546, 2023-11-06T13:42:08.751 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 412248162, 2023-11-06T13:42:08.751 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 13, 2023-11-06T13:42:08.751 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 6, 2023-11-06T13:42:08.751 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 62.041084882, 2023-11-06T13:42:08.752 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 26.750069872, 2023-11-06T13:42:08.752 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 42.668145596, 2023-11-06T13:42:08.752 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 1.815659593, 2023-11-06T13:42:08.752 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.752 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1280718, 2023-11-06T13:42:08.753 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 63.540629414, 2023-11-06T13:42:08.753 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000049613 2023-11-06T13:42:08.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.753 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.753 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2376076, 2023-11-06T13:42:08.754 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.456722135, 2023-11-06T13:42:08.754 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000192 2023-11-06T13:42:08.754 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.754 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:08.755 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 1590914, 2023-11-06T13:42:08.757 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 1590298, 2023-11-06T13:42:08.758 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 272281905, 2023-11-06T13:42:08.758 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 439325534, 2023-11-06T13:42:08.758 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 10, 2023-11-06T13:42:08.758 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 7, 2023-11-06T13:42:08.758 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 74.208465362, 2023-11-06T13:42:08.759 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 32.199694672, 2023-11-06T13:42:08.759 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 51.839619009, 2023-11-06T13:42:08.759 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 1.356913211, 2023-11-06T13:42:08.759 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.759 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1590297, 2023-11-06T13:42:08.760 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 59.128895517, 2023-11-06T13:42:08.760 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000037181 2023-11-06T13:42:08.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.760 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.760 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3075095, 2023-11-06T13:42:08.761 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.583787828, 2023-11-06T13:42:08.761 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000189 2023-11-06T13:42:08.761 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.761 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.761 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:08.762 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 497969, 2023-11-06T13:42:08.762 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 704363, 2023-11-06T13:42:08.762 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 144288085, 2023-11-06T13:42:08.762 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 356074788, 2023-11-06T13:42:08.762 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 10, 2023-11-06T13:42:08.763 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:08.763 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 25.308896810, 2023-11-06T13:42:08.763 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 11.207831810, 2023-11-06T13:42:08.763 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 364.192050532, 2023-11-06T13:42:08.763 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 1.209808493, 2023-11-06T13:42:08.764 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:08.764 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 704362, 2023-11-06T13:42:08.764 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 62.583713628, 2023-11-06T13:42:08.764 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000088851 2023-11-06T13:42:08.764 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.765 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:08.765 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 974242, 2023-11-06T13:42:08.765 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.226906263, 2023-11-06T13:42:08.765 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000232 2023-11-06T13:42:08.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.766 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-11-06T13:42:08.766 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2023-11-06T13:42:08.766 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-11-06T13:42:08.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.767 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2023-11-06T13:42:08.767 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:08.767 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:08.767 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 28134, 2023-11-06T13:42:08.767 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 145.957873809, 2023-11-06T13:42:08.768 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.005187953 2023-11-06T13:42:08.768 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.768 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:08.768 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:08.769 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:08.769 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 58403, 2023-11-06T13:42:08.769 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 15.977061488, 2023-11-06T13:42:08.769 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000273565 2023-11-06T13:42:08.769 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.770 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2023-11-06T13:42:08.770 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 157734, 2023-11-06T13:42:08.770 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 146739, 2023-11-06T13:42:08.770 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2023-11-06T13:42:08.770 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 146739, 2023-11-06T13:42:08.771 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 3074.377384763, 2023-11-06T13:42:08.771 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.020951331 2023-11-06T13:42:08.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.771 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2023-11-06T13:42:08.771 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 10980, 2023-11-06T13:42:08.772 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch": 19, 2023-11-06T13:42:08.772 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 1365, 2023-11-06T13:42:08.772 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 126, 2023-11-06T13:42:08.772 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 5, 2023-11-06T13:42:08.772 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 13, 2023-11-06T13:42:08.773 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 0, 2023-11-06T13:42:08.773 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 2, 2023-11-06T13:42:08.773 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 11, 2023-11-06T13:42:08.773 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 12, 2023-11-06T13:42:08.773 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 65958, 2023-11-06T13:42:08.774 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 0, 2023-11-06T13:42:08.774 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 0, 2023-11-06T13:42:08.774 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 2, 2023-11-06T13:42:08.774 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 242399, 2023-11-06T13:42:08.774 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 205980, 2023-11-06T13:42:08.775 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 10724, 2023-11-06T13:42:08.775 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 1067, 2023-11-06T13:42:08.775 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 1, 2023-11-06T13:42:08.775 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:08.775 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 196, 2023-11-06T13:42:08.776 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 2860, 2023-11-06T13:42:08.776 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2023-11-06T13:42:08.776 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 276, 2023-11-06T13:42:08.776 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 38917, 2023-11-06T13:42:08.776 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 411, 2023-11-06T13:42:08.777 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 41691, 2023-11-06T13:42:08.777 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:08.777 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 34935, 2023-11-06T13:42:08.777 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:08.777 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 4, 2023-11-06T13:42:08.777 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 246, 2023-11-06T13:42:08.778 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2023-11-06T13:42:08.778 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 34935, 2023-11-06T13:42:08.778 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:08.778 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:08.778 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:08.779 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 323, 2023-11-06T13:42:08.779 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2023-11-06T13:42:08.779 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 323, 2023-11-06T13:42:08.779 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 34612, 2023-11-06T13:42:08.779 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 371, 2023-11-06T13:42:08.780 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 30871, 2023-11-06T13:42:08.780 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 69505, 2023-11-06T13:42:08.780 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 1, 2023-11-06T13:42:08.780 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:08.780 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:08.781 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 57819, 2023-11-06T13:42:08.781 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 29132, 2023-11-06T13:42:08.781 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 823, 2023-11-06T13:42:08.781 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 67059 2023-11-06T13:42:08.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.782 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2023-11-06T13:42:08.782 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 1, 2023-11-06T13:42:08.782 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:08.782 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:08.782 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 32199, 2023-11-06T13:42:08.783 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 32198, 2023-11-06T13:42:08.783 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:08.783 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2023-11-06T13:42:08.783 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:08.783 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:08.784 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:08.784 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2023-11-06T13:42:08.784 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2023-11-06T13:42:08.784 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2023-11-06T13:42:08.784 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 279, 2023-11-06T13:42:08.784 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2023-11-06T13:42:08.785 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 131, 2023-11-06T13:42:08.785 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:08.785 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2023-11-06T13:42:08.785 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.785 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2023-11-06T13:42:08.786 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 193845, 2023-11-06T13:42:08.786 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 93597, 2023-11-06T13:42:08.786 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 93597, 2023-11-06T13:42:08.786 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 100248, 2023-11-06T13:42:08.786 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2023-11-06T13:42:08.787 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 642, 2023-11-06T13:42:08.787 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 237, 2023-11-06T13:42:08.787 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 109, 2023-11-06T13:42:08.787 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 109, 2023-11-06T13:42:08.787 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 129, 2023-11-06T13:42:08.788 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2023-11-06T13:42:08.788 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 1, 2023-11-06T13:42:08.788 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 226497747, 2023-11-06T13:42:08.788 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 433805049, 2023-11-06T13:42:08.788 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 0, 2023-11-06T13:42:08.789 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2023-11-06T13:42:08.789 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3145, 2023-11-06T13:42:08.789 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 334.212360008, 2023-11-06T13:42:08.789 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.106267841 2023-11-06T13:42:08.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.790 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 0 2023-11-06T13:42:08.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.790 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2023-11-06T13:42:08.790 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 19, 2023-11-06T13:42:08.790 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 59698, 2023-11-06T13:42:08.791 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 59679, 2023-11-06T13:42:08.791 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 21, 2023-11-06T13:42:08.791 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 2899, 2023-11-06T13:42:08.791 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 2878, 2023-11-06T13:42:08.791 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 60, 2023-11-06T13:42:08.792 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 134870, 2023-11-06T13:42:08.792 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 134810, 2023-11-06T13:42:08.792 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 0, 2023-11-06T13:42:08.792 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 62845, 2023-11-06T13:42:08.792 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 62845, 2023-11-06T13:42:08.793 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 131852, 2023-11-06T13:42:08.793 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 332024 2023-11-06T13:42:08.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.793 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2023-11-06T13:42:08.793 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 190494, 2023-11-06T13:42:08.794 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 3767, 2023-11-06T13:42:08.794 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 157734, 2023-11-06T13:42:08.794 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 357, 2023-11-06T13:42:08.794 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 6152, 2023-11-06T13:42:08.794 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2023-11-06T13:42:08.795 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 29517, 2023-11-06T13:42:08.795 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 213.148436754, 2023-11-06T13:42:08.795 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.007221209 2023-11-06T13:42:08.795 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.795 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2023-11-06T13:42:08.796 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2385, 2023-11-06T13:42:08.796 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 428.605470186, 2023-11-06T13:42:08.796 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.179708792 2023-11-06T13:42:08.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.796 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:08.797 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.797 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.797 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.797 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.797 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2023-11-06T13:42:08.798 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.798 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.798 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.798 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.798 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2023-11-06T13:42:08.799 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 47648, 2023-11-06T13:42:08.799 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1643.435298607, 2023-11-06T13:42:08.799 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.034491170 2023-11-06T13:42:08.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.800 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:08.800 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.800 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.800 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.801 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2023-11-06T13:42:08.801 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.801 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.801 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.801 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.802 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2023-11-06T13:42:08.802 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.802 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.802 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.803 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:08.803 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.803 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.803 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.803 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:08.804 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.804 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.804 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.805 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2023-11-06T13:42:08.805 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.805 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.805 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.805 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.805 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2023-11-06T13:42:08.806 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 207, 2023-11-06T13:42:08.806 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 4.100126193, 2023-11-06T13:42:08.806 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.019807372 2023-11-06T13:42:08.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.806 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2023-11-06T13:42:08.807 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.807 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.807 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.807 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2023-11-06T13:42:08.808 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.808 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.808 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.809 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2023-11-06T13:42:08.809 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 7744, 2023-11-06T13:42:08.809 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 53.595424299, 2023-11-06T13:42:08.809 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.006920896 2023-11-06T13:42:08.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.810 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2023-11-06T13:42:08.810 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1326, 2023-11-06T13:42:08.810 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 2.143621883, 2023-11-06T13:42:08.810 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001616607 2023-11-06T13:42:08.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.811 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2023-11-06T13:42:08.811 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 29518, 2023-11-06T13:42:08.811 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 645.179752859, 2023-11-06T13:42:08.811 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.021857163 2023-11-06T13:42:08.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.811 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:08.812 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.812 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.812 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.812 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2023-11-06T13:42:08.813 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 274, 2023-11-06T13:42:08.813 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 35.812909111, 2023-11-06T13:42:08.813 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.130704047 2023-11-06T13:42:08.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.813 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:08.814 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.814 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.814 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.814 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.815 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2023-11-06T13:42:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1, 2023-11-06T13:42:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.068502854, 2023-11-06T13:42:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.068502854 2023-11-06T13:42:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.816 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.817 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.818 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2023-11-06T13:42:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.819 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2023-11-06T13:42:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2023-11-06T13:42:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2023-11-06T13:42:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 28119, 2023-11-06T13:42:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 48.287842017, 2023-11-06T13:42:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001717267 2023-11-06T13:42:08.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.823 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2023-11-06T13:42:08.824 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 1, 2023-11-06T13:42:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 2, 2023-11-06T13:42:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 1, 2023-11-06T13:42:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 1, 2023-11-06T13:42:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2023-11-06T13:42:08.825 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 17637, 2023-11-06T13:42:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 17637, 2023-11-06T13:42:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 1811 2023-11-06T13:42:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-11-06T13:42:08.826 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 600, 2023-11-06T13:42:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 600, 2023-11-06T13:42:08.827 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:08.828 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:08.829 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:08.830 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:08.831 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:08.832 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:08.833 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-11-06T13:42:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:08.834 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 247877, 2023-11-06T13:42:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 140, 2023-11-06T13:42:08.835 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 264, 2023-11-06T13:42:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 3, 2023-11-06T13:42:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-11-06T13:42:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-11-06T13:42:08.836 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:08.837 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 126, 2023-11-06T13:42:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-11-06T13:42:08.838 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 128611, 2023-11-06T13:42:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 1098, 2023-11-06T13:42:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-11-06T13:42:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:08.839 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-11-06T13:42:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2023-11-06T13:42:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2023-11-06T13:42:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2023-11-06T13:42:08.840 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 117139, 2023-11-06T13:42:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 462020690, 2023-11-06T13:42:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 28, 2023-11-06T13:42:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 117139, 2023-11-06T13:42:08.841 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2023-11-06T13:42:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 117139, 2023-11-06T13:42:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 133976 2023-11-06T13:42:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 117139, 2023-11-06T13:42:08.842 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 35672, 2023-11-06T13:42:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 81467, 2023-11-06T13:42:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2023-11-06T13:42:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2023-11-06T13:42:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 205, 2023-11-06T13:42:08.843 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 9793, 2023-11-06T13:42:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 718, 2023-11-06T13:42:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 3864, 2023-11-06T13:42:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 399, 2023-11-06T13:42:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2023-11-06T13:42:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2023-11-06T13:42:08.844 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2023-11-06T13:42:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 126, 2023-11-06T13:42:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 65780, 2023-11-06T13:42:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2023-11-06T13:42:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:08.845 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 34939, 2023-11-06T13:42:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 14728, 2023-11-06T13:42:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:08.846 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2023-11-06T13:42:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2023-11-06T13:42:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2023-11-06T13:42:08.847 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2023-11-06T13:42:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 1, 2023-11-06T13:42:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2023-11-06T13:42:08.848 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2023-11-06T13:42:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2023-11-06T13:42:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2023-11-06T13:42:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2023-11-06T13:42:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2023-11-06T13:42:08.849 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2023-11-06T13:42:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2023-11-06T13:42:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2023-11-06T13:42:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2023-11-06T13:42:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2023-11-06T13:42:08.850 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2023-11-06T13:42:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2023-11-06T13:42:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2023-11-06T13:42:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2023-11-06T13:42:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2023-11-06T13:42:08.851 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 33, 2023-11-06T13:42:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2023-11-06T13:42:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 2, 2023-11-06T13:42:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 12, 2023-11-06T13:42:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 12, 2023-11-06T13:42:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2023-11-06T13:42:08.852 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2023-11-06T13:42:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 2965, 2023-11-06T13:42:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 38, 2023-11-06T13:42:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 420 2023-11-06T13:42:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.853 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2023-11-06T13:42:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 1, 2023-11-06T13:42:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2023-11-06T13:42:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2023-11-06T13:42:08.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2023-11-06T13:42:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 17, 2023-11-06T13:42:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2023-11-06T13:42:08.855 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 5, 2023-11-06T13:42:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 32198, 2023-11-06T13:42:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:08.856 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 3366959, 2023-11-06T13:42:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 322208140, 2023-11-06T13:42:08.857 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 3366959, 2023-11-06T13:42:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 3366959, 2023-11-06T13:42:08.858 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 322208140, 2023-11-06T13:42:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.859 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:08.860 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:08.861 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 117139, 2023-11-06T13:42:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 465529272, 2023-11-06T13:42:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 117139, 2023-11-06T13:42:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 465529272, 2023-11-06T13:42:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.862 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.863 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2023-11-06T13:42:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:08.864 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 117139, 2023-11-06T13:42:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 117139, 2023-11-06T13:42:08.865 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 117139, 2023-11-06T13:42:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 117139, 2023-11-06T13:42:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:08.867 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 32198, 2023-11-06T13:42:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 3508886, 2023-11-06T13:42:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 32198, 2023-11-06T13:42:08.868 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 718, 2023-11-06T13:42:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 3508886, 2023-11-06T13:42:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.869 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:08.870 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x55e6f812a280": { 2023-11-06T13:42:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 193845, 2023-11-06T13:42:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 429610745, 2023-11-06T13:42:08.871 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 193845, 2023-11-06T13:42:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 3145, 2023-11-06T13:42:08.872 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 429610745, 2023-11-06T13:42:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:08.873 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.874 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:08.874 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-11-06T13:42:08.875 INFO:tasks.check_counter:Daemon mds.i mds.exported=276 2023-11-06T13:42:08.876 INFO:tasks.check_counter:Daemon mds.i mds.imported=411 2023-11-06T13:42:08.876 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=126 2023-11-06T13:42:08.876 DEBUG:tasks.check_counter:Getting stats from l 2023-11-06T13:42:08.877 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.l.asok perf dump 2023-11-06T13:42:08.997 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-11-06T13:42:08.997 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-11-06T13:42:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 217357, 2023-11-06T13:42:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 305082, 2023-11-06T13:42:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 73870493, 2023-11-06T13:42:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 236598071, 2023-11-06T13:42:08.998 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 23, 2023-11-06T13:42:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2023-11-06T13:42:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 12.546796822, 2023-11-06T13:42:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 5.937512199, 2023-11-06T13:42:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 400.138787527, 2023-11-06T13:42:08.999 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.352803287, 2023-11-06T13:42:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 305079, 2023-11-06T13:42:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 35.531957967, 2023-11-06T13:42:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000116468 2023-11-06T13:42:09.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 409566, 2023-11-06T13:42:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.082964326, 2023-11-06T13:42:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000202 2023-11-06T13:42:09.001 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-11-06T13:42:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 245196, 2023-11-06T13:42:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 243901, 2023-11-06T13:42:09.002 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 46292143, 2023-11-06T13:42:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 120721131, 2023-11-06T13:42:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 82, 2023-11-06T13:42:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 8, 2023-11-06T13:42:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 10.300231388, 2023-11-06T13:42:09.003 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 3.981101191, 2023-11-06T13:42:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 7.245624915, 2023-11-06T13:42:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.398877733, 2023-11-06T13:42:09.004 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 243899, 2023-11-06T13:42:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 9.052262328, 2023-11-06T13:42:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000037114 2023-11-06T13:42:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.005 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 453167, 2023-11-06T13:42:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.079278511, 2023-11-06T13:42:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000174 2023-11-06T13:42:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-11-06T13:42:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 201206, 2023-11-06T13:42:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 199759, 2023-11-06T13:42:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 35750976, 2023-11-06T13:42:09.007 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 88352642, 2023-11-06T13:42:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 15, 2023-11-06T13:42:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 6, 2023-11-06T13:42:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 10.260600519, 2023-11-06T13:42:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 4.322177836, 2023-11-06T13:42:09.008 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 7.076663663, 2023-11-06T13:42:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.412206642, 2023-11-06T13:42:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-11-06T13:42:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 199760, 2023-11-06T13:42:09.009 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 10.139115887, 2023-11-06T13:42:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000050756 2023-11-06T13:42:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-11-06T13:42:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 381287, 2023-11-06T13:42:09.010 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.065069323, 2023-11-06T13:42:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000170 2023-11-06T13:42:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-11-06T13:42:09.011 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2023-11-06T13:42:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-11-06T13:42:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2023-11-06T13:42:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:09.012 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5067, 2023-11-06T13:42:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 82.939853133, 2023-11-06T13:42:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.016368630 2023-11-06T13:42:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.013 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2023-11-06T13:42:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-11-06T13:42:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-11-06T13:42:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 18938, 2023-11-06T13:42:09.014 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 4.062784024, 2023-11-06T13:42:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000214530 2023-11-06T13:42:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2023-11-06T13:42:09.015 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 91682, 2023-11-06T13:42:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 86744, 2023-11-06T13:42:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2023-11-06T13:42:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 86744, 2023-11-06T13:42:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1399.257332457, 2023-11-06T13:42:09.016 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.016130883 2023-11-06T13:42:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2023-11-06T13:42:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 4938, 2023-11-06T13:42:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch": 1, 2023-11-06T13:42:09.017 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 733, 2023-11-06T13:42:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 80, 2023-11-06T13:42:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 1, 2023-11-06T13:42:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 24, 2023-11-06T13:42:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 0, 2023-11-06T13:42:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 3, 2023-11-06T13:42:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 21, 2023-11-06T13:42:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 23, 2023-11-06T13:42:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 38157, 2023-11-06T13:42:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 1, 2023-11-06T13:42:09.019 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 1, 2023-11-06T13:42:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 3, 2023-11-06T13:42:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 148741, 2023-11-06T13:42:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 126103, 2023-11-06T13:42:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 4796, 2023-11-06T13:42:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 328, 2023-11-06T13:42:09.020 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2023-11-06T13:42:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2023-11-06T13:42:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 222, 2023-11-06T13:42:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 2649, 2023-11-06T13:42:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 1, 2023-11-06T13:42:09.021 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 290, 2023-11-06T13:42:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 22922, 2023-11-06T13:42:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 182, 2023-11-06T13:42:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 11605, 2023-11-06T13:42:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2023-11-06T13:42:09.022 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 1271, 2023-11-06T13:42:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2023-11-06T13:42:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 4, 2023-11-06T13:42:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 246, 2023-11-06T13:42:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2023-11-06T13:42:09.023 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 1271, 2023-11-06T13:42:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2023-11-06T13:42:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2023-11-06T13:42:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2023-11-06T13:42:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 81, 2023-11-06T13:42:09.024 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 8, 2023-11-06T13:42:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 73, 2023-11-06T13:42:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 1190, 2023-11-06T13:42:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 103, 2023-11-06T13:42:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 17939, 2023-11-06T13:42:09.025 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 34690, 2023-11-06T13:42:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 6, 2023-11-06T13:42:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-11-06T13:42:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2023-11-06T13:42:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 45571, 2023-11-06T13:42:09.026 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 17919, 2023-11-06T13:42:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 346, 2023-11-06T13:42:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 32991 2023-11-06T13:42:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2023-11-06T13:42:09.027 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 0, 2023-11-06T13:42:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2023-11-06T13:42:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2023-11-06T13:42:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 10373, 2023-11-06T13:42:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 10373, 2023-11-06T13:42:09.028 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2023-11-06T13:42:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2023-11-06T13:42:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2023-11-06T13:42:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2023-11-06T13:42:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2023-11-06T13:42:09.029 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2023-11-06T13:42:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2023-11-06T13:42:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 8, 2023-11-06T13:42:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 290, 2023-11-06T13:42:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2023-11-06T13:42:09.030 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 81, 2023-11-06T13:42:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2023-11-06T13:42:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2023-11-06T13:42:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2023-11-06T13:42:09.031 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 101681, 2023-11-06T13:42:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2023-11-06T13:42:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2023-11-06T13:42:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 101681, 2023-11-06T13:42:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2023-11-06T13:42:09.032 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2023-11-06T13:42:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 120, 2023-11-06T13:42:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2023-11-06T13:42:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2023-11-06T13:42:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 120, 2023-11-06T13:42:09.033 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2023-11-06T13:42:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2023-11-06T13:42:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2023-11-06T13:42:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 225674684, 2023-11-06T13:42:09.034 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 0, 2023-11-06T13:42:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2023-11-06T13:42:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2131, 2023-11-06T13:42:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 180.192074923, 2023-11-06T13:42:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.084557519 2023-11-06T13:42:09.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 0 2023-11-06T13:42:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2023-11-06T13:42:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 30, 2023-11-06T13:42:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 26027, 2023-11-06T13:42:09.036 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 25997, 2023-11-06T13:42:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 29, 2023-11-06T13:42:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 1319, 2023-11-06T13:42:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 1290, 2023-11-06T13:42:09.037 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 74, 2023-11-06T13:42:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 58307, 2023-11-06T13:42:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 58233, 2023-11-06T13:42:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 1, 2023-11-06T13:42:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 27053, 2023-11-06T13:42:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 27052, 2023-11-06T13:42:09.038 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 115712, 2023-11-06T13:42:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 340216 2023-11-06T13:42:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2023-11-06T13:42:09.039 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 110283, 2023-11-06T13:42:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 1186, 2023-11-06T13:42:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 91682, 2023-11-06T13:42:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 292, 2023-11-06T13:42:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 2424, 2023-11-06T13:42:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2023-11-06T13:42:09.040 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 18291, 2023-11-06T13:42:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 70.675360033, 2023-11-06T13:42:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.003863941 2023-11-06T13:42:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2023-11-06T13:42:09.041 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1807, 2023-11-06T13:42:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 82.224433564, 2023-11-06T13:42:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.045503283 2023-11-06T13:42:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2023-11-06T13:42:09.042 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2023-11-06T13:42:09.043 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2023-11-06T13:42:09.044 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 35546, 2023-11-06T13:42:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 938.065347050, 2023-11-06T13:42:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.026390180 2023-11-06T13:42:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2023-11-06T13:42:09.045 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2023-11-06T13:42:09.046 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.047 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2023-11-06T13:42:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.048 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2023-11-06T13:42:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.049 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2023-11-06T13:42:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.050 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2023-11-06T13:42:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2023-11-06T13:42:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 135, 2023-11-06T13:42:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 3.541337572, 2023-11-06T13:42:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.026232130 2023-11-06T13:42:09.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2023-11-06T13:42:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.053 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2023-11-06T13:42:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.054 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2023-11-06T13:42:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 4615, 2023-11-06T13:42:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 36.447196720, 2023-11-06T13:42:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.007897550 2023-11-06T13:42:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.055 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2023-11-06T13:42:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 422, 2023-11-06T13:42:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.147839296, 2023-11-06T13:42:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002719998 2023-11-06T13:42:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.056 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2023-11-06T13:42:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 17892, 2023-11-06T13:42:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 236.997686604, 2023-11-06T13:42:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.013246014 2023-11-06T13:42:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.057 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2023-11-06T13:42:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.058 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2023-11-06T13:42:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 66, 2023-11-06T13:42:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 13.025020241, 2023-11-06T13:42:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.197348791 2023-11-06T13:42:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.059 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2023-11-06T13:42:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2023-11-06T13:42:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.062 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2023-11-06T13:42:09.062 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 7, 2023-11-06T13:42:09.062 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.213828319, 2023-11-06T13:42:09.062 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.030546902 2023-11-06T13:42:09.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.063 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2023-11-06T13:42:09.063 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.063 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.063 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.064 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2023-11-06T13:42:09.064 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.064 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.064 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2023-11-06T13:42:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2023-11-06T13:42:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 7, 2023-11-06T13:42:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.020094766, 2023-11-06T13:42:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002870680 2023-11-06T13:42:09.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2023-11-06T13:42:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3, 2023-11-06T13:42:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.002508682, 2023-11-06T13:42:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000836227 2023-11-06T13:42:09.067 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2023-11-06T13:42:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 7953, 2023-11-06T13:42:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 16.896679610, 2023-11-06T13:42:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002124566 2023-11-06T13:42:09.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2023-11-06T13:42:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2023-11-06T13:42:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2023-11-06T13:42:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.069 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2023-11-06T13:42:09.070 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 1, 2023-11-06T13:42:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 3, 2023-11-06T13:42:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 2, 2023-11-06T13:42:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 1, 2023-11-06T13:42:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2023-11-06T13:42:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 2073, 2023-11-06T13:42:09.071 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 2073, 2023-11-06T13:42:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 822 2023-11-06T13:42:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-11-06T13:42:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 120, 2023-11-06T13:42:09.072 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 120, 2023-11-06T13:42:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-11-06T13:42:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-11-06T13:42:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-11-06T13:42:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-11-06T13:42:09.073 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-06T13:42:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-11-06T13:42:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-06T13:42:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-11-06T13:42:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-11-06T13:42:09.074 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-11-06T13:42:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_bytes": 0, 2023-11-06T13:42:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Buffer_items": 0, 2023-11-06T13:42:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_bytes": 0, 2023-11-06T13:42:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Extent_items": 0, 2023-11-06T13:42:09.075 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_bytes": 0, 2023-11-06T13:42:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_Blob_items": 0, 2023-11-06T13:42:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_bytes": 0, 2023-11-06T13:42:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_SharedBlob_items": 0, 2023-11-06T13:42:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-06T13:42:09.076 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-11-06T13:42:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-11-06T13:42:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-11-06T13:42:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-11-06T13:42:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-11-06T13:42:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-06T13:42:09.077 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-11-06T13:42:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-11-06T13:42:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-11-06T13:42:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-11-06T13:42:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-11-06T13:42:09.078 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-11-06T13:42:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-11-06T13:42:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-11-06T13:42:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-11-06T13:42:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 226573, 2023-11-06T13:42:09.079 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 123, 2023-11-06T13:42:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 264, 2023-11-06T13:42:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 3, 2023-11-06T13:42:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-11-06T13:42:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-11-06T13:42:09.080 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-11-06T13:42:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-11-06T13:42:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-11-06T13:42:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-11-06T13:42:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 7944, 2023-11-06T13:42:09.081 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 126, 2023-11-06T13:42:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-11-06T13:42:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-11-06T13:42:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-11-06T13:42:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-11-06T13:42:09.082 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 170301, 2023-11-06T13:42:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 1570, 2023-11-06T13:42:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-11-06T13:42:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-11-06T13:42:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-11-06T13:42:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-11-06T13:42:09.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2023-11-06T13:42:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2023-11-06T13:42:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2023-11-06T13:42:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 26897, 2023-11-06T13:42:09.084 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 237063999, 2023-11-06T13:42:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 37, 2023-11-06T13:42:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 26897, 2023-11-06T13:42:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2023-11-06T13:42:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 26897, 2023-11-06T13:42:09.085 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 27922 2023-11-06T13:42:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 26897, 2023-11-06T13:42:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 1655, 2023-11-06T13:42:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 25242, 2023-11-06T13:42:09.086 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2023-11-06T13:42:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2023-11-06T13:42:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 0, 2023-11-06T13:42:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 11, 2023-11-06T13:42:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 375, 2023-11-06T13:42:09.087 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 2498, 2023-11-06T13:42:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 230, 2023-11-06T13:42:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2023-11-06T13:42:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2023-11-06T13:42:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2023-11-06T13:42:09.088 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 80, 2023-11-06T13:42:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 21553, 2023-11-06T13:42:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2023-11-06T13:42:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2023-11-06T13:42:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2023-11-06T13:42:09.089 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 1279, 2023-11-06T13:42:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 22, 2023-11-06T13:42:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2023-11-06T13:42:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2023-11-06T13:42:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2023-11-06T13:42:09.090 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2023-11-06T13:42:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2023-11-06T13:42:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2023-11-06T13:42:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2023-11-06T13:42:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2023-11-06T13:42:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2023-11-06T13:42:09.091 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 6, 2023-11-06T13:42:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2023-11-06T13:42:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2023-11-06T13:42:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2023-11-06T13:42:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2023-11-06T13:42:09.092 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2023-11-06T13:42:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2023-11-06T13:42:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2023-11-06T13:42:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2023-11-06T13:42:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2023-11-06T13:42:09.093 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2023-11-06T13:42:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2023-11-06T13:42:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2023-11-06T13:42:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2023-11-06T13:42:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2023-11-06T13:42:09.094 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2023-11-06T13:42:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2023-11-06T13:42:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 33, 2023-11-06T13:42:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2023-11-06T13:42:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 7, 2023-11-06T13:42:09.095 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 12, 2023-11-06T13:42:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 12, 2023-11-06T13:42:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2023-11-06T13:42:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2023-11-06T13:42:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 1689, 2023-11-06T13:42:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 2, 2023-11-06T13:42:09.096 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 177 2023-11-06T13:42:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2023-11-06T13:42:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 1, 2023-11-06T13:42:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2023-11-06T13:42:09.097 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2023-11-06T13:42:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2023-11-06T13:42:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2023-11-06T13:42:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2023-11-06T13:42:09.098 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 17, 2023-11-06T13:42:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2023-11-06T13:42:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 6, 2023-11-06T13:42:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 10373, 2023-11-06T13:42:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2023-11-06T13:42:09.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-11-06T13:42:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:09.100 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 663755, 2023-11-06T13:42:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 89229130, 2023-11-06T13:42:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 663755, 2023-11-06T13:42:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:09.101 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 663755, 2023-11-06T13:42:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 89229130, 2023-11-06T13:42:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.102 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2023-11-06T13:42:09.103 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-11-06T13:42:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:09.104 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 26897, 2023-11-06T13:42:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 238194392, 2023-11-06T13:42:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 26897, 2023-11-06T13:42:09.105 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 238194392, 2023-11-06T13:42:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.106 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2023-11-06T13:42:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2023-11-06T13:42:09.107 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-11-06T13:42:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-11-06T13:42:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-11-06T13:42:09.108 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 26897, 2023-11-06T13:42:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 26897, 2023-11-06T13:42:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 26897, 2023-11-06T13:42:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 26897, 2023-11-06T13:42:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.109 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.110 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2023-11-06T13:42:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 10373, 2023-11-06T13:42:09.111 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 1130409, 2023-11-06T13:42:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 10373, 2023-11-06T13:42:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 367, 2023-11-06T13:42:09.112 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 1130409, 2023-11-06T13:42:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.113 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-11-06T13:42:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x55ec90f42280": { 2023-11-06T13:42:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-11-06T13:42:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-11-06T13:42:09.114 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-11-06T13:42:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 101681, 2023-11-06T13:42:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 221480380, 2023-11-06T13:42:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-11-06T13:42:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 101681, 2023-11-06T13:42:09.115 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-11-06T13:42:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-11-06T13:42:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 2131, 2023-11-06T13:42:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 221480380, 2023-11-06T13:42:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-11-06T13:42:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-11-06T13:42:09.116 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-11-06T13:42:09.117 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-11-06T13:42:09.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.117 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-11-06T13:42:09.117 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-11-06T13:42:09.119 INFO:tasks.check_counter:Daemon mds.l mds.exported=290 2023-11-06T13:42:09.119 INFO:tasks.check_counter:Daemon mds.l mds.imported=182 2023-11-06T13:42:09.119 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=80 2023-11-06T13:42:09.120 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-11-06T13:42:09.130 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-11-06T13:42:18.594 DEBUG:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-11-06T13:42:18.730 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.726+0000 7ffb0e1b8700 1 Processor -- start 2023-11-06T13:42:18.731 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.726+0000 7ffb0e1b8700 1 -- start start 2023-11-06T13:42:18.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb0e1b8700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb08175540 0x7ffb08182d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb0e1b8700 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0817cf20 con 0x7ffb08175920 2023-11-06T13:42:18.733 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb0e1b8700 1 -- --> v1:172.21.15.163:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0817e040 con 0x7ffb0817e4d0 2023-11-06T13:42:18.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb0e1b8700 1 -- --> v2:172.21.15.38:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0817d150 con 0x7ffb08175540 2023-11-06T13:42:18.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb08175540 0x7ffb08182d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 --2- >> v2:172.21.15.38:3300/0 conn(0x7ffb08175540 0x7ffb08182d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47794/0 (socket says 172.21.15.38:47794) 2023-11-06T13:42:18.734 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 -- 172.21.15.38:0/2055834714 learned_addr learned my addr 172.21.15.38:0/2055834714 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:18.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 -- 172.21.15.38:0/2055834714 >> v1:172.21.15.163:6789/0 conn(0x7ffb0817e4d0 legacy=0x7ffb0817c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb067fc700 1 -- 172.21.15.38:0/2055834714 <== mon.2 v1:172.21.15.163:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114003456 0 0) 0x7ffb0817e040 con 0x7ffb0817e4d0 2023-11-06T13:42:18.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 -- 172.21.15.38:0/2055834714 >> v1:172.21.15.44:6789/0 conn(0x7ffb08175920 legacy=0x7ffb080cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 -- 172.21.15.38:0/2055834714 --> v2:172.21.15.38:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0817d430 con 0x7ffb08175540 2023-11-06T13:42:18.735 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb077fe700 1 --2- 172.21.15.38:0/2055834714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175540 0x7ffb08182d70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7ffaf8006fd0 tx=0x7ffaf80090f0).ready entity=mon.0 client_cookie=511559665ceca4e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb067fc700 1 -- 172.21.15.38:0/2055834714 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800b600 con 0x7ffb08175540 2023-11-06T13:42:18.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb067fc700 1 -- 172.21.15.38:0/2055834714 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf800b760 con 0x7ffb08175540 2023-11-06T13:42:18.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.728+0000 7ffb067fc700 1 -- 172.21.15.38:0/2055834714 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800bae0 con 0x7ffb08175540 2023-11-06T13:42:18.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/2055834714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175540 msgr2=0x7ffb08182d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.736 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/2055834714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175540 0x7ffb08182d70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7ffaf8006fd0 tx=0x7ffaf80090f0).stop 2023-11-06T13:42:18.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/2055834714 shutdown_connections 2023-11-06T13:42:18.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/2055834714 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175540 0x7ffb08182d70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.737 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/2055834714 >> 172.21.15.38:0/2055834714 conn(0x7ffb080f53b0 msgr2=0x7ffb080f57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:18.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/2055834714 shutdown_connections 2023-11-06T13:42:18.738 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.729+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/2055834714 wait complete. 2023-11-06T13:42:18.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.730+0000 7ffb0e1b8700 1 Processor -- start 2023-11-06T13:42:18.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.731+0000 7ffb0e1b8700 1 -- start start 2023-11-06T13:42:18.744 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb08175540 0x7ffb08190580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 0x7ffb08172b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb0817e4d0 0x7ffb08173810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080c51b0 con 0x7ffb08175920 2023-11-06T13:42:18.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08190a70 con 0x7ffb0817e4d0 2023-11-06T13:42:18.745 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081726d0 con 0x7ffb08175540 2023-11-06T13:42:18.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 0x7ffb08172b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 0x7ffb08172b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47806/0 (socket says 172.21.15.38:47806) 2023-11-06T13:42:18.746 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1398561811 learned_addr learned my addr 172.21.15.38:0/1398561811 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:18.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb08175540 0x7ffb08190580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb07fff700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb0817e4d0 0x7ffb08173810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb08175540 msgr2=0x7ffb08190580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.747 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb08175540 0x7ffb08190580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1398561811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb0817e4d0 msgr2=0x7ffb08173810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb0817e4d0 0x7ffb08173810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.748 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1398561811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf8009370 con 0x7ffb08175920 2023-11-06T13:42:18.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 0x7ffb08172b60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffafc00c490 tx=0x7ffafc007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffaef7fe700 1 -- 172.21.15.38:0/1398561811 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00ce30 con 0x7ffb08175920 2023-11-06T13:42:18.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffaef7fe700 1 -- 172.21.15.38:0/1398561811 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00f470 con 0x7ffb08175920 2023-11-06T13:42:18.749 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb081717e0 con 0x7ffb08175920 2023-11-06T13:42:18.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffaef7fe700 1 -- 172.21.15.38:0/1398561811 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00f830 con 0x7ffb08175920 2023-11-06T13:42:18.750 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.732+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb08171da0 con 0x7ffb08175920 2023-11-06T13:42:18.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.735+0000 7ffaef7fe700 1 -- 172.21.15.38:0/1398561811 <== mon.0 v2:172.21.15.38:3300/0 4 ==== mgrmap(e 6) v1 ==== 113055+0+0 (secure 0 0 0) 0x7ffafc00fc20 con 0x7ffb08175920 2023-11-06T13:42:18.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.735+0000 7ffaef7fe700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf408cb40 0x7ffaf408f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.736+0000 7ffaef7fe700 1 -- 172.21.15.38:0/1398561811 <== mon.0 v2:172.21.15.38:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ffafc0b13d0 con 0x7ffb08175920 2023-11-06T13:42:18.751 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.736+0000 7ffb077fe700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf408cb40 0x7ffaf408f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.736+0000 7ffb077fe700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf408cb40 0x7ffaf408f000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ffaf8009130 tx=0x7ffaf8017000).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.737+0000 7ffb1fb50b80 1 Processor -- start 2023-11-06T13:42:18.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.737+0000 7ffb1fb50b80 1 -- start start 2023-11-06T13:42:18.752 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99736400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab997368f0 0x55ab996f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99733c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab996b8fd0 con 0x55ab996f3110 2023-11-06T13:42:18.753 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab99630240 con 0x55ab994afe90 2023-11-06T13:42:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab99645490 con 0x55ab997368f0 2023-11-06T13:42:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99733c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99733c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47808/0 (socket says 172.21.15.38:47808) 2023-11-06T13:42:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 -- 172.21.15.38:0/602302562 learned_addr learned my addr 172.21.15.38:0/602302562 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:18.754 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb077fe700 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99736400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 -- 172.21.15.38:0/602302562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab997368f0 msgr2=0x55ab996f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab997368f0 0x55ab996f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:42:18.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 -- 172.21.15.38:0/602302562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 msgr2=0x55ab99736400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.738+0000 7ffb07fff700 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99736400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.755 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb07fff700 1 -- 172.21.15.38:0/602302562 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab9963e670 con 0x55ab996f3110 2023-11-06T13:42:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb07fff700 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99733c00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ffb0000c8f0 tx=0x7ffb00009040).ready entity=mon.0 client_cookie=ad4f91da50a5b7a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.756 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffaecff9700 1 -- 172.21.15.38:0/602302562 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000ce90 con 0x55ab996f3110 2023-11-06T13:42:18.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffaecff9700 1 -- 172.21.15.38:0/602302562 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb000040d0 con 0x55ab996f3110 2023-11-06T13:42:18.757 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffaecff9700 1 -- 172.21.15.38:0/602302562 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00006e40 con 0x55ab996f3110 2023-11-06T13:42:18.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/602302562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 msgr2=0x55ab99733c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.814 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99733c00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ffb0000c8f0 tx=0x7ffb00009040).stop 2023-11-06T13:42:18.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/602302562 shutdown_connections 2023-11-06T13:42:18.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99733c00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99736400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.815 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/602302562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab997368f0 0x55ab996f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-11-06T13:42:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.739+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/602302562 >> 172.21.15.38:0/602302562 conn(0x55ab9955d4f0 msgr2=0x55ab996f3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.740+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/602302562 shutdown_connections 2023-11-06T13:42:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.740+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/602302562 wait complete. 2023-11-06T13:42:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.740+0000 7ffb1fb50b80 1 -- start start 2023-11-06T13:42:18.816 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.740+0000 7ffb1fb50b80 1 Processor -- start 2023-11-06T13:42:18.827 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99722940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab9972f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab996455d0 con 0x55ab996f3110 2023-11-06T13:42:18.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab99645850 con 0x55ab997368f0 2023-11-06T13:42:18.828 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab99610e60 con 0x55ab994afe90 2023-11-06T13:42:18.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.741+0000 7ffb1fb50b80 10 client.0 ll_register_callbacks cb 0x55ab996b33d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:42:18.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99722940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab9972f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab9972f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.38:41322/0 (socket says 172.21.15.38:41322) 2023-11-06T13:42:18.829 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99722940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47810/0 (socket says 172.21.15.38:47810) 2023-11-06T13:42:18.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb07fff700 1 -- 172.21.15.38:0/1095741804 learned_addr learned my addr 172.21.15.38:0/1095741804 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:18.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 msgr2=0x55ab996faf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.830 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1095741804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 msgr2=0x55ab9972f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab9972f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1095741804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0000f040 con 0x55ab996f3110 2023-11-06T13:42:18.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99722940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ffafc00cb30 tx=0x7ffafc0aee80).ready entity=mon.0 client_cookie=614c097a88d618f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffae5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:42:18.831 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffae5ffb700 1 -- 172.21.15.38:0/1095741804 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0b11a0 con 0x55ab996f3110 2023-11-06T13:42:18.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffae5ffb700 1 -- 172.21.15.38:0/1095741804 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ffafc08af00 con 0x55ab996f3110 2023-11-06T13:42:18.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab996e7690 con 0x55ab996f3110 2023-11-06T13:42:18.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffae5ffb700 1 -- 172.21.15.38:0/1095741804 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffafc08aa70 con 0x55ab996f3110 2023-11-06T13:42:18.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb1fb50b80 10 client.5829 fetch_fsmap learned FSMap version 50 2023-11-06T13:42:18.832 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.742+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55ab99639a10 con 0x55ab996f3110 2023-11-06T13:42:18.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffae5ffb700 1 -- 172.21.15.38:0/1095741804 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab996e7690 con 0x55ab996f3110 2023-11-06T13:42:18.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffae5ffb700 1 -- 172.21.15.38:0/1095741804 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 50) v1 ==== 7524+0+0 (secure 0 0 0) 0x7ffafc089210 con 0x55ab996f3110 2023-11-06T13:42:18.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb1fb50b80 10 client.5829 fetch_fsmap finished waiting for FSMap version 50 2023-11-06T13:42:18.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb1fb50b80 10 client.5829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:42:18.833 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb1fb50b80 20 client.5829 populate_metadata read hostname 'smithi038' 2023-11-06T13:42:18.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab997722b0 0x55ab997620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb1fb50b80 4 client.5829 mds_command: new command op to 4361 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-06T13:42:18.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab994abcf0 con 0x55ab997722b0 2023-11-06T13:42:18.834 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb077fe700 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab997722b0 0x55ab997620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffae5ffb700 10 client.5829 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:42:18.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.743+0000 7ffb077fe700 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab997722b0 0x55ab997620a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5b4d6170fd3c61ea server_cookie=8e2b756955b10a in_seq=0 out_seq=0 2023-11-06T13:42:18.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffae5ffb700 1 -- 172.21.15.38:0/1095741804 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55ab994abcf0 con 0x55ab997722b0 2023-11-06T13:42:18.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffae5ffb700 10 client.5829 handle_command_reply: tid=0 2023-11-06T13:42:18.835 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 client.5829 shutdown 2023-11-06T13:42:18.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 msgr2=0x55ab99722940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99722940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ffafc00cb30 tx=0x7ffafc0aee80).stop 2023-11-06T13:42:18.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 shutdown_connections 2023-11-06T13:42:18.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab9972f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.836 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab997722b0 0x55ab997620a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1095741804 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab99722940 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffae5ffb700 0 client.5829 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:42:18.837 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 >> 172.21.15.38:0/1095741804 conn(0x55ab9955d4f0 msgr2=0x55ab99735360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 shutdown_connections 2023-11-06T13:42:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1095741804 wait complete. 2023-11-06T13:42:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.744+0000 7ffb1fb50b80 20 client.5829 trim_cache size 0 max 16384 2023-11-06T13:42:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.761+0000 7ffb1fb50b80 1 Processor -- start 2023-11-06T13:42:18.838 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.761+0000 7ffb1fb50b80 1 -- start start 2023-11-06T13:42:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab996eee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab99759450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab996f1b90 con 0x55ab996f3110 2023-11-06T13:42:18.839 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab996f3900 con 0x55ab997368f0 2023-11-06T13:42:18.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab99738b70 con 0x55ab994afe90 2023-11-06T13:42:18.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab996eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab996eee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47818/0 (socket says 172.21.15.38:47818) 2023-11-06T13:42:18.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1164641380 learned_addr learned my addr 172.21.15.38:0/1164641380 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:18.840 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb077fe700 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb07fff700 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab99759450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1164641380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 msgr2=0x55ab996faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1164641380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 msgr2=0x55ab99759450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.841 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab99759450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.762+0000 7ffb06ffd700 1 -- 172.21.15.38:0/1164641380 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab99639760 con 0x55ab996f3110 2023-11-06T13:42:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab996eee20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ffafc083970 tx=0x7ffafc08e000).ready entity=mon.0 client_cookie=f2a4ff009232c2ac server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffaed7fa700 1 -- 172.21.15.38:0/1164641380 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc085620 con 0x55ab996f3110 2023-11-06T13:42:18.842 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffaed7fa700 1 -- 172.21.15.38:0/1164641380 <== mon.0 v2:172.21.15.38:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc0b1030 con 0x55ab996f3110 2023-11-06T13:42:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffaed7fa700 1 -- 172.21.15.38:0/1164641380 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc08af00 con 0x55ab996f3110 2023-11-06T13:42:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1164641380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 msgr2=0x55ab996eee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab996eee20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7ffafc083970 tx=0x7ffafc08e000).stop 2023-11-06T13:42:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1164641380 shutdown_connections 2023-11-06T13:42:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab997368f0 0x55ab99759450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.843 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab994afe90 0x55ab996faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/1164641380 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab996f3110 0x55ab996eee20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1164641380 >> 172.21.15.38:0/1164641380 conn(0x55ab9955d4f0 msgr2=0x55ab997371d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1164641380 shutdown_connections 2023-11-06T13:42:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.763+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/1164641380 wait complete. 2023-11-06T13:42:18.844 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.764+0000 7ffb1fb50b80 1 -- start start 2023-11-06T13:42:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.764+0000 7ffb1fb50b80 1 Processor -- start 2023-11-06T13:42:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99729e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab996f3110 0x55ab997cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 0x55ab99735c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.845 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab99726870 con 0x55ab997368f0 2023-11-06T13:42:18.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9972e6c0 con 0x55ab994afe90 2023-11-06T13:42:18.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab996f2ef0 con 0x55ab996f3110 2023-11-06T13:42:18.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb1fb50b80 10 client.0 ll_register_callbacks cb 0x55ab996b33d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-06T13:42:18.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 0x55ab99735c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.846 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb07fff700 1 --2- >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 0x55ab99735c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.38:3300/0 says I am v2:172.21.15.38:47820/0 (socket says 172.21.15.38:47820) 2023-11-06T13:42:18.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb07fff700 1 -- 172.21.15.38:0/904010748 learned_addr learned my addr 172.21.15.38:0/904010748 (peer_addr_for_me v2:172.21.15.38:0/0) 2023-11-06T13:42:18.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb06ffd700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab996f3110 0x55ab997cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.847 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.765+0000 7ffb077fe700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99729e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb07fff700 1 -- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab996f3110 msgr2=0x55ab997cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb07fff700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab996f3110 0x55ab997cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb07fff700 1 -- 172.21.15.38:0/904010748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 msgr2=0x55ab99729e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-06T13:42:18.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb07fff700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99729e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.848 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb07fff700 1 -- 172.21.15.38:0/904010748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab99639a10 con 0x55ab997368f0 2023-11-06T13:42:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb07fff700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 0x55ab99735c60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ffb00004000 tx=0x7ffb00009040).ready entity=mon.0 client_cookie=e28941c3b857c784 server_cookie=0 in_seq=0 out_seq=0 2023-11-06T13:42:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffae5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.38:3300/0 2023-11-06T13:42:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffae5ffb700 1 -- 172.21.15.38:0/904010748 <== mon.0 v2:172.21.15.38:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000ec60 con 0x55ab997368f0 2023-11-06T13:42:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb000040d0 con 0x55ab997368f0 2023-11-06T13:42:18.849 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffae5ffb700 1 -- 172.21.15.38:0/904010748 <== mon.0 v2:172.21.15.38:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 8803+0+0 (secure 0 0 0) 0x7ffb0000edc0 con 0x55ab997368f0 2023-11-06T13:42:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffae5ffb700 1 -- 172.21.15.38:0/904010748 <== mon.0 v2:172.21.15.38:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb00022690 con 0x55ab997368f0 2023-11-06T13:42:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb1fb50b80 10 client.5835 fetch_fsmap learned FSMap version 50 2023-11-06T13:42:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 --> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55ab994b0fd0 con 0x55ab997368f0 2023-11-06T13:42:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.766+0000 7ffae5ffb700 1 -- 172.21.15.38:0/904010748 <== mon.0 v2:172.21.15.38:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb000040d0 con 0x55ab997368f0 2023-11-06T13:42:18.850 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffae5ffb700 1 -- 172.21.15.38:0/904010748 <== mon.0 v2:172.21.15.38:3300/0 5 ==== fsmap(e 50) v1 ==== 7524+0+0 (secure 0 0 0) 0x7ffb000227f0 con 0x55ab997368f0 2023-11-06T13:42:18.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 10 client.5835 fetch_fsmap finished waiting for FSMap version 50 2023-11-06T13:42:18.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 10 client.5835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.l 2023-11-06T13:42:18.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 20 client.5835 populate_metadata read hostname 'smithi038' 2023-11-06T13:42:18.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab996f45d0 0x55ab996f1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-11-06T13:42:18.851 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 4 client.5835 mds_command: new command op to 4361 tid=0[{"prefix": "scrub status"}] 2023-11-06T13:42:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 --> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ab994e2cf0 con 0x55ab996f45d0 2023-11-06T13:42:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb077fe700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab996f45d0 0x55ab996f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-11-06T13:42:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffae5ffb700 10 client.5835 ms_handle_connect on v2:172.21.15.163:6840/2794564975 2023-11-06T13:42:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb077fe700 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab996f45d0 0x55ab996f1430 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ba53122a5e51cc19 server_cookie=df1fb52cb8e3db5e in_seq=0 out_seq=0 2023-11-06T13:42:18.852 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffae5ffb700 1 -- 172.21.15.38:0/904010748 <== mds.0 v2:172.21.15.163:6840/2794564975 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ab994e2cf0 con 0x55ab996f45d0 2023-11-06T13:42:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffae5ffb700 10 client.5835 handle_command_reply: tid=0 2023-11-06T13:42:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.767+0000 7ffb1fb50b80 1 client.5835 shutdown 2023-11-06T13:42:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 msgr2=0x55ab99735c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 0x55ab99735c60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7ffb00004000 tx=0x7ffb00009040).stop 2023-11-06T13:42:18.853 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 shutdown_connections 2023-11-06T13:42:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x55ab997368f0 0x55ab99735c60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ab994afe90 0x55ab99729e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:6840/2794564975,v1:172.21.15.163:6841/2794564975] conn(0x55ab996f45d0 0x55ab996f1430 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 --2- 172.21.15.38:0/904010748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab996f3110 0x55ab997cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.854 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 >> 172.21.15.38:0/904010748 conn(0x55ab9955d4f0 msgr2=0x55ab997371d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffae5ffb700 0 client.5835 ms_handle_reset on v2:172.21.15.163:6840/2794564975 2023-11-06T13:42:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 shutdown_connections 2023-11-06T13:42:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 1 -- 172.21.15.38:0/904010748 wait complete. 2023-11-06T13:42:18.855 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb1fb50b80 20 client.5835 trim_cache size 0 max 16384 2023-11-06T13:42:18.856 INFO:teuthology.orchestra.run.smithi038.stdout:{ 2023-11-06T13:42:18.856 INFO:teuthology.orchestra.run.smithi038.stdout: "status": "no active scrubs running", 2023-11-06T13:42:18.856 INFO:teuthology.orchestra.run.smithi038.stdout: "scrubs": {} 2023-11-06T13:42:18.856 INFO:teuthology.orchestra.run.smithi038.stdout:} 2023-11-06T13:42:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf408cb40 msgr2=0x7ffaf408f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf408cb40 0x7ffaf408f000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7ffaf8009130 tx=0x7ffaf8017000).stop 2023-11-06T13:42:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 msgr2=0x7ffb08172b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-06T13:42:18.858 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 0x7ffb08172b60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7ffafc00c490 tx=0x7ffafc007db0).stop 2023-11-06T13:42:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 shutdown_connections 2023-11-06T13:42:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:6832/91073,v1:172.21.15.163:6833/91073] conn(0x7ffaf408cb40 0x7ffaf408f000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffb0817e4d0 0x7ffb08173810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffb08175540 0x7ffb08190580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.859 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 --2- 172.21.15.38:0/1398561811 >> [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] conn(0x7ffb08175920 0x7ffb08172b60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-11-06T13:42:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 >> 172.21.15.38:0/1398561811 conn(0x7ffb080f53b0 msgr2=0x7ffb080f32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-06T13:42:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 shutdown_connections 2023-11-06T13:42:18.860 INFO:teuthology.orchestra.run.smithi038.stderr:2023-11-06T13:42:18.768+0000 7ffb0e1b8700 1 -- 172.21.15.38:0/1398561811 wait complete. 2023-11-06T13:42:18.861 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-06T13:42:19.862 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2023-11-06T13:42:19.862 INFO:tasks.fwd_scrub:done joining 2023-11-06T13:42:19.863 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-06T13:42:19.874 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-06T13:42:19.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-06T13:42:19.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-11-06T13:42:19.875 DEBUG:teuthology.orchestra.run.smithi038:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-06T13:42:55.338 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:42:55.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:42:55.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:42:55.405 INFO:tasks.ceph.mds.c.smithi163.stderr:2023-11-06T13:42:55.402+0000 7f44a0d8d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96031) UID: 0 2023-11-06T13:42:55.406 INFO:tasks.ceph.mds.f.smithi163.stderr:2023-11-06T13:42:55.402+0000 7ffabe90f700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96031) UID: 0 2023-11-06T13:42:55.406 INFO:tasks.ceph.mds.l.smithi163.stderr:2023-11-06T13:42:55.402+0000 7f2dabb63700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96031) UID: 0 2023-11-06T13:42:55.407 INFO:tasks.ceph.mds.i.smithi163.stderr:2023-11-06T13:42:55.402+0000 7f68ea7a3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96031) UID: 0 2023-11-06T13:45:09.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:45:09.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:45:09.093 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:45:39.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:45:39.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:45:39.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:46:09.260 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:46:09.263 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:46:09.266 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:46:39.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:46:39.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:46:39.413 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:47:09.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:47:09.524 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:47:09.527 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:47:39.692 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:47:39.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:47:39.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:48:09.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:48:09.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:48:09.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:48:39.892 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:48:39.896 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:48:39.899 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:49:10.065 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:49:10.068 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:49:10.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:49:40.194 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:49:40.198 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:49:40.200 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:50:10.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:50:10.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:50:10.338 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:50:40.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:50:40.437 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:50:40.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:51:10.567 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:51:10.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:51:10.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:51:40.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:51:40.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:51:40.694 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:52:10.869 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:52:10.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:52:10.875 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:52:40.973 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:52:40.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:52:40.979 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:53:11.061 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:53:11.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:53:11.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:53:41.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:53:41.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:53:41.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:54:11.311 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:54:11.315 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:54:11.318 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:54:41.442 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:54:41.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:54:41.448 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:55:11.563 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:55:11.567 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:55:11.569 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:55:41.697 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:55:41.701 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:55:41.703 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:56:11.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:56:11.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:56:11.820 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:56:41.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:56:41.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:56:41.902 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:57:11.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:57:11.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:57:11.989 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:57:19.932 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-11-06T13:57:19.934 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-11-06T13:57:42.053 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:57:42.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:57:42.060 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:58:12.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:58:12.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:58:12.181 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:58:42.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:58:42.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:58:42.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:59:12.434 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:59:12.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:59:12.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:59:42.523 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:59:42.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T13:59:42.530 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:00:12.762 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:00:12.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:00:12.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:00:42.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:00:42.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:00:42.932 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:01:13.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:01:13.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:01:13.037 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:01:43.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:01:43.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:01:43.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:02:13.247 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:02:13.252 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:02:13.255 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:02:43.386 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:02:43.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:02:43.394 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:03:13.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:03:13.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:03:13.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:03:43.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:03:43.616 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:03:43.618 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:04:13.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:04:13.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:04:13.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:04:43.752 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:04:43.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:04:43.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:05:13.933 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:05:13.937 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:05:13.940 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:05:44.023 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:05:44.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:05:44.029 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:06:14.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:06:14.174 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:06:14.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:06:44.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:06:44.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:06:44.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:07:14.438 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:07:14.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:07:14.445 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:07:44.559 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:07:44.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:07:44.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:08:14.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:08:14.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:08:14.641 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:08:44.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:08:44.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:08:44.784 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:09:14.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:09:14.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:09:14.846 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:09:44.986 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:09:44.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:09:44.993 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:10:15.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:10:15.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:10:15.057 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:10:45.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:10:45.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:10:45.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:11:15.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:11:15.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:11:15.325 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:11:45.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:11:45.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:11:45.386 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:12:15.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:12:15.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:12:15.534 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:12:45.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:12:45.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:12:45.603 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:13:15.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:13:15.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:13:15.751 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:13:45.858 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:13:45.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:13:45.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:14:15.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:14:15.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:14:15.994 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:14:46.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:14:46.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:14:46.195 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:15:16.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:15:16.309 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:15:16.312 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:15:46.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:15:46.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:15:46.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:16:16.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:16:16.578 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:16:16.581 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:16:46.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:16:46.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:16:46.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:17:16.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:17:16.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:17:16.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:17:46.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:17:46.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:17:46.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:18:17.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:18:17.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:18:17.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:18:47.181 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:18:47.185 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:18:47.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:19:17.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:19:17.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:19:17.267 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:19:47.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:19:47.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:19:47.423 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:20:17.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:20:17.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:20:17.477 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:20:47.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:20:47.630 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:20:47.633 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:21:17.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:21:17.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:21:17.771 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:21:47.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:21:47.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:21:47.918 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:22:18.024 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:22:18.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:22:18.031 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:22:48.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:22:48.242 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:22:48.245 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:23:18.301 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:23:18.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:23:18.308 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:23:48.406 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:23:48.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:23:48.412 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:24:18.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:24:18.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:24:18.543 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:24:48.659 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:24:48.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:24:48.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:25:18.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:25:18.800 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:25:18.803 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:25:48.869 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:25:48.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:25:48.876 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:26:18.999 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:26:19.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:26:19.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:26:49.142 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:26:49.146 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:26:49.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:27:19.250 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:27:19.253 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:27:19.256 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:27:49.418 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:27:49.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:27:49.425 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:28:19.531 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:28:19.534 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:28:19.537 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:28:49.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:28:49.702 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:28:49.705 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:29:19.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:29:19.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:29:19.788 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:29:49.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:29:49.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:29:49.960 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:30:20.084 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:30:20.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:30:20.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:30:50.205 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:30:50.209 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:30:50.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:31:20.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:31:20.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:31:20.291 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:31:50.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:31:50.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:31:50.372 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:32:20.479 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:32:20.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:32:20.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:32:50.643 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:32:50.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:32:50.649 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:33:20.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:33:20.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:33:20.786 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:33:50.893 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:33:50.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:33:50.899 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:34:21.023 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:34:21.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:34:21.029 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:34:51.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:34:51.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:34:51.110 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:35:21.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:35:21.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:35:21.248 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:35:51.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:35:51.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:35:51.402 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:36:21.526 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:36:21.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:36:21.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:36:51.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:36:51.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:36:51.670 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:37:21.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:37:21.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:37:21.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:37:51.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:37:51.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:37:51.896 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:38:22.038 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:38:22.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:38:22.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:38:52.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:38:52.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:38:52.184 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:39:22.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:39:22.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:39:22.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:39:52.429 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:39:52.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:39:52.435 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:40:22.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:40:22.554 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:40:22.557 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:40:52.633 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:40:52.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:40:52.639 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:41:22.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:41:22.740 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:41:22.744 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:41:52.892 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:41:52.896 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:41:52.899 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:42:23.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:42:23.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:42:23.036 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:42:53.185 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:42:53.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:42:53.192 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:43:23.416 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:43:23.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:43:23.422 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:43:53.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:43:53.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:43:53.492 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:44:23.709 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:44:23.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:44:23.715 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:44:53.855 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:44:53.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:44:53.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:45:24.019 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:45:24.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:45:24.025 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:45:54.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:45:54.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:45:54.190 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:46:24.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:46:24.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:46:24.319 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:46:54.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:46:54.447 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:46:54.450 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:47:24.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:47:24.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:47:24.588 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:47:54.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:47:54.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:47:54.659 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:48:24.808 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:48:24.811 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:48:24.814 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:48:54.939 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:48:54.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:48:54.945 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:49:25.027 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:49:25.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:49:25.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:49:55.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:49:55.151 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:49:55.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:50:25.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:50:25.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:50:25.318 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:50:55.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:50:55.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:50:55.474 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:51:25.555 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:51:25.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:51:25.562 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:51:55.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:51:55.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:51:55.700 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:52:25.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:52:25.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:52:25.773 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:52:55.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:52:55.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:52:55.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:53:26.003 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:53:26.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:53:26.008 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:53:56.123 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:53:56.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:53:56.130 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:54:26.305 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:54:26.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:54:26.311 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:54:56.428 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:54:56.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:54:56.435 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:55:26.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:55:26.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:55:26.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:55:56.662 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:55:56.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:55:56.669 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:56:26.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:56:26.830 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:56:26.833 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:56:56.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:56:56.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:56:56.936 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:57:27.068 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:57:27.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:57:27.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:57:57.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:57:57.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:57:57.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:58:27.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:58:27.307 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:58:27.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:58:57.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:58:57.412 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:58:57.415 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:59:27.600 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:59:27.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:59:27.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:59:57.668 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:59:57.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T14:59:57.674 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:00:27.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:00:27.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:00:27.788 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:00:57.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:00:57.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:00:57.960 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:01:28.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:01:28.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:01:28.099 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:01:58.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:01:58.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:01:58.171 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:02:28.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:02:28.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:02:28.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:02:58.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:02:58.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:02:58.439 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:03:28.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:03:28.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:03:28.505 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:03:58.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:03:58.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:03:58.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:04:28.653 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:04:28.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:04:28.659 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:04:58.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:04:58.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:04:58.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:05:28.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:05:28.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:05:28.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:05:59.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:05:59.025 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:05:59.028 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:06:29.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:06:29.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:06:29.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:06:59.273 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:06:59.277 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:06:59.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:07:29.402 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:07:29.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:07:29.408 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:07:59.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:07:59.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:07:59.556 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:08:29.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:08:29.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:08:29.629 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:08:59.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:08:59.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:08:59.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:09:29.939 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:09:29.943 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:09:29.946 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:10:00.069 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:10:00.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:10:00.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:10:30.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:10:30.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:10:30.190 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:11:00.330 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:11:00.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:11:00.336 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:11:30.451 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:11:30.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:11:30.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:12:00.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:12:00.585 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:12:00.587 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:12:30.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:12:30.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:12:30.657 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:13:00.741 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:13:00.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:13:00.748 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:13:30.871 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:13:30.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:13:30.878 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:14:00.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:14:00.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:14:00.973 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:14:31.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:14:31.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:14:31.120 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:15:01.186 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:15:01.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:15:01.192 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:15:31.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:15:31.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:15:31.346 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:16:01.446 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:16:01.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:16:01.452 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:16:31.600 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:16:31.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:16:31.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:17:01.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:17:01.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:17:01.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:17:31.736 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:17:31.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:17:31.742 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:18:01.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:18:01.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:18:01.905 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:18:32.012 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:18:32.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:18:32.019 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:19:02.150 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:19:02.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:19:02.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:19:32.289 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:19:32.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:19:32.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:20:02.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:20:02.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:20:02.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:20:32.540 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:20:32.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:20:32.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:21:02.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:21:02.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:21:02.894 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:21:32.951 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:21:32.954 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:21:32.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:22:03.114 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:22:03.118 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:22:03.120 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:22:33.270 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:22:33.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:22:33.276 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:23:03.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:23:03.403 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:23:03.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:23:33.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:23:33.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:23:33.473 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:24:03.601 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:24:03.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:24:03.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:24:33.655 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:24:33.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:24:33.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:25:03.793 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:25:03.797 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:25:03.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:25:33.865 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:25:33.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:25:33.871 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:26:03.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:26:03.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:26:03.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:26:34.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:26:34.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:26:34.114 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:27:04.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:27:04.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:27:04.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:27:34.316 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:27:34.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:27:34.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:28:04.472 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:28:04.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:28:04.478 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:28:34.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:28:34.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:28:34.540 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:29:04.674 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:29:04.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:29:04.680 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:29:34.740 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:29:34.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:29:34.746 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:30:04.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:30:04.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:30:04.821 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:30:34.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:30:34.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:30:34.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:31:05.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:31:05.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:31:05.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:31:35.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:31:35.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:31:35.254 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:32:05.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:32:05.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:32:05.401 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:32:35.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:32:35.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:32:35.536 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:33:05.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:33:05.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:33:05.669 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:33:35.757 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:33:35.761 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:33:35.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:34:05.830 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:34:05.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:34:05.837 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:34:35.899 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:34:35.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:34:35.905 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:35:05.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:35:05.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:35:05.989 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:35:36.120 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:35:36.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:35:36.126 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:36:06.215 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:36:06.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:36:06.221 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:36:36.370 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:36:36.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:36:36.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:37:06.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:37:06.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:37:06.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:37:36.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:37:36.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:37:36.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:38:06.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:38:06.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:38:06.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:38:36.990 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:38:36.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:38:36.996 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:39:07.053 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:39:07.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:39:07.060 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:39:37.138 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:39:37.142 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:39:37.144 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:40:07.282 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:40:07.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:40:07.288 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:40:37.418 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:40:37.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:40:37.427 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:41:07.515 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:41:07.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:41:07.521 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:41:37.668 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:41:37.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:41:37.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:42:07.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:42:07.769 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:42:07.772 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:42:37.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:42:37.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:42:37.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:43:08.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:43:08.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:43:08.275 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:43:38.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:43:38.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:43:38.339 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:44:08.469 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:44:08.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:44:08.478 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:44:38.640 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:44:38.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:44:38.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:45:08.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:45:08.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:45:08.752 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:45:38.895 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:45:38.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:45:38.901 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:46:09.081 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:46:09.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:46:09.088 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:46:39.145 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:46:39.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:46:39.151 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:47:09.291 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:47:09.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:47:09.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:47:39.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:47:39.451 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:47:39.454 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:48:09.576 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:48:09.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:48:09.582 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:48:39.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:48:39.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:48:39.636 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:49:09.786 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:49:09.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:49:09.792 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:49:39.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:49:39.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:49:39.897 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:50:09.979 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:50:09.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:50:09.986 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:50:40.092 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:50:40.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:50:40.099 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:51:10.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:51:10.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:51:10.221 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:51:40.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:51:40.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:51:40.375 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:52:10.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:52:10.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:52:10.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:52:40.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:52:40.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:52:40.585 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:53:10.725 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:53:10.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:53:10.732 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:53:40.863 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:53:40.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:53:40.869 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:54:11.038 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:54:11.041 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:54:11.044 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:54:41.180 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:54:41.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:54:41.186 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:55:11.285 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:55:11.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:55:11.291 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:55:41.415 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:55:41.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:55:41.421 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:56:11.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:56:11.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:56:11.517 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:56:41.675 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:56:41.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:56:41.681 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:57:11.812 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:57:11.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:57:11.818 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:57:41.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:57:41.881 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:57:41.884 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:58:12.013 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:58:12.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:58:12.020 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:58:42.093 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:58:42.097 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:58:42.100 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:59:12.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:59:12.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:59:12.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:59:42.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:59:42.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T15:59:42.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:00:12.453 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:00:12.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:00:12.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:00:42.581 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:00:42.584 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:00:42.587 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:01:12.735 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:01:12.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:01:12.742 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:01:42.841 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:01:42.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:01:42.847 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:02:12.961 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:02:12.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:02:12.968 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:02:43.050 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:02:43.053 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:02:43.057 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:03:13.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:03:13.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:03:13.186 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:03:43.245 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:03:43.248 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:03:43.251 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:04:13.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:04:13.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:04:13.423 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:04:43.489 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:04:43.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:04:43.500 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:05:13.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:05:13.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:05:13.664 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:05:43.755 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:05:43.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:05:43.761 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:06:13.919 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:06:13.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:06:13.925 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:06:44.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:06:44.061 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:06:44.064 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:07:14.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:07:14.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:07:14.221 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:07:44.342 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:07:44.346 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:07:44.349 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:08:14.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:08:14.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:08:14.421 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:08:44.552 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:08:44.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:08:44.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:09:14.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:09:14.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:09:14.734 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:09:44.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:09:44.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:09:44.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:10:14.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:10:14.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:10:14.995 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:10:45.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:10:45.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:10:45.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:11:15.178 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:11:15.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:11:15.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:11:45.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:11:45.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:11:45.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:12:15.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:12:15.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:12:15.437 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:12:45.585 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:12:45.589 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:12:45.592 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:13:15.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:13:15.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:13:15.745 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:13:45.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:13:45.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:13:45.938 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:14:16.023 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:14:16.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:14:16.029 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:14:46.162 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:14:46.165 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:14:46.168 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:15:16.259 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:15:16.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:15:16.265 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:15:46.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:15:46.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:15:46.402 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:16:16.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:16:16.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:16:16.524 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:16:46.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:16:46.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:16:46.654 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:17:16.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:17:16.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:17:16.725 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:17:46.789 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:17:46.792 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:17:46.795 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:18:16.873 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:18:16.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:18:16.879 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:18:47.009 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:18:47.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:18:47.016 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:19:17.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:19:17.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:19:17.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:19:47.244 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:19:47.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:19:47.250 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:20:17.365 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:20:17.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:20:17.372 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:20:47.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:20:47.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:20:47.517 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:21:17.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:21:17.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:21:17.603 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:21:47.763 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:21:47.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:21:47.769 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:22:17.885 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:22:17.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:22:17.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:22:48.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:22:48.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:22:48.229 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:23:18.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:23:18.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:23:18.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:23:48.448 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:23:48.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:23:48.457 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:24:18.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:24:18.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:24:18.567 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:24:48.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:24:48.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:24:48.664 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:25:18.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:25:18.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:25:18.739 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:25:48.801 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:25:48.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:25:48.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:26:18.922 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:26:18.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:26:18.928 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:26:49.051 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:26:49.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:26:49.058 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:27:19.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:27:19.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:27:19.220 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:27:49.361 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:27:49.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:27:49.367 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:28:19.451 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:28:19.455 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:28:19.458 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:28:49.530 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:28:49.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:28:49.538 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:29:19.587 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:29:19.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:29:19.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:29:49.666 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:29:49.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:29:49.672 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:30:19.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:30:19.829 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:30:19.832 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:30:49.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:30:49.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:30:49.945 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:31:20.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:31:20.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:31:20.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:31:50.223 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:31:50.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:31:50.231 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:32:20.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:32:20.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:32:20.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:32:50.423 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:32:50.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:32:50.430 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:33:20.537 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:33:20.540 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:33:20.543 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:33:50.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:33:50.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:33:50.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:34:20.682 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:34:20.685 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:34:20.688 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:34:50.851 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:34:50.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:34:50.857 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:35:20.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:35:21.002 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:35:21.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:35:51.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:35:51.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:35:51.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:36:21.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:36:21.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:36:21.270 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:36:51.334 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:36:51.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:36:51.340 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:37:21.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:37:21.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:37:21.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:37:51.545 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:37:51.549 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:37:51.551 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:38:21.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:38:21.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:38:21.652 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:38:51.763 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:38:51.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:38:51.770 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:39:21.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:39:21.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:39:21.907 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:39:52.014 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:39:52.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:39:52.021 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:40:22.169 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:40:22.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:40:22.175 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:40:52.257 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:40:52.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:40:52.263 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:41:22.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:41:22.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:41:22.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:41:52.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:41:52.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:41:52.566 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:42:22.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:42:22.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:42:22.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:42:52.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:42:52.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:42:52.725 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:43:22.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:43:22.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:43:22.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:43:52.894 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:43:52.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:43:52.900 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:44:23.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:44:23.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:44:23.048 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:44:53.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:44:53.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:44:53.118 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:45:23.275 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:45:23.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:45:23.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:45:53.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:45:53.408 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:45:53.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:46:23.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:46:23.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:46:23.542 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:46:53.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:46:53.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:46:53.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:47:23.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:47:23.692 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:47:23.694 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:47:53.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:47:53.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:47:53.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:48:23.891 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:48:23.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:48:23.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:48:54.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:48:54.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:48:54.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:49:24.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:49:24.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:49:24.162 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:49:54.269 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:49:54.273 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:49:54.276 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:50:24.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:50:24.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:50:24.598 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:50:54.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:50:54.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:50:54.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:51:24.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:51:24.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:51:24.765 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:51:54.838 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:51:54.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:51:54.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:52:24.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:52:24.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:52:24.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:52:55.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:52:55.052 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:52:55.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:53:25.204 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:53:25.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:53:25.210 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:53:55.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:53:55.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:53:55.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:54:25.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:54:25.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:54:25.503 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:54:55.557 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:54:55.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:54:55.564 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:55:25.689 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:55:25.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:55:25.696 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:55:55.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:55:55.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:55:55.818 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:56:25.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:56:25.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:56:25.966 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:56:56.111 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:56:56.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:56:56.118 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:57:26.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:57:26.191 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:57:26.194 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:57:56.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:57:56.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:57:56.336 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:58:26.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:58:26.412 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:58:26.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:58:56.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:58:56.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:58:56.612 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:59:26.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:59:26.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:59:26.682 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:59:56.832 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:59:56.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T16:59:56.838 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:00:26.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:00:26.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:00:26.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:00:57.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:00:57.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:00:57.031 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:01:27.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:01:27.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:01:27.204 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:01:57.334 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:01:57.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:01:57.341 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:02:27.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:02:27.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:02:27.478 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:02:57.548 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:02:57.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:02:57.555 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:03:27.630 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:03:27.634 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:03:27.640 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:03:57.710 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:03:57.713 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:03:57.716 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:04:27.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:04:27.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:04:27.790 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:04:57.939 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:04:57.943 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:04:57.946 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:05:28.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:05:28.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:05:28.051 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:05:58.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:05:58.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:05:58.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:06:28.303 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:06:28.307 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:06:28.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:06:58.432 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:06:58.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:06:58.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:07:28.538 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:07:28.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:07:28.544 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:07:58.684 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:07:58.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:07:58.691 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:08:28.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:08:28.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:08:28.754 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:08:58.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:08:58.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:08:58.934 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:09:29.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:09:29.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:09:29.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:09:59.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:09:59.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:09:59.143 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:10:29.273 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:10:29.277 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:10:29.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:10:59.362 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:10:59.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:10:59.368 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:11:29.491 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:11:29.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:11:29.498 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:11:59.654 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:11:59.658 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:11:59.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:12:29.791 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:12:29.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:12:29.798 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:12:59.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:12:59.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:12:59.937 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:13:30.068 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:13:30.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:13:30.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:14:00.256 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:14:00.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:14:00.263 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:14:30.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:14:30.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:14:30.327 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:15:00.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:15:00.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:15:00.497 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:15:30.628 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:15:30.632 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:15:30.635 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:16:00.740 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:16:00.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:16:00.748 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:16:30.888 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:16:30.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:16:30.894 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:17:01.000 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:17:01.004 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:17:01.006 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:17:31.078 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:17:31.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:17:31.085 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:18:01.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:18:01.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:18:01.225 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:18:31.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:18:31.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:18:31.363 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:19:01.419 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:19:01.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:19:01.426 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:19:31.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:19:31.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:19:31.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:20:01.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:20:01.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:20:01.652 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:20:31.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:20:31.804 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:20:31.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:21:01.880 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:21:01.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:21:01.887 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:21:32.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:21:32.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:21:32.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:22:02.156 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:22:02.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:22:02.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:22:32.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:22:32.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:22:32.267 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:23:02.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:23:02.326 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:23:02.329 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:23:32.453 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:23:32.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:23:32.459 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:24:02.600 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:24:02.603 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:24:02.606 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:24:32.754 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:24:32.758 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:24:32.761 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:25:02.825 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:25:02.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:25:02.831 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:25:32.890 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:25:32.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:25:32.897 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:26:02.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:26:02.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:26:02.999 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:26:33.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:26:33.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:26:33.139 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:27:03.270 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:27:03.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:27:03.283 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:27:33.358 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:27:33.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:27:33.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:28:03.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:28:03.509 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:28:03.512 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:28:33.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:28:33.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:28:33.634 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:29:03.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:29:03.769 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:29:03.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:29:33.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:29:33.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:29:33.860 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:30:04.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:30:04.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:30:04.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:30:34.170 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:30:34.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:30:34.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:31:04.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:31:04.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:31:04.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:31:34.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:31:34.381 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:31:34.384 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:32:04.542 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:32:04.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:32:04.549 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:32:34.679 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:32:34.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:32:34.686 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:33:04.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:33:04.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:33:04.841 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:33:34.948 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:33:34.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:33:34.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:34:05.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:34:05.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:34:05.031 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:34:35.166 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:34:35.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:34:35.172 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:35:05.295 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:35:05.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:35:05.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:35:35.400 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:35:35.403 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:35:35.406 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:36:05.548 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:36:05.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:36:05.555 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:36:35.621 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:36:35.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:36:35.627 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:37:05.759 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:37:05.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:37:05.767 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:37:35.940 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:37:35.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:37:35.946 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:38:06.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:38:06.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:38:06.050 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:38:36.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:38:36.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:38:36.157 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:39:06.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:39:06.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:39:06.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:39:36.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:39:36.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:39:36.398 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:40:06.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:40:06.509 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:40:06.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:40:36.643 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:40:36.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:40:36.650 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:41:06.790 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:41:06.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:41:06.796 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:41:36.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:41:36.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:41:36.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:42:07.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:42:07.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:42:07.084 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:42:37.147 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:42:37.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:42:37.153 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:43:07.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:43:07.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:43:07.225 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:43:37.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:43:37.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:43:37.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:44:07.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:44:07.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:44:07.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:44:37.633 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:44:37.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:44:37.640 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:45:07.763 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:45:07.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:45:07.770 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:45:37.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:45:37.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:45:37.840 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:46:08.007 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:46:08.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:46:08.013 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:46:38.086 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:46:38.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:46:38.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:47:08.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:47:08.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:47:08.173 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:47:38.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:47:38.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:47:38.246 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:48:08.320 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:48:08.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:48:08.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:48:38.390 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:48:38.394 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:48:38.396 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:49:08.466 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:49:08.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:49:08.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:49:38.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:49:38.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:49:38.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:50:08.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:50:08.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:50:08.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:50:38.791 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:50:38.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:50:38.798 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:51:08.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:51:08.886 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:51:08.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:51:38.969 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:51:38.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:51:38.975 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:52:09.106 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:52:09.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:52:09.113 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:52:39.188 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:52:39.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:52:39.194 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:53:09.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:53:09.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:53:09.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:53:39.466 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:53:39.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:53:39.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:54:09.542 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:54:09.546 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:54:09.548 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:54:39.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:54:39.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:54:39.687 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:55:09.747 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:55:09.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:55:09.753 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:55:39.864 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:55:39.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:55:39.870 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:56:09.978 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:56:09.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:56:09.985 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:56:40.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:56:40.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:56:40.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:57:10.238 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:57:10.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:57:10.245 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:57:40.401 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:57:40.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:57:40.407 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:58:10.539 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:58:10.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:58:10.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:58:40.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:58:40.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:58:40.676 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:59:10.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:59:10.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:59:10.789 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:59:40.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:59:40.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T17:59:40.954 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:00:11.041 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:00:11.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:00:11.047 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:00:41.196 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:00:41.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:00:41.202 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:01:11.259 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:01:11.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:01:11.265 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:01:41.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:01:41.393 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:01:41.395 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:02:11.520 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:02:11.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:02:11.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:02:41.599 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:02:41.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:02:41.605 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:03:11.738 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:03:11.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:03:11.745 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:03:41.809 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:03:41.813 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:03:41.816 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:04:11.881 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:04:11.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:04:11.887 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:04:42.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:04:42.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:04:42.026 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:05:12.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:05:12.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:05:12.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:05:42.421 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:05:42.425 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:05:42.427 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:06:12.484 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:06:12.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:06:12.490 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:06:42.631 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:06:42.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:06:42.638 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:07:12.737 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:07:12.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:07:12.744 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:07:42.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:07:42.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:07:42.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:08:12.947 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:08:12.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:08:12.953 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:08:43.061 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:08:43.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:08:43.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:09:13.224 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:09:13.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:09:13.234 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:09:43.294 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:09:43.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:09:43.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:10:13.434 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:10:13.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:10:13.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:10:43.515 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:10:43.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:10:43.521 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:11:13.645 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:11:13.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:11:13.651 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:11:43.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:11:43.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:11:43.766 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:12:13.896 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:12:13.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:12:13.902 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:12:43.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:12:43.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:12:43.986 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:13:14.046 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:13:14.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:13:14.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:13:44.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:13:44.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:13:44.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:14:14.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:14:14.195 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:14:14.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:14:44.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:14:44.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:14:44.278 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:15:14.427 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:15:14.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:15:14.434 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:15:44.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:15:44.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:15:44.506 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:16:14.612 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:16:14.616 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:16:14.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:16:44.742 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:16:44.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:16:44.748 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:17:14.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:17:14.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:17:14.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:17:45.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:17:45.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:17:45.034 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:18:15.157 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:18:15.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:18:15.163 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:18:45.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:18:45.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:18:45.235 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:19:15.300 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:19:15.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:19:15.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:19:45.439 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:19:45.442 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:19:45.445 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:20:15.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:20:15.606 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:20:15.609 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:20:45.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:20:45.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:20:45.755 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:21:15.870 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:21:15.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:21:15.876 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:21:45.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:21:45.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:21:46.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:22:16.122 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:22:16.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:22:16.128 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:22:46.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:22:46.281 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:22:46.284 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:23:16.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:23:16.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:23:16.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:23:46.512 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:23:46.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:23:46.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:24:16.577 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:24:16.581 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:24:16.584 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:24:46.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:24:46.700 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:24:46.702 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:25:16.763 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:25:16.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:25:16.769 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:25:46.906 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:25:46.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:25:46.913 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:26:16.987 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:26:16.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:26:16.993 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:26:47.141 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:26:47.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:26:47.148 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:27:17.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:27:17.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:27:17.285 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:27:47.352 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:27:47.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:27:47.359 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:28:17.441 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:28:17.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:28:17.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:28:47.562 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:28:47.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:28:47.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:29:17.683 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:29:17.686 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:29:17.689 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:29:47.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:29:47.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:29:47.837 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:30:17.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:30:17.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:30:17.916 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:30:48.049 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:30:48.052 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:30:48.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:31:18.179 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:31:18.182 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:31:18.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:31:48.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:31:48.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:31:48.248 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:32:18.339 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:32:18.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:32:18.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:32:48.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:32:48.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:32:48.477 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:33:18.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:33:18.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:33:18.540 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:33:48.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:33:48.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:33:48.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:34:18.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:34:18.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:34:18.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:34:48.874 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:34:48.877 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:34:48.880 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:35:19.020 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:35:19.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:35:19.027 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:35:49.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:35:49.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:35:49.173 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:36:19.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:36:19.225 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:36:19.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:36:49.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:36:49.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:36:49.375 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:37:19.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:37:19.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:37:19.504 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:37:49.620 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:37:49.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:37:49.626 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:38:19.767 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:38:19.771 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:38:19.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:38:49.854 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:38:49.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:38:49.861 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:39:19.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:39:19.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:39:20.002 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:39:50.054 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:39:50.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:39:50.060 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:40:20.126 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:40:20.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:40:20.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:40:50.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:40:50.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:40:50.273 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:41:20.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:41:20.408 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:41:20.411 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:41:50.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:41:50.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:41:50.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:42:20.698 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:42:20.701 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:42:20.704 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:42:50.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:42:50.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:42:50.826 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:43:20.982 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:43:20.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:43:20.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:43:51.231 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:43:51.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:43:51.237 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:44:21.292 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:44:21.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:44:21.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:44:51.398 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:44:51.401 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:44:51.404 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:45:21.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:45:21.548 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:45:21.551 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:45:51.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:45:51.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:45:51.621 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:46:21.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:46:21.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:46:21.752 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:46:51.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:46:51.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:46:51.890 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:47:21.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:47:21.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:47:21.986 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:47:52.066 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:47:52.070 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:47:52.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:48:22.173 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:48:22.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:48:22.179 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:48:52.312 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:48:52.315 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:48:52.318 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:49:22.408 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:49:22.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:49:22.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:49:52.554 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:49:52.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:49:52.561 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:50:22.693 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:50:22.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:50:22.699 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:50:52.756 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:50:52.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:50:52.761 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:51:22.911 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:51:22.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:51:22.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:51:53.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:51:53.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:51:53.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:52:23.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:52:23.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:52:23.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:52:53.335 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:52:53.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:52:53.341 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:53:23.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:53:23.443 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:53:23.446 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:53:53.553 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:53:53.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:53:53.559 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:54:23.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:54:23.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:54:23.706 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:54:53.847 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:54:53.850 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:54:53.853 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:55:24.002 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:55:24.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:55:24.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:55:54.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:55:54.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:55:54.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:56:24.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:56:24.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:56:24.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:56:54.441 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:56:54.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:56:54.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:57:24.563 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:57:24.567 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:57:24.570 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:57:54.693 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:57:54.696 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:57:54.699 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:58:24.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:58:24.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:58:24.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:58:54.905 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:58:54.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:58:54.912 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:59:25.035 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:59:25.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:59:25.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:59:55.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:59:55.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T18:59:55.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:00:25.304 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:00:25.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:00:25.311 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:00:55.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:00:55.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:00:55.422 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:01:25.538 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:01:25.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:01:25.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:01:55.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:01:55.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:01:55.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:02:25.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:02:25.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:02:25.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:02:55.846 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:02:55.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:02:55.852 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:03:25.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:03:25.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:03:25.998 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:03:56.155 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:03:56.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:03:56.161 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:04:26.236 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:04:26.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:04:26.242 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:04:56.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:04:56.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:04:56.355 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:05:26.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:05:26.555 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:05:26.557 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:05:56.624 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:05:56.628 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:05:56.631 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:06:26.731 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:06:26.734 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:06:26.737 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:06:56.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:06:56.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:06:56.883 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:07:26.981 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:07:26.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:07:26.987 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:07:57.078 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:07:57.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:07:57.084 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:08:27.242 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:08:27.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:08:27.248 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:08:57.388 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:08:57.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:08:57.394 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:09:27.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:09:27.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:09:27.541 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:09:57.814 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:09:57.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:09:57.820 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:10:27.886 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:10:27.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:10:27.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:10:58.040 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:10:58.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:10:58.047 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:11:28.197 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:11:28.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:11:28.203 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:11:58.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:11:58.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:11:58.332 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:12:28.431 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:12:28.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:12:28.438 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:12:58.569 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:12:58.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:12:58.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:13:28.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:13:28.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:13:28.723 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:13:58.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:13:58.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:13:58.829 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:14:28.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:14:28.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:14:28.908 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:14:59.174 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:14:59.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:14:59.181 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:15:29.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:15:29.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:15:29.335 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:15:59.426 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:15:59.429 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:15:59.432 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:16:29.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:16:29.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:16:29.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:16:59.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:16:59.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:16:59.642 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:17:29.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:17:29.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:17:29.788 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:17:59.912 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:17:59.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:17:59.919 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:18:29.991 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:18:29.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:18:29.997 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:19:00.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:19:00.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:19:00.070 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:19:30.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:19:30.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:19:30.143 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:20:00.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:20:00.269 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:20:00.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:20:30.341 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:20:30.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:20:30.348 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:21:00.493 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:21:00.496 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:21:00.499 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:21:30.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:21:30.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:21:30.563 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:22:00.736 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:22:00.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:22:00.742 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:22:30.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:22:30.912 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:22:30.915 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:23:01.136 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:23:01.139 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:23:01.142 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:23:31.210 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:23:31.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:23:31.217 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:24:01.349 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:24:01.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:24:01.355 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:24:31.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:24:31.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:24:31.493 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:25:01.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:25:01.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:25:01.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:25:31.806 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:25:31.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:25:31.811 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:26:01.909 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:26:01.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:26:01.916 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:26:32.097 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:26:32.100 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:26:32.103 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:27:02.291 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:27:02.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:27:02.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:27:32.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:27:32.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:27:32.386 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:28:02.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:28:02.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:28:02.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:28:32.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:28:32.596 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:28:32.599 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:29:02.679 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:29:02.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:29:02.686 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:29:32.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:29:32.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:29:32.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:30:02.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:30:02.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:30:02.955 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:30:33.029 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:30:33.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:30:33.035 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:31:03.102 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:31:03.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:31:03.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:31:33.223 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:31:33.226 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:31:33.229 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:32:03.370 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:32:03.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:32:03.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:32:33.444 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:32:33.447 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:32:33.450 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:33:03.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:33:03.575 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:33:03.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:33:33.635 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:33:33.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:33:33.641 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:34:03.782 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:34:03.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:34:03.788 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:34:33.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:34:33.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:34:33.926 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:35:04.016 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:35:04.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:35:04.023 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:35:34.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:35:34.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:35:34.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:36:04.268 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:36:04.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:36:04.275 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:36:34.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:36:34.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:36:34.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:37:04.495 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:37:04.498 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:37:04.501 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:37:34.667 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:37:34.670 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:37:34.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:38:04.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:38:04.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:38:04.827 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:38:34.960 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:38:34.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:38:34.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:39:05.115 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:39:05.118 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:39:05.121 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:39:35.444 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:39:35.448 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:39:35.450 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:40:05.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:40:05.594 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:40:05.597 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:40:35.671 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:40:35.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:40:35.677 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:41:05.746 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:41:05.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:41:05.752 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:41:35.822 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:41:35.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:41:35.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:42:05.907 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:42:05.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:42:05.913 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:42:36.001 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:42:36.004 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:42:36.007 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:43:06.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:43:06.074 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:43:06.077 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:43:36.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:43:36.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:43:36.224 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:44:06.347 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:44:06.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:44:06.353 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:44:36.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:44:36.416 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:44:36.419 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:45:06.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:45:06.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:45:06.505 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:45:36.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:45:36.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:45:36.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:46:06.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:46:06.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:46:06.782 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:46:36.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:46:36.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:46:36.921 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:47:07.044 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:47:07.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:47:07.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:47:37.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:47:37.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:47:37.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:48:07.229 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:48:07.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:48:07.235 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:48:37.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:48:37.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:48:37.392 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:49:07.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:49:07.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:49:07.539 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:49:37.679 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:49:37.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:49:37.686 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:50:07.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:50:07.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:50:07.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:50:37.881 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:50:37.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:50:37.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:51:07.995 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:51:07.999 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:51:08.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:51:38.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:51:38.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:51:38.123 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:52:08.177 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:52:08.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:52:08.184 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:52:38.261 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:52:38.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:52:38.268 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:53:08.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:53:08.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:53:08.398 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:53:38.454 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:53:38.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:53:38.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:54:08.544 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:54:08.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:54:08.550 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:54:38.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:54:38.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:54:38.664 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:55:08.805 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:55:08.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:55:08.812 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:55:38.868 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:55:38.872 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:55:38.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:56:09.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:56:09.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:56:09.016 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:56:39.071 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:56:39.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:56:39.077 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:57:09.216 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:57:09.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:57:09.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:57:39.354 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:57:39.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:57:39.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:58:09.483 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:58:09.487 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:58:09.489 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:58:39.605 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:58:39.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:58:39.612 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:59:09.769 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:59:09.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:59:09.776 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:59:39.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:59:39.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T19:59:39.922 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:00:09.988 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:00:09.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:00:09.994 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:00:40.101 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:00:40.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:00:40.107 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:01:10.302 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:01:10.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:01:10.309 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:01:40.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:01:40.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:01:40.375 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:02:10.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:02:10.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:02:10.498 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:02:40.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:02:40.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:02:40.654 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:03:10.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:03:10.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:03:10.782 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:03:40.914 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:03:40.917 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:03:40.920 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:04:11.019 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:04:11.022 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:04:11.025 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:04:41.149 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:04:41.152 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:04:41.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:05:11.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:05:11.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:05:11.287 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:05:41.363 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:05:41.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:05:41.369 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:06:11.458 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:06:11.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:06:11.464 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:06:41.527 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:06:41.531 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:06:41.533 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:07:11.601 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:07:11.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:07:11.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:07:41.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:07:41.709 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:07:41.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:08:11.770 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:08:11.776 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:08:11.780 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:08:41.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:08:41.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:08:41.856 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:09:11.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:09:11.949 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:09:11.951 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:09:42.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:09:42.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:09:42.032 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:10:12.140 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:10:12.144 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:10:12.147 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:10:42.262 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:10:42.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:10:42.268 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:11:12.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:11:12.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:11:12.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:11:42.464 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:11:42.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:11:42.470 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:12:12.577 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:12:12.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:12:12.582 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:12:42.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:12:42.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:12:42.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:13:12.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:13:12.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:13:12.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:13:42.864 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:13:42.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:13:42.870 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:14:12.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:14:12.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:14:12.970 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:14:43.103 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:14:43.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:14:43.109 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:15:13.171 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:15:13.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:15:13.177 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:15:43.332 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:15:43.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:15:43.338 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:16:13.394 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:16:13.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:16:13.401 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:16:43.508 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:16:43.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:16:43.514 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:17:13.647 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:17:13.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:17:13.654 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:17:43.819 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:17:43.822 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:17:43.825 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:18:13.931 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:18:13.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:18:13.937 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:18:44.053 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:18:44.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:18:44.059 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:19:14.208 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:19:14.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:19:14.214 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:19:44.354 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:19:44.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:19:44.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:20:14.467 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:20:14.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:20:14.474 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:20:44.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:20:44.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:20:44.855 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:21:14.935 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:21:14.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:21:14.941 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:21:45.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:21:45.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:21:45.114 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:22:15.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:22:15.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:22:15.218 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:22:45.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:22:45.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:22:45.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:23:15.414 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:23:15.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:23:15.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:23:45.536 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:23:45.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:23:45.556 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:24:15.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:24:15.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:24:15.706 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:24:45.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:24:45.848 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:24:45.851 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:25:15.966 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:25:15.970 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:25:15.973 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:25:46.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:25:46.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:25:46.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:26:16.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:26:16.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:26:16.239 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:26:46.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:26:46.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:26:46.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:27:16.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:27:16.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:27:16.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:27:46.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:27:46.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:27:46.623 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:28:16.745 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:28:16.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:28:16.751 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:28:46.850 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:28:46.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:28:46.856 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:29:17.004 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:29:17.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:29:17.011 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:29:47.108 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:29:47.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:29:47.114 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:30:17.182 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:30:17.185 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:30:17.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:30:47.385 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:30:47.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:30:47.392 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:31:17.523 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:31:17.526 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:31:17.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:31:47.669 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:31:47.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:31:47.676 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:32:17.765 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:32:17.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:32:17.771 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:32:47.845 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:32:47.848 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:32:47.851 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:33:17.975 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:33:17.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:33:17.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:33:48.038 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:33:48.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:33:48.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:34:18.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:34:18.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:34:18.165 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:34:48.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:34:48.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:34:48.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:35:18.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:35:18.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:35:18.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:35:48.457 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:35:48.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:35:48.463 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:36:18.606 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:36:18.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:36:18.613 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:36:48.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:36:48.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:36:48.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:37:18.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:37:18.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:37:18.844 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:37:48.927 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:37:48.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:37:48.933 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:38:19.049 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:38:19.052 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:38:19.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:38:49.187 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:38:49.191 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:38:49.194 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:39:19.386 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:39:19.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:39:19.392 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:39:49.458 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:39:49.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:39:49.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:40:19.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:40:19.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:40:19.600 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:40:49.740 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:40:49.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:40:49.746 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:41:19.886 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:41:19.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:41:19.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:41:49.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:41:49.953 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:41:49.956 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:42:20.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:42:20.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:42:20.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:42:50.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:42:50.230 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:42:50.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:43:20.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:43:20.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:43:20.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:43:50.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:43:50.506 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:43:50.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:44:20.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:44:20.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:44:20.597 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:44:50.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:44:50.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:44:50.736 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:45:20.859 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:45:20.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:45:20.866 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:45:50.989 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:45:50.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:45:50.994 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:46:21.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:46:21.147 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:46:21.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:46:51.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:46:51.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:46:51.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:47:21.368 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:47:21.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:47:21.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:47:51.516 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:47:51.519 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:47:51.522 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:48:21.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:48:21.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:48:21.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:48:51.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:48:51.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:48:51.805 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:49:21.938 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:49:21.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:49:21.945 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:49:52.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:49:52.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:49:52.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:50:22.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:50:22.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:50:22.212 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:50:52.327 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:50:52.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:50:52.333 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:51:22.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:51:22.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:51:22.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:51:52.578 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:51:52.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:51:52.585 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:52:22.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:52:22.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:52:22.696 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:52:52.771 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:52:52.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:52:52.777 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:53:22.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:53:22.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:53:22.906 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:53:52.997 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:53:53.000 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:53:53.003 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:54:23.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:54:23.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:54:23.141 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:54:53.248 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:54:53.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:54:53.254 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:55:23.369 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:55:23.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:55:23.375 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:55:53.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:55:53.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:55:53.505 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:56:23.629 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:56:23.632 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:56:23.634 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:56:53.732 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:56:53.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:56:53.739 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:57:23.863 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:57:23.866 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:57:23.869 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:57:54.027 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:57:54.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:57:54.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:58:24.089 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:58:24.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:58:24.095 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:58:54.219 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:58:54.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:58:54.225 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:59:24.306 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:59:24.309 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:59:24.311 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:59:54.389 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:59:54.393 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T20:59:54.396 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:00:24.459 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:00:24.462 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:00:24.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:00:54.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:00:54.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:00:54.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:01:24.634 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:01:24.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:01:24.640 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:01:54.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:01:54.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:01:54.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:02:24.928 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:02:24.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:02:24.935 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:02:55.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:02:55.094 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:02:55.097 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:03:25.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:03:25.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:03:25.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:03:55.367 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:03:55.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:03:55.373 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:04:25.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:04:25.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:04:25.453 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:04:55.618 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:04:55.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:04:55.624 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:05:25.772 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:05:25.775 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:05:25.777 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:05:55.901 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:05:55.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:05:55.908 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:06:26.048 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:06:26.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:06:26.054 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:06:56.119 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:06:56.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:06:56.125 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:07:26.194 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:07:26.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:07:26.200 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:07:56.329 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:07:56.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:07:56.335 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:08:26.450 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:08:26.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:08:26.456 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:08:56.597 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:08:56.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:08:56.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:09:26.762 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:09:26.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:09:26.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:09:56.898 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:09:56.902 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:09:56.905 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:10:27.028 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:10:27.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:10:27.034 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:10:57.167 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:10:57.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:10:57.173 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:11:27.313 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:11:27.317 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:11:27.319 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:11:57.468 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:11:57.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:11:57.474 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:12:27.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:12:27.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:12:27.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:12:57.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:12:57.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:12:57.667 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:13:27.766 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:13:27.769 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:13:27.771 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:13:57.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:13:57.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:13:57.926 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:14:28.067 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:14:28.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:14:28.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:14:58.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:14:58.217 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:14:58.219 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:15:28.307 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:15:28.310 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:15:28.313 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:15:58.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:15:58.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:15:58.378 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:16:28.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:16:28.522 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:16:28.525 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:16:58.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:16:58.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:16:58.655 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:17:28.804 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:17:28.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:17:28.812 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:17:58.959 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:17:58.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:17:58.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:18:29.032 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:18:29.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:18:29.038 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:18:59.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:18:59.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:18:59.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:19:29.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:19:29.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:19:29.330 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:19:59.461 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:19:59.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:19:59.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:20:29.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:20:29.555 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:20:29.558 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:20:59.625 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:20:59.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:20:59.632 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:21:29.711 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:21:29.720 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:21:29.723 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:21:59.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:21:59.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:21:59.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:22:29.868 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:22:29.872 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:22:29.875 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:22:59.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:22:59.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:22:59.963 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:23:30.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:23:30.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:23:30.051 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:24:00.132 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:24:00.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:24:00.138 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:24:30.213 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:24:30.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:24:30.219 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:25:00.350 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:25:00.354 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:25:00.357 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:25:30.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:25:30.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:25:30.495 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:26:00.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:26:00.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:26:00.582 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:26:30.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:26:30.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:26:30.653 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:27:00.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:27:00.721 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:27:00.723 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:27:30.807 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:27:30.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:27:30.813 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:28:00.887 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:28:00.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:28:00.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:28:30.975 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:28:30.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:28:30.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:29:01.106 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:29:01.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:29:01.112 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:29:31.234 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:29:31.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:29:31.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:30:01.372 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:30:01.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:30:01.378 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:30:31.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:30:31.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:30:31.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:31:01.614 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:31:01.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:31:01.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:31:31.769 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:31:31.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:31:31.775 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:32:01.924 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:32:01.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:32:01.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:32:31.994 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:32:31.997 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:32:32.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:33:02.082 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:33:02.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:33:02.088 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:33:32.222 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:33:32.225 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:33:32.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:34:02.326 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:34:02.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:34:02.333 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:34:32.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:34:32.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:34:32.533 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:35:02.677 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:35:02.680 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:35:02.683 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:35:32.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:35:32.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:35:32.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:36:02.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:36:02.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:36:02.977 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:36:33.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:36:33.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:36:33.049 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:37:03.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:37:03.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:37:03.137 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:37:33.277 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:37:33.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:37:33.283 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:38:03.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:38:03.443 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:38:03.446 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:38:33.519 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:38:33.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:38:33.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:39:03.658 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:39:03.661 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:39:03.664 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:39:33.788 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:39:33.791 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:39:33.794 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:40:03.926 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:40:03.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:40:03.932 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:40:34.159 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:40:34.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:40:34.165 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:41:04.279 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:41:04.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:41:04.285 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:41:34.392 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:41:34.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:41:34.398 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:42:04.556 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:42:04.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:42:04.562 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:42:34.668 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:42:34.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:42:34.675 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:43:04.840 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:43:04.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:43:04.846 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:43:34.961 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:43:34.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:43:34.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:44:05.091 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:44:05.094 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:44:05.097 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:44:35.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:44:35.225 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:44:35.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:45:05.333 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:45:05.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:45:05.341 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:45:35.473 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:45:35.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:45:35.479 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:46:05.568 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:46:05.571 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:46:05.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:46:35.690 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:46:35.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:46:35.697 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:47:05.820 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:47:05.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:47:05.827 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:47:35.975 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:47:35.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:47:35.981 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:48:06.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:48:06.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:48:06.118 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:48:36.243 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:48:36.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:48:36.249 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:49:06.380 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:49:06.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:49:06.386 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:49:36.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:49:36.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:49:36.542 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:50:06.610 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:50:06.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:50:06.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:50:36.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:50:36.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:50:36.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:51:06.823 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:51:06.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:51:06.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:51:36.937 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:51:36.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:51:36.943 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:52:07.075 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:52:07.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:52:07.081 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:52:37.163 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:52:37.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:52:37.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:53:07.264 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:53:07.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:53:07.270 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:53:37.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:53:37.493 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:53:37.496 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:54:07.636 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:54:07.640 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:54:07.642 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:54:37.733 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:54:37.736 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:54:37.739 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:55:07.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:55:07.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:55:07.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:55:37.941 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:55:37.945 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:55:37.948 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:56:08.080 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:56:08.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:56:08.086 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:56:38.201 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:56:38.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:56:38.208 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:57:08.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:57:08.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:57:08.329 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:57:38.453 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:57:38.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:57:38.459 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:58:08.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:58:08.619 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:58:08.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:58:38.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:58:38.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:58:38.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:59:08.834 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:59:08.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:59:08.840 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:59:38.909 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:59:38.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T21:59:38.915 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:00:08.984 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:00:08.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:00:08.990 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:00:39.064 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:00:39.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:00:39.070 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:01:09.135 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:01:09.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:01:09.142 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:01:39.217 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:01:39.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:01:39.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:02:09.291 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:02:09.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:02:09.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:02:39.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:02:39.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:02:39.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:03:09.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:03:09.443 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:03:09.446 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:03:39.593 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:03:39.596 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:03:39.599 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:04:09.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:04:09.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:04:09.755 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:04:39.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:04:39.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:04:39.827 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:05:09.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:05:09.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:05:09.980 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:05:40.070 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:05:40.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:05:40.076 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:06:10.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:06:10.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:06:10.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:06:40.355 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:06:40.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:06:40.361 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:07:10.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:07:10.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:07:10.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:07:40.639 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:07:40.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:07:40.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:08:10.794 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:08:10.797 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:08:10.800 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:08:40.924 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:08:40.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:08:40.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:09:11.062 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:09:11.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:09:11.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:09:41.216 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:09:41.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:09:41.221 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:10:11.296 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:10:11.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:10:11.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:10:41.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:10:41.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:10:41.423 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:11:11.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:11:11.575 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:11:11.578 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:11:41.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:11:41.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:11:41.700 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:12:11.789 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:12:11.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:12:11.795 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:12:41.869 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:12:41.874 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:12:41.878 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:13:11.968 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:13:11.972 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:13:11.975 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:13:42.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:13:42.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:13:42.137 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:14:12.263 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:14:12.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:14:12.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:14:42.381 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:14:42.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:14:42.387 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:15:12.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:15:12.542 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:15:12.545 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:15:42.681 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:15:42.685 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:15:42.688 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:16:12.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:16:12.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:16:12.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:16:42.974 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:16:42.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:16:42.980 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:17:13.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:17:13.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:17:13.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:17:43.218 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:17:43.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:17:43.224 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:18:13.347 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:18:13.351 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:18:13.353 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:18:43.453 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:18:43.456 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:18:43.458 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:19:13.566 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:19:13.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:19:13.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:19:43.696 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:19:43.700 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:19:43.703 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:20:13.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:20:13.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:20:13.764 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:20:43.897 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:20:43.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:20:43.903 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:21:14.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:21:14.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:21:14.042 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:21:44.113 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:21:44.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:21:44.119 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:22:14.190 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:22:14.193 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:22:14.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:22:44.265 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:22:44.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:22:44.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:23:14.361 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:23:14.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:23:14.368 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:23:44.433 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:23:44.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:23:44.439 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:24:14.496 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:24:14.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:24:14.502 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:24:44.616 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:24:44.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:24:44.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:25:14.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:25:14.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:25:14.736 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:25:44.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:25:44.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:25:44.809 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:26:14.956 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:26:14.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:26:14.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:26:45.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:26:45.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:26:45.060 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:27:15.299 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:27:15.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:27:15.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:27:45.445 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:27:45.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:27:45.451 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:28:15.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:28:15.553 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:28:15.556 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:28:45.730 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:28:45.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:28:45.736 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:29:15.884 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:29:15.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:29:15.890 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:29:45.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:29:45.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:29:45.982 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:30:16.068 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:30:16.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:30:16.075 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:30:46.278 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:30:46.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:30:46.284 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:31:16.342 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:31:16.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:31:16.348 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:31:46.465 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:31:46.469 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:31:46.471 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:32:16.615 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:32:16.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:32:16.621 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:32:46.849 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:32:46.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:32:46.855 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:33:16.924 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:33:16.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:33:16.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:33:47.068 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:33:47.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:33:47.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:34:17.131 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:34:17.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:34:17.137 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:34:47.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:34:47.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:34:47.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:35:17.399 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:35:17.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:35:17.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:35:47.487 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:35:47.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:35:47.495 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:36:17.560 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:36:17.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:36:17.568 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:36:47.664 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:36:47.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:36:47.670 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:37:17.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:37:17.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:37:17.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:37:47.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:37:47.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:37:47.895 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:38:18.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:38:18.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:38:18.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:38:48.175 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:38:48.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:38:48.180 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:39:18.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:39:18.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:39:18.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:39:48.371 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:39:48.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:39:48.377 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:40:18.443 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:40:18.447 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:40:18.450 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:40:48.517 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:40:48.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:40:48.523 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:41:18.589 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:41:18.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:41:18.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:41:48.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:41:48.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:41:48.677 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:42:18.744 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:42:18.747 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:42:18.750 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:42:48.824 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:42:48.827 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:42:48.831 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:43:18.967 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:43:18.970 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:43:18.973 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:43:49.045 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:43:49.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:43:49.051 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:44:19.226 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:44:19.229 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:44:19.232 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:44:49.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:44:49.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:44:49.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:45:19.543 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:45:19.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:45:19.549 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:45:49.607 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:45:49.611 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:45:49.614 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:46:19.753 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:46:19.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:46:19.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:46:49.817 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:46:49.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:46:49.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:47:19.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:47:19.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:47:19.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:47:50.085 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:47:50.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:47:50.091 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:48:20.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:48:20.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:48:20.220 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:48:50.361 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:48:50.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:48:50.367 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:49:20.457 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:49:20.460 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:49:20.463 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:49:50.595 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:49:50.599 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:49:50.602 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:50:20.734 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:50:20.737 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:50:20.740 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:50:50.838 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:50:50.841 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:50:50.844 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:51:20.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:51:20.979 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:51:20.982 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:51:51.105 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:51:51.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:51:51.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:52:21.228 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:52:21.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:52:21.234 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:52:51.325 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:52:51.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:52:51.331 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:53:21.420 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:53:21.425 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:53:21.427 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:53:51.486 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:53:51.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:53:51.492 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:54:21.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:54:21.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:54:21.630 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:54:51.761 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:54:51.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:54:51.767 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:55:21.882 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:55:21.886 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:55:21.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:55:52.015 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:55:52.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:55:52.021 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:56:22.166 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:56:22.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:56:22.172 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:56:52.407 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:56:52.411 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:56:52.414 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:57:22.470 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:57:22.473 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:57:22.476 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:57:52.541 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:57:52.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:57:52.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:58:22.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:58:22.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:58:22.694 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:58:52.810 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:58:52.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:58:52.816 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:59:22.957 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:59:22.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:59:22.963 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:59:53.061 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:59:53.065 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T22:59:53.068 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:00:23.199 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:00:23.202 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:00:23.204 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:00:53.354 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:00:53.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:00:53.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:01:23.418 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:01:23.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:01:23.424 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:01:53.514 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:01:53.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:01:53.520 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:02:23.652 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:02:23.655 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:02:23.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:02:53.799 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:02:53.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:02:53.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:03:23.971 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:03:23.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:03:23.977 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:03:54.100 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:03:54.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:03:54.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:04:24.246 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:04:24.249 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:04:24.252 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:04:54.410 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:04:54.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:04:54.416 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:05:24.572 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:05:24.575 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:05:24.578 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:05:54.660 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:05:54.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:05:54.667 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:06:24.815 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:06:24.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:06:24.821 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:06:54.953 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:06:54.956 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:06:54.959 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:07:25.082 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:07:25.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:07:25.088 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:07:55.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:07:55.224 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:07:55.226 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:08:25.334 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:08:25.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:08:25.343 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:08:55.497 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:08:55.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:08:55.504 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:09:25.569 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:09:25.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:09:25.575 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:09:55.699 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:09:55.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:09:55.705 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:10:25.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:10:25.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:10:25.782 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:10:55.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:10:55.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:10:55.854 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:11:25.922 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:11:25.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:11:25.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:11:56.010 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:11:56.014 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:11:56.016 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:12:26.072 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:12:26.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:12:26.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:12:56.139 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:12:56.143 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:12:56.145 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:13:26.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:13:26.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:13:26.219 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:13:56.287 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:13:56.290 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:13:56.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:14:26.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:14:26.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:14:26.363 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:14:56.533 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:14:56.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:14:56.539 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:15:26.602 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:15:26.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:15:26.608 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:15:56.676 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:15:56.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:15:56.683 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:16:26.748 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:16:26.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:16:26.755 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:16:56.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:16:56.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:16:56.828 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:17:26.910 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:17:26.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:17:26.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:17:56.983 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:17:56.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:17:56.989 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:18:27.072 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:18:27.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:18:27.078 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:18:57.153 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:18:57.157 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:18:57.160 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:19:27.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:19:27.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:19:27.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:19:57.323 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:19:57.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:19:57.329 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:20:27.404 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:20:27.408 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:20:27.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:20:57.478 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:20:57.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:20:57.483 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:21:27.550 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:21:27.554 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:21:27.556 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:21:57.623 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:21:57.625 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:21:57.628 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:22:27.704 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:22:27.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:22:27.710 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:22:57.778 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:22:57.781 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:22:57.784 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:23:27.868 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:23:27.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:23:27.874 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:23:57.956 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:23:57.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:23:57.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:24:28.037 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:24:28.040 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:24:28.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:24:58.117 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:24:58.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:24:58.124 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:25:28.192 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:25:28.195 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:25:28.198 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:25:58.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:25:58.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:25:58.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:26:28.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:26:28.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:26:28.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:26:58.417 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:26:58.420 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:26:58.423 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:27:28.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:27:28.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:27:28.505 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:27:58.561 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:27:58.565 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:27:58.567 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:28:28.651 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:28:28.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:28:28.657 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:28:58.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:28:58.730 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:28:58.732 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:29:28.800 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:29:28.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:29:28.805 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:29:58.879 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:29:58.882 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:29:58.885 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:30:28.953 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:30:28.956 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:30:28.959 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:30:59.025 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:30:59.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:30:59.030 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:31:29.087 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:31:29.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:31:29.093 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:31:59.161 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:31:59.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:31:59.167 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:32:29.227 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:32:29.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:32:29.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:32:59.293 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:32:59.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:32:59.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:33:29.356 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:33:29.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:33:29.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:33:59.428 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:33:59.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:33:59.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:34:29.501 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:34:29.504 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:34:29.507 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:34:59.570 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:34:59.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:34:59.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:35:29.663 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:35:29.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:35:29.669 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:35:59.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:35:59.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:35:59.826 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:36:29.951 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:36:29.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:36:29.958 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:37:00.098 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:37:00.101 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:37:00.104 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:37:30.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:37:30.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:37:30.242 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:38:00.357 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:38:00.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:38:00.363 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:38:30.463 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:38:30.466 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:38:30.469 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:39:00.582 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:39:00.585 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:39:00.588 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:39:30.687 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:39:30.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:39:30.693 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:40:00.776 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:40:00.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:40:00.782 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:40:30.853 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:40:30.856 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:40:30.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:41:00.943 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:41:00.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:41:00.949 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:41:31.019 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:41:31.023 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:41:31.026 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:42:01.104 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:42:01.107 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:42:01.110 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:42:31.183 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:42:31.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:42:31.189 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:43:01.272 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:43:01.276 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:43:01.278 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:43:31.353 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:43:31.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:43:31.359 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:44:01.442 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:44:01.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:44:01.448 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:44:31.507 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:44:31.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:44:31.513 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:45:01.598 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:45:01.601 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:45:01.604 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:45:31.672 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:45:31.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:45:31.678 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:46:01.758 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:46:01.761 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:46:01.764 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:46:31.839 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:46:31.842 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:46:31.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:47:01.915 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:47:01.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:47:01.921 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:47:31.976 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:47:31.980 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:47:31.983 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:48:02.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:48:02.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:48:02.059 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:48:32.122 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:48:32.126 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:48:32.128 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:49:02.239 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:49:02.242 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:49:02.245 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:49:32.309 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:49:32.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:49:32.315 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:50:02.447 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:50:02.451 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:50:02.453 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:50:32.702 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:50:32.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:50:32.707 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:51:02.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:51:02.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:51:02.770 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:51:32.833 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:51:32.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:51:32.839 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:52:02.908 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:52:02.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:52:02.914 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:52:32.977 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:52:32.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:52:32.983 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:53:03.062 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:53:03.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:53:03.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:53:33.148 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:53:33.152 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:53:33.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:54:03.221 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:54:03.225 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:54:03.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:54:33.319 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:54:33.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:54:33.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:55:03.396 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:55:03.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:55:03.402 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:55:33.460 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:55:33.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:55:33.466 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:56:03.524 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:56:03.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:56:03.530 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:56:33.816 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:56:33.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:56:33.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:57:03.954 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:57:03.958 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:57:03.960 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:57:34.234 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:57:34.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:57:34.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:58:04.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:58:04.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:58:04.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:58:34.502 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:58:34.506 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:58:34.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:59:04.632 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:59:04.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:59:04.638 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:59:34.724 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:59:34.727 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-06T23:59:34.729 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:00:04.796 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:00:04.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:00:04.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:00:34.920 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:00:34.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:00:34.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:01:04.992 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:01:04.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:01:04.998 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:01:35.071 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:01:35.074 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:01:35.077 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:02:05.144 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:02:05.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:02:05.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:02:35.241 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:02:35.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:02:35.249 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:03:05.316 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:03:05.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:03:05.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:03:35.383 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:03:35.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:03:35.389 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:04:05.454 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:04:05.458 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:04:05.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:04:35.535 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:04:35.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:04:35.541 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:05:05.625 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:05:05.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:05:05.631 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:05:35.729 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:05:35.732 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:05:35.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:06:05.802 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:06:05.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:06:05.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:06:35.877 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:06:35.881 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:06:35.884 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:07:05.930 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:07:05.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:07:05.936 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:07:36.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:07:36.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:07:36.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:08:06.118 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:08:06.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:08:06.124 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:08:36.195 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:08:36.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:08:36.201 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:09:06.276 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:09:06.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:09:06.283 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:09:36.340 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:09:36.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:09:36.346 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:10:06.405 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:10:06.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:10:06.412 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:10:36.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:10:36.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:10:36.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:11:06.574 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:11:06.577 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:11:06.581 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:11:36.646 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:11:36.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:11:36.652 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:12:06.719 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:12:06.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:12:06.726 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:12:36.783 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:12:36.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:12:36.789 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:13:06.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:13:06.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:13:06.854 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:13:36.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:13:36.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:13:36.950 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:14:07.034 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:14:07.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:14:07.041 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:14:37.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:14:37.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:14:37.143 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:15:07.212 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:15:07.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:15:07.218 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:15:37.284 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:15:37.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:15:37.290 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:16:07.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:16:07.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:16:07.366 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:16:37.440 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:16:37.444 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:16:37.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:17:07.511 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:17:07.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:17:07.517 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:17:37.583 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:17:37.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:17:37.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:18:07.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:18:07.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:18:07.656 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:18:37.780 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:18:37.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:18:37.787 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:19:07.844 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:19:07.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:19:07.850 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:19:37.916 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:19:37.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:19:37.923 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:20:07.989 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:20:07.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:20:07.998 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:20:38.145 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:20:38.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:20:38.152 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:21:08.207 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:21:08.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:21:08.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:21:38.346 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:21:38.349 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:21:38.352 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:22:08.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:22:08.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:22:08.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:22:38.522 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:22:38.526 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:22:38.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:23:08.643 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:23:08.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:23:08.649 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:23:38.764 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:23:38.768 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:23:38.770 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:24:08.886 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:24:08.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:24:08.892 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:24:38.949 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:24:38.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:24:38.955 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:25:09.112 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:25:09.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:25:09.118 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:25:39.266 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:25:39.269 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:25:39.271 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:26:09.354 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:26:09.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:26:09.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:26:39.492 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:26:39.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:26:39.498 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:27:09.575 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:27:09.578 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:27:09.581 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:27:39.694 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:27:39.697 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:27:39.699 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:28:09.762 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:28:09.766 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:28:09.769 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:28:39.835 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:28:39.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:28:39.841 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:29:09.932 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:29:09.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:29:09.938 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:29:40.005 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:29:40.009 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:29:40.012 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:30:10.151 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:30:10.155 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:30:10.158 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:30:40.297 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:30:40.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:30:40.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:31:10.360 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:31:10.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:31:10.366 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:31:40.506 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:31:40.510 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:31:40.514 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:32:10.638 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:32:10.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:32:10.644 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:32:40.749 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:32:40.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:32:40.755 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:33:10.821 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:33:10.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:33:10.829 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:33:40.950 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:33:40.954 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:33:40.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:34:11.032 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:34:11.036 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:34:11.039 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:34:41.184 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:34:41.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:34:41.191 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:35:11.288 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:35:11.292 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:35:11.295 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:35:41.438 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:35:41.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:35:41.444 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:36:11.499 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:36:11.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:36:11.506 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:36:41.591 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:36:41.595 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:36:41.597 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:37:11.657 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:37:11.660 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:37:11.663 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:37:41.728 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:37:41.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:37:41.734 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:38:11.797 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:38:11.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:38:11.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:38:41.921 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:38:41.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:38:41.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:39:12.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:39:12.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:39:12.058 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:39:42.137 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:39:42.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:39:42.143 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:40:12.211 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:40:12.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:40:12.217 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:40:42.286 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:40:42.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:40:42.292 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:41:12.359 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:41:12.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:41:12.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:41:42.428 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:41:42.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:41:42.434 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:42:12.504 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:42:12.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:42:12.511 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:42:42.573 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:42:42.577 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:42:42.579 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:43:12.649 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:43:12.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:43:12.655 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:43:42.727 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:43:42.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:43:42.734 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:44:12.803 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:44:12.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:44:12.809 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:44:42.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:44:42.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:44:42.895 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:45:12.964 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:45:12.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:45:12.970 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:45:43.052 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:45:43.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:45:43.058 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:46:13.127 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:46:13.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:46:13.133 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:46:43.206 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:46:43.210 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:46:43.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:47:13.280 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:47:13.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:47:13.286 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:47:43.377 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:47:43.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:47:43.383 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:48:13.435 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:48:13.437 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:48:13.440 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:48:43.490 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:48:43.493 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:48:43.496 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:49:13.554 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:49:13.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:49:13.560 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:49:43.626 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:49:43.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:49:43.632 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:50:13.707 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:50:13.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:50:13.713 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:50:43.792 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:50:43.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:50:43.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:51:13.861 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:51:13.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:51:13.868 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:51:43.934 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:51:43.938 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:51:43.941 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:52:14.006 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:52:14.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:52:14.012 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:52:44.095 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:52:44.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:52:44.101 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:53:14.168 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:53:14.172 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:53:14.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:53:44.254 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:53:44.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:53:44.261 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:54:14.318 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:54:14.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:54:14.324 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:54:44.403 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:54:44.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:54:44.409 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:55:14.477 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:55:14.480 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:55:14.484 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:55:44.549 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:55:44.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:55:44.555 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:56:14.637 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:56:14.640 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:56:14.642 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:56:44.717 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:56:44.721 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:56:44.723 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:57:14.798 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:57:14.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:57:14.804 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:57:44.881 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:57:44.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:57:44.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:58:14.956 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:58:14.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:58:14.962 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:58:45.018 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:58:45.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:58:45.024 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:59:15.088 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:59:15.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:59:15.094 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:59:45.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:59:45.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T00:59:45.169 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:00:15.233 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:00:15.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:00:15.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:00:45.319 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:00:45.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:00:45.325 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:01:15.413 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:01:15.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:01:15.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:01:45.485 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:01:45.488 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:01:45.491 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:02:15.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:02:15.555 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:02:15.557 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:02:45.628 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:02:45.632 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:02:45.637 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:03:15.700 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:03:15.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:03:15.707 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:03:45.775 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:03:45.779 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:03:45.781 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:04:15.848 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:04:15.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:04:15.854 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:04:45.925 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:04:45.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:04:45.931 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:05:15.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:05:15.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:05:15.999 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:05:46.063 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:05:46.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:05:46.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:06:16.164 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:06:16.168 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:06:16.170 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:06:46.235 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:06:46.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:06:46.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:07:16.308 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:07:16.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:07:16.315 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:07:46.373 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:07:46.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:07:46.380 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:08:16.462 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:08:16.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:08:16.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:08:46.518 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:08:46.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:08:46.524 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:09:16.618 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:09:16.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:09:16.624 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:09:46.706 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:09:46.709 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:09:46.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:10:16.786 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:10:16.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:10:16.792 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:10:46.875 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:10:46.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:10:46.881 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:11:16.963 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:11:16.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:11:16.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:11:47.032 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:11:47.036 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:11:47.040 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:12:17.128 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:12:17.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:12:17.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:12:47.202 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:12:47.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:12:47.208 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:13:17.271 DEBUG:teuthology.orchestra.run.smithi038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:13:17.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:13:17.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-07T01:13:28.354 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-07T01:13:28.355 DEBUG:teuthology.task.console_log:Killing console logger for smithi038 2023-11-07T01:13:28.356 DEBUG:teuthology.task.console_log:Killing console logger for smithi044 2023-11-07T01:13:28.356 DEBUG:teuthology.task.console_log:Killing console logger for smithi163 2023-11-07T01:13:28.357 DEBUG:teuthology.exit:Finished running handlers